[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:50.391057 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:45223
I20260709 13:07:50.392665 21775 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:50.393674 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:50.409940 21781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:50.409977 21784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:50.412658 21775 server_base.cc:1061] running on GCE node
W20260709 13:07:50.410746 21782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:51.627789 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:51.628005 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:51.628156 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602471628139 us; error 0 us; skew 500 ppm
I20260709 13:07:51.628923 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:51.634114 21775 webserver.cc:533] Webserver started at http://127.21.67.254:40395/ using document root <none> and password file <none>
I20260709 13:07:51.634884 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:51.635072 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:51.635452 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:51.641024 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "98a984421a7c4cc1bc99584baa6bbf3c"
format_stamp: "Formatted at 2026-07-09 13:07:51 on dist-test-slave-zkvt"
I20260709 13:07:51.648355 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:51.653183 21790 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:51.654215 21775 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:07:51.654512 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "98a984421a7c4cc1bc99584baa6bbf3c"
format_stamp: "Formatted at 2026-07-09 13:07:51 on dist-test-slave-zkvt"
I20260709 13:07:51.654783 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:51.705034 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:51.706458 21775 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:07:51.706842 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:51.776656 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:45223
I20260709 13:07:51.776731 21841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:45223 every 8 connection(s)
I20260709 13:07:51.784279 21842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:51.805531 21842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c: Bootstrap starting.
I20260709 13:07:51.811332 21842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.813175 21842 log.cc:826] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c: Log is configured to *not* fsync() on all Append() calls
I20260709 13:07:51.817487 21842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c: No bootstrap required, opened a new log
I20260709 13:07:51.837421 21842 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" member_type: VOTER }
I20260709 13:07:51.837960 21842 raft_consensus.cc:385] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.838227 21842 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a984421a7c4cc1bc99584baa6bbf3c, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.839108 21842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" member_type: VOTER }
I20260709 13:07:51.839610 21842 raft_consensus.cc:399] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:51.839967 21842 raft_consensus.cc:493] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:51.840332 21842 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.844528 21842 raft_consensus.cc:515] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" member_type: VOTER }
I20260709 13:07:51.845199 21842 leader_election.cc:304] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98a984421a7c4cc1bc99584baa6bbf3c; no voters: 
I20260709 13:07:51.846912 21842 leader_election.cc:290] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:51.847239 21845 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.849426 21845 raft_consensus.cc:697] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 1 LEADER]: Becoming Leader. State: Replica: 98a984421a7c4cc1bc99584baa6bbf3c, State: Running, Role: LEADER
I20260709 13:07:51.850320 21845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" member_type: VOTER }
I20260709 13:07:51.851424 21842 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:51.861200 21847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98a984421a7c4cc1bc99584baa6bbf3c. Latest consensus state: current_term: 1 leader_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" member_type: VOTER } }
I20260709 13:07:51.861951 21847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:51.862825 21846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a984421a7c4cc1bc99584baa6bbf3c" member_type: VOTER } }
I20260709 13:07:51.863478 21846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:51.868567 21855 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:51.880443 21855 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:51.882859 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:51.897574 21855 catalog_manager.cc:1383] Generated new cluster ID: 585124b99adc4019b527f284bf54ee4e
I20260709 13:07:51.897877 21855 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:51.910151 21855 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:51.911557 21855 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:51.924693 21855 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c: Generated new TSK 0
I20260709 13:07:51.925513 21855 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:51.949898 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:51.959883 21864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:51.961061 21865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:51.965080 21775 server_base.cc:1061] running on GCE node
W20260709 13:07:51.965958 21867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:51.966928 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:51.967163 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:51.967355 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602471967336 us; error 0 us; skew 500 ppm
I20260709 13:07:51.968043 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:51.972263 21775 webserver.cc:533] Webserver started at http://127.21.67.193:38519/ using document root <none> and password file <none>
I20260709 13:07:51.972808 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:51.973030 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:51.973330 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:51.974484 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "e769de5650164cd4865787ac84f637e7"
format_stamp: "Formatted at 2026-07-09 13:07:51 on dist-test-slave-zkvt"
I20260709 13:07:51.980034 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:07:51.984272 21872 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:51.985227 21775 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:07:51.985564 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "e769de5650164cd4865787ac84f637e7"
format_stamp: "Formatted at 2026-07-09 13:07:51 on dist-test-slave-zkvt"
I20260709 13:07:51.985859 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:52.006031 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:52.007315 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:52.010035 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:52.014005 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:52.014249 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.014535 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:52.014711 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.113121 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:38473
I20260709 13:07:52.113253 21934 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:38473 every 8 connection(s)
I20260709 13:07:52.120582 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:52.133507 21939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:52.135000 21940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:52.140172 21942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:52.141330 21775 server_base.cc:1061] running on GCE node
I20260709 13:07:52.142235 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:52.142467 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:52.142661 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602472142638 us; error 0 us; skew 500 ppm
I20260709 13:07:52.143257 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:52.146982 21775 webserver.cc:533] Webserver started at http://127.21.67.194:42959/ using document root <none> and password file <none>
I20260709 13:07:52.147656 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:52.147925 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:52.148272 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:52.149808 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "4d6235ba51a1430f8e4cc4348769a14f"
format_stamp: "Formatted at 2026-07-09 13:07:52 on dist-test-slave-zkvt"
I20260709 13:07:52.155939 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:07:52.156561 21935 heartbeater.cc:344] Connected to a master server at 127.21.67.254:45223
I20260709 13:07:52.157074 21935 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:52.158371 21935 heartbeater.cc:507] Master 127.21.67.254:45223 requested a full tablet report, sending...
I20260709 13:07:52.161602 21947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.161934 21807 ts_manager.cc:194] Registered new tserver with Master: e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473)
I20260709 13:07:52.162583 21775 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:52.162830 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "4d6235ba51a1430f8e4cc4348769a14f"
format_stamp: "Formatted at 2026-07-09 13:07:52 on dist-test-slave-zkvt"
I20260709 13:07:52.163072 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:52.165015 21807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51850
I20260709 13:07:52.180766 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:52.182107 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:52.184849 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:52.188540 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:52.188741 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.189059 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:52.189255 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.297396 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:32933
I20260709 13:07:52.297506 22009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:32933 every 8 connection(s)
I20260709 13:07:52.304095 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:52.311894 22013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:52.314108 22014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:52.319671 22010 heartbeater.cc:344] Connected to a master server at 127.21.67.254:45223
I20260709 13:07:52.320182 22010 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:52.321324 22010 heartbeater.cc:507] Master 127.21.67.254:45223 requested a full tablet report, sending...
I20260709 13:07:52.324321 21807 ts_manager.cc:194] Registered new tserver with Master: 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:52.326532 21807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51864
I20260709 13:07:52.334769 21775 server_base.cc:1061] running on GCE node
W20260709 13:07:52.334875 22016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:52.335901 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:52.336076 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:52.336290 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602472336256 us; error 0 us; skew 500 ppm
I20260709 13:07:52.336838 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:52.339565 21775 webserver.cc:533] Webserver started at http://127.21.67.195:44491/ using document root <none> and password file <none>
I20260709 13:07:52.340076 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:52.340261 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:52.340528 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:52.341600 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
format_stamp: "Formatted at 2026-07-09 13:07:52 on dist-test-slave-zkvt"
I20260709 13:07:52.346159 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:52.349539 22021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.350342 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:52.350600 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
format_stamp: "Formatted at 2026-07-09 13:07:52 on dist-test-slave-zkvt"
I20260709 13:07:52.350858 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:52.366902 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:52.368119 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:52.369532 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:52.371516 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:52.371738 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.371978 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:52.372120 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:52.465395 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:37939
I20260709 13:07:52.465482 22083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:37939 every 8 connection(s)
I20260709 13:07:52.486984 22084 heartbeater.cc:344] Connected to a master server at 127.21.67.254:45223
I20260709 13:07:52.487427 22084 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:52.488371 22084 heartbeater.cc:507] Master 127.21.67.254:45223 requested a full tablet report, sending...
I20260709 13:07:52.490473 21807 ts_manager.cc:194] Registered new tserver with Master: 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:52.490947 21775 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014614767s
I20260709 13:07:52.492224 21807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51880
I20260709 13:07:52.538297 21807 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51890:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:52.541755 21807 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:52.637061 21975 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b5d7bdf4f4027b3180a826bb19d27 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:52.638804 21975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b5d7bdf4f4027b3180a826bb19d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.641084 21972 tablet_service.cc:1511] Processing CreateTablet for tablet b35dcb5b67044f49b7b588c4842b0cd3 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:52.642470 21972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35dcb5b67044f49b7b588c4842b0cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.644882 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 492880dbe0b343e698bcdf99664cafce (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:52.647046 21974 tablet_service.cc:1511] Processing CreateTablet for tablet c6e40ab8d3d04064a60336a5cfc3236c (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:52.648545 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492880dbe0b343e698bcdf99664cafce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.652719 21974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e40ab8d3d04064a60336a5cfc3236c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.658558 21971 tablet_service.cc:1511] Processing CreateTablet for tablet 14af8fdd522646239ec50dff4a3b0d99 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:52.660861 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14af8fdd522646239ec50dff4a3b0d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.675958 21900 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b5d7bdf4f4027b3180a826bb19d27 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:52.681391 21899 tablet_service.cc:1511] Processing CreateTablet for tablet c6e40ab8d3d04064a60336a5cfc3236c (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:52.680473 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 492880dbe0b343e698bcdf99664cafce (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:52.687698 21897 tablet_service.cc:1511] Processing CreateTablet for tablet b35dcb5b67044f49b7b588c4842b0cd3 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:52.692497 21900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b5d7bdf4f4027b3180a826bb19d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.695026 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 14af8fdd522646239ec50dff4a3b0d99 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:52.703238 21895 tablet_service.cc:1511] Processing CreateTablet for tablet 7f46b5632e014bed850801e9d6bd1f24 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:52.704299 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e40ab8d3d04064a60336a5cfc3236c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.709398 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492880dbe0b343e698bcdf99664cafce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.710486 22101 tablet_bootstrap.cc:492] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:52.713676 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f46b5632e014bed850801e9d6bd1f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.712896 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 7f46b5632e014bed850801e9d6bd1f24 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:52.717983 22048 tablet_service.cc:1511] Processing CreateTablet for tablet c6e40ab8d3d04064a60336a5cfc3236c (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:52.713730 22049 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b5d7bdf4f4027b3180a826bb19d27 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:52.721462 22048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e40ab8d3d04064a60336a5cfc3236c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.719153 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14af8fdd522646239ec50dff4a3b0d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.721796 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f46b5632e014bed850801e9d6bd1f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.724918 22049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b5d7bdf4f4027b3180a826bb19d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.726994 22047 tablet_service.cc:1511] Processing CreateTablet for tablet 492880dbe0b343e698bcdf99664cafce (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:52.730489 22046 tablet_service.cc:1511] Processing CreateTablet for tablet b35dcb5b67044f49b7b588c4842b0cd3 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:52.732344 22047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492880dbe0b343e698bcdf99664cafce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.734289 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35dcb5b67044f49b7b588c4842b0cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.736485 22046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35dcb5b67044f49b7b588c4842b0cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.736487 22045 tablet_service.cc:1511] Processing CreateTablet for tablet 14af8fdd522646239ec50dff4a3b0d99 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:52.739566 22045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14af8fdd522646239ec50dff4a3b0d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.746492 22044 tablet_service.cc:1511] Processing CreateTablet for tablet 7f46b5632e014bed850801e9d6bd1f24 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:52.749189 22044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f46b5632e014bed850801e9d6bd1f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.807898 22102 tablet_bootstrap.cc:492] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:52.825302 22103 tablet_bootstrap.cc:492] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:52.829906 21974 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae4798cecd84e89982e361221027a58 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:52.830561 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae4798cecd84e89982e361221027a58 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:52.832130 21974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae4798cecd84e89982e361221027a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.832358 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae4798cecd84e89982e361221027a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.845675 22101 tablet_bootstrap.cc:654] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.865629 22102 tablet_bootstrap.cc:654] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:52.870489 21854 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:52.875380 22049 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae4798cecd84e89982e361221027a58 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:52.876657 22049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae4798cecd84e89982e361221027a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.884346 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 5564fd8e3a7b413cb4b2d04c298af553 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:52.885653 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5564fd8e3a7b413cb4b2d04c298af553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.895761 22044 tablet_service.cc:1511] Processing CreateTablet for tablet 5564fd8e3a7b413cb4b2d04c298af553 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:52.897418 22044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5564fd8e3a7b413cb4b2d04c298af553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.900938 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 5564fd8e3a7b413cb4b2d04c298af553 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:52.902405 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5564fd8e3a7b413cb4b2d04c298af553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.906809 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 71b3f16113124de69ec9533712d5e781 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:52.908587 22103 tablet_bootstrap.cc:654] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.908404 21971 tablet_service.cc:1511] Processing CreateTablet for tablet 71b3f16113124de69ec9533712d5e781 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:52.910063 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b3f16113124de69ec9533712d5e781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.913229 22046 tablet_service.cc:1511] Processing CreateTablet for tablet 71b3f16113124de69ec9533712d5e781 (DEFAULT_TABLE table=test-workload [id=e521a7413af74f378c4479e5985a1582]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:52.914337 22046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b3f16113124de69ec9533712d5e781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.903488 22101 tablet_bootstrap.cc:492] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:52.922818 22101 ts_tablet_manager.cc:1403] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.217s	user 0.013s	sys 0.009s
I20260709 13:07:52.909408 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b3f16113124de69ec9533712d5e781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:52.926556 22102 tablet_bootstrap.cc:492] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:52.926988 22102 ts_tablet_manager.cc:1403] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.025s
I20260709 13:07:52.962797 22101 raft_consensus.cc:359] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:52.973462 22102 raft_consensus.cc:359] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:52.974576 22102 raft_consensus.cc:385] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.974949 22102 raft_consensus.cc:740] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.976120 22102 consensus_queue.cc:260] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:52.963855 22101 raft_consensus.cc:385] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.977710 22101 raft_consensus.cc:740] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.979274 22101 consensus_queue.cc:260] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:52.980947 22103 tablet_bootstrap.cc:492] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:52.981375 22103 ts_tablet_manager.cc:1403] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.004s
I20260709 13:07:52.983978 22103 raft_consensus.cc:359] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:52.984799 22103 raft_consensus.cc:385] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.985186 22103 raft_consensus.cc:740] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.986004 22103 consensus_queue.cc:260] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:52.994133 22010 heartbeater.cc:499] Master 127.21.67.254:45223 was elected leader, sending a full tablet report...
I20260709 13:07:52.994587 22101 ts_tablet_manager.cc:1434] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.071s	user 0.016s	sys 0.004s
I20260709 13:07:52.995685 22101 tablet_bootstrap.cc:492] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.002593 22101 tablet_bootstrap.cc:654] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.014175 22084 heartbeater.cc:499] Master 127.21.67.254:45223 was elected leader, sending a full tablet report...
I20260709 13:07:53.014703 22102 ts_tablet_manager.cc:1434] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.087s	user 0.019s	sys 0.045s
I20260709 13:07:53.015825 22102 tablet_bootstrap.cc:492] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.023730 22102 tablet_bootstrap.cc:654] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.036952 21935 heartbeater.cc:499] Master 127.21.67.254:45223 was elected leader, sending a full tablet report...
I20260709 13:07:53.037694 22103 ts_tablet_manager.cc:1434] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.056s	user 0.022s	sys 0.030s
I20260709 13:07:53.038899 22103 tablet_bootstrap.cc:492] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.051012 22103 tablet_bootstrap.cc:654] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:53.053776 22011 tablet.cc:2406] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:53.056588 22101 tablet_bootstrap.cc:492] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.057188 22101 ts_tablet_manager.cc:1403] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.062s	user 0.030s	sys 0.015s
I20260709 13:07:53.061444 22101 raft_consensus.cc:359] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.062337 22101 raft_consensus.cc:385] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.062724 22101 raft_consensus.cc:740] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.063586 22101 consensus_queue.cc:260] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.067090 22101 ts_tablet_manager.cc:1434] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:53.069499 22101 tablet_bootstrap.cc:492] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.075749 22101 tablet_bootstrap.cc:654] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.075771 22102 tablet_bootstrap.cc:492] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.076630 22102 ts_tablet_manager.cc:1403] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.061s	user 0.026s	sys 0.028s
I20260709 13:07:53.078891 22103 tablet_bootstrap.cc:492] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.079398 22103 ts_tablet_manager.cc:1403] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.012s
I20260709 13:07:53.082844 22103 raft_consensus.cc:359] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.083549 22103 raft_consensus.cc:385] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.080703 22102 raft_consensus.cc:359] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.083863 22103 raft_consensus.cc:740] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.084376 22102 raft_consensus.cc:385] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.084722 22103 consensus_queue.cc:260] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.085088 22102 raft_consensus.cc:740] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.087107 22103 ts_tablet_manager.cc:1434] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:53.087976 22103 tablet_bootstrap.cc:492] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.093302 22102 consensus_queue.cc:260] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.094408 22103 tablet_bootstrap.cc:654] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.094444 22101 tablet_bootstrap.cc:492] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.095722 22101 ts_tablet_manager.cc:1403] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.014s
I20260709 13:07:53.097841 22102 ts_tablet_manager.cc:1434] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:07:53.098858 22102 tablet_bootstrap.cc:492] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.098582 22101 raft_consensus.cc:359] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.099288 22101 raft_consensus.cc:385] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.099601 22101 raft_consensus.cc:740] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.100342 22101 consensus_queue.cc:260] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.102404 22101 ts_tablet_manager.cc:1434] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:07:53.105656 22101 tablet_bootstrap.cc:492] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.109807 22102 tablet_bootstrap.cc:654] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.111639 22101 tablet_bootstrap.cc:654] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.121295 22102 tablet_bootstrap.cc:492] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.121806 22102 ts_tablet_manager.cc:1403] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 13:07:53.123128 22103 tablet_bootstrap.cc:492] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.123569 22103 ts_tablet_manager.cc:1403] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.005s
I20260709 13:07:53.124848 22102 raft_consensus.cc:359] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.125689 22102 raft_consensus.cc:385] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.126070 22102 raft_consensus.cc:740] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.126344 22103 raft_consensus.cc:359] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.127187 22103 raft_consensus.cc:385] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.126888 22102 consensus_queue.cc:260] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.127496 22103 raft_consensus.cc:740] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.128285 22103 consensus_queue.cc:260] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.132221 22103 ts_tablet_manager.cc:1434] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:07:53.133133 22103 tablet_bootstrap.cc:492] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.142066 22102 ts_tablet_manager.cc:1434] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 13:07:53.140558 22103 tablet_bootstrap.cc:654] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.146082 22102 tablet_bootstrap.cc:492] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.149197 22101 tablet_bootstrap.cc:492] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.149646 22101 ts_tablet_manager.cc:1403] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.016s
I20260709 13:07:53.154839 22109 raft_consensus.cc:493] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.155285 22109 raft_consensus.cc:515] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.158195 22109 leader_election.cc:290] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.153053 22101 raft_consensus.cc:359] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.159842 22101 raft_consensus.cc:385] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.160125 22101 raft_consensus.cc:740] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.160796 22101 consensus_queue.cc:260] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.162817 22101 ts_tablet_manager.cc:1434] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:07:53.164319 22101 tablet_bootstrap.cc:492] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.170560 22101 tablet_bootstrap.cc:654] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.170416 22107 raft_consensus.cc:493] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.171061 22107 raft_consensus.cc:515] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.172025 22103 tablet_bootstrap.cc:492] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.172469 22103 ts_tablet_manager.cc:1403] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.010s
I20260709 13:07:53.178582 22103 raft_consensus.cc:359] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.179276 22103 raft_consensus.cc:385] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.181191 22108 raft_consensus.cc:493] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.181756 22108 raft_consensus.cc:515] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.157713 22102 tablet_bootstrap.cc:654] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.179574 22103 raft_consensus.cc:740] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.192293 22103 consensus_queue.cc:260] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.196674 22108 leader_election.cc:290] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:53.201478 22103 ts_tablet_manager.cc:1434] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:07:53.202703 22103 tablet_bootstrap.cc:492] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.195690 22107 leader_election.cc:290] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939), e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473)
I20260709 13:07:53.236133 22109 raft_consensus.cc:493] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.240435 22109 raft_consensus.cc:515] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.248875 22109 leader_election.cc:290] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.252115 22101 tablet_bootstrap.cc:492] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.253815 22101 ts_tablet_manager.cc:1403] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.005s
I20260709 13:07:53.259405 22103 tablet_bootstrap.cc:654] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.261236 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.261332 22059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.262858 22102 tablet_bootstrap.cc:492] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.260219 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae4798cecd84e89982e361221027a58" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.267297 22101 raft_consensus.cc:359] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.270169 22101 raft_consensus.cc:385] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:53.270941 21873 leader_election.cc:343] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.269361 22102 ts_tablet_manager.cc:1403] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.023s
I20260709 13:07:53.271883 22101 raft_consensus.cc:740] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.267736 22059 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
W20260709 13:07:53.280323 21873 leader_election.cc:343] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.281044 22101 consensus_queue.cc:260] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.296442 22109 raft_consensus.cc:493] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.296749 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.287575 22059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae4798cecd84e89982e361221027a58" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.298748 22109 raft_consensus.cc:515] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.299185 21985 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 0.
W20260709 13:07:53.303102 21875 leader_election.cc:343] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.288465 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.303541 21875 leader_election.cc:304] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e769de5650164cd4865787ac84f637e7; no voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:53.302255 22022 leader_election.cc:304] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.305231 22109 leader_election.cc:290] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.306244 22108 raft_consensus.cc:2804] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.307523 22108 raft_consensus.cc:493] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.307901 22108 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.304409 22103 tablet_bootstrap.cc:492] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.306255 22109 raft_consensus.cc:2749] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.300689 21950 leader_election.cc:304] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.311015 22101 ts_tablet_manager.cc:1434] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 13:07:53.316068 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.315003 22103 ts_tablet_manager.cc:1403] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.004s
I20260709 13:07:53.320396 22101 tablet_bootstrap.cc:492] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.320561 22107 raft_consensus.cc:2804] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.321048 22107 raft_consensus.cc:493] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.321460 22107 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.320036 21985 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 0.
I20260709 13:07:53.323764 21873 leader_election.cc:304] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.327585 22109 raft_consensus.cc:2804] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.331892 22109 raft_consensus.cc:493] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.332219 22109 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.337574 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7" is_pre_election: true
I20260709 13:07:53.327106 22102 raft_consensus.cc:359] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
W20260709 13:07:53.342617 21950 leader_election.cc:343] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.345062 22107 raft_consensus.cc:515] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.345996 22102 raft_consensus.cc:385] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.349378 22102 raft_consensus.cc:740] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.350144 22102 consensus_queue.cc:260] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.351629 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
W20260709 13:07:53.348663 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:37939, user_credentials={real_user=slave}} blocked reactor thread for 46071.5us
I20260709 13:07:53.352301 22107 leader_election.cc:290] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Requested vote from peers 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939), e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473)
I20260709 13:07:53.353307 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:53.353376 22059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.354019 22059 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 0.
I20260709 13:07:53.354094 22103 raft_consensus.cc:359] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.352169 22058 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:53.354615 21950 leader_election.cc:343] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.348559 22108 raft_consensus.cc:515] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
W20260709 13:07:53.355474 21875 leader_election.cc:343] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.355926 21875 leader_election.cc:304] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e769de5650164cd4865787ac84f637e7; no voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:53.356397 22103 raft_consensus.cc:385] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.356793 22103 raft_consensus.cc:740] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.359573 22109 raft_consensus.cc:515] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.360383 22108 leader_election.cc:290] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:53.361634 22109 leader_election.cc:290] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.362134 22109 raft_consensus.cc:2749] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.362277 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:53.362831 21984 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.361083 22107 raft_consensus.cc:493] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.364933 22107 raft_consensus.cc:515] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.367259 22102 ts_tablet_manager.cc:1434] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.095s	user 0.003s	sys 0.006s
I20260709 13:07:53.368247 22102 tablet_bootstrap.cc:492] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.368614 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7" is_pre_election: true
I20260709 13:07:53.368778 22107 leader_election.cc:290] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.369881 22059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.370450 22059 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.371619 21950 leader_election.cc:304] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.372385 22107 raft_consensus.cc:2804] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.372774 22107 raft_consensus.cc:493] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.373134 22107 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.357064 22132 raft_consensus.cc:493] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.358919 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:53.374699 21985 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.375456 22102 tablet_bootstrap.cc:654] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.381249 21985 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 1.
I20260709 13:07:53.382412 22022 leader_election.cc:304] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.374127 21984 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 1.
I20260709 13:07:53.383319 22133 raft_consensus.cc:2804] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.383836 22133 raft_consensus.cc:697] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 LEADER]: Becoming Leader. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:07:53.384402 21873 leader_election.cc:304] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.384691 22133 consensus_queue.cc:237] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.384425 22132 raft_consensus.cc:515] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.388926 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.389225 22102 tablet_bootstrap.cc:492] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.389663 22102 ts_tablet_manager.cc:1403] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:07:53.389786 21984 raft_consensus.cc:2393] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e769de5650164cd4865787ac84f637e7 in current term 1: Already voted for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in this term.
I20260709 13:07:53.390218 22101 tablet_bootstrap.cc:654] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.391556 22132 leader_election.cc:290] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.392246 22132 raft_consensus.cc:2804] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.392882 22132 raft_consensus.cc:697] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:53.394353 22132 consensus_queue.cc:237] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.396628 22102 raft_consensus.cc:359] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.397341 22102 raft_consensus.cc:385] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.397221 22107 raft_consensus.cc:515] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.397666 22102 raft_consensus.cc:740] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.398397 22102 consensus_queue.cc:260] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.399171 22107 leader_election.cc:290] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
W20260709 13:07:53.399561 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:37939, user_credentials={real_user=slave}} blocked reactor thread for 44122.2us
I20260709 13:07:53.399899 22103 consensus_queue.cc:260] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.400696 22109 raft_consensus.cc:493] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.400972 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:53.401134 22109 raft_consensus.cc:515] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.401518 22059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:53.402030 22059 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.402508 21910 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.406567 22109 leader_election.cc:290] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.407308 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.408172 21984 raft_consensus.cc:2393] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e769de5650164cd4865787ac84f637e7 in current term 1: Already voted for candidate 4d6235ba51a1430f8e4cc4348769a14f in this term.
I20260709 13:07:53.408245 22057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:53.408980 22057 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.409673 22059 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 1.
I20260709 13:07:53.411744 22059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.415622 22057 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
I20260709 13:07:53.416095 21875 leader_election.cc:304] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e769de5650164cd4865787ac84f637e7; no voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:53.417939 21807 catalog_manager.cc:5697] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195). New cstate: current_term: 1 leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.419200 22102 ts_tablet_manager.cc:1434] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:07:53.420208 22102 tablet_bootstrap.cc:492] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.420106 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.420915 22056 raft_consensus.cc:2393] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e769de5650164cd4865787ac84f637e7 in current term 1: Already voted for candidate 4d6235ba51a1430f8e4cc4348769a14f in this term.
I20260709 13:07:53.422263 21950 leader_election.cc:304] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: e769de5650164cd4865787ac84f637e7
I20260709 13:07:53.423043 22107 raft_consensus.cc:2804] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.423485 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:53.424007 21909 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.426087 22102 tablet_bootstrap.cc:654] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.428045 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7" is_pre_election: true
I20260709 13:07:53.397688 22058 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
I20260709 13:07:53.430919 22107 raft_consensus.cc:697] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:53.433239 21950 leader_election.cc:304] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: e769de5650164cd4865787ac84f637e7
I20260709 13:07:53.433815 21875 leader_election.cc:304] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e769de5650164cd4865787ac84f637e7; no voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:53.432423 22107 consensus_queue.cc:237] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.434242 22103 ts_tablet_manager.cc:1434] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.115s	user 0.010s	sys 0.005s
I20260709 13:07:53.435405 22103 tablet_bootstrap.cc:492] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.437247 22132 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.441370 21909 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 1.
I20260709 13:07:53.443039 22139 raft_consensus.cc:2804] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.447700 22103 tablet_bootstrap.cc:654] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.451815 22134 raft_consensus.cc:2749] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.450815 22132 raft_consensus.cc:2749] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.457442 22101 tablet_bootstrap.cc:492] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.457897 22101 ts_tablet_manager.cc:1403] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.003s
I20260709 13:07:53.461318 22101 raft_consensus.cc:359] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.462007 22101 raft_consensus.cc:385] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.462275 22101 raft_consensus.cc:740] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.462949 22101 consensus_queue.cc:260] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.465075 21806 catalog_manager.cc:5697] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.471453 22103 tablet_bootstrap.cc:492] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.471983 22103 ts_tablet_manager.cc:1403] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.008s
I20260709 13:07:53.474658 22103 raft_consensus.cc:359] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.475298 22103 raft_consensus.cc:385] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.477010 22101 ts_tablet_manager.cc:1434] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.006s
I20260709 13:07:53.475584 22103 raft_consensus.cc:740] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.479259 22102 tablet_bootstrap.cc:492] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.478798 22103 consensus_queue.cc:260] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.479739 22102 ts_tablet_manager.cc:1403] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.007s
I20260709 13:07:53.481341 22103 ts_tablet_manager.cc:1434] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:07:53.482285 22103 tablet_bootstrap.cc:492] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.483270 22102 raft_consensus.cc:359] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.484701 22102 raft_consensus.cc:385] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.485172 22102 raft_consensus.cc:740] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.486141 22102 consensus_queue.cc:260] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.477936 22101 tablet_bootstrap.cc:492] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.492599 22103 tablet_bootstrap.cc:654] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.493110 22139 raft_consensus.cc:697] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:53.494851 22102 ts_tablet_manager.cc:1434] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:07:53.496354 22102 tablet_bootstrap.cc:492] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.495000 22139 consensus_queue.cc:237] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.511129 22101 tablet_bootstrap.cc:654] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.514369 22102 tablet_bootstrap.cc:654] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.528643 21805 catalog_manager.cc:5697] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.548518 22103 tablet_bootstrap.cc:492] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.549008 22103 ts_tablet_manager.cc:1403] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.028s
I20260709 13:07:53.549417 22101 tablet_bootstrap.cc:492] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.550208 22101 ts_tablet_manager.cc:1403] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.072s	user 0.006s	sys 0.013s
I20260709 13:07:53.553797 22102 tablet_bootstrap.cc:492] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.553650 22101 raft_consensus.cc:359] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.554513 22101 raft_consensus.cc:385] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.557682 22101 raft_consensus.cc:740] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.558275 22101 consensus_queue.cc:260] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.559986 22101 ts_tablet_manager.cc:1434] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:53.560743 22101 tablet_bootstrap.cc:492] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.555410 21806 catalog_manager.cc:5697] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.554940 22102 ts_tablet_manager.cc:1403] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.008s
I20260709 13:07:53.557076 22103 raft_consensus.cc:359] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.566215 22103 raft_consensus.cc:385] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.566599 22103 raft_consensus.cc:740] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.566766 22102 raft_consensus.cc:359] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.567621 22102 raft_consensus.cc:385] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.567463 22103 consensus_queue.cc:260] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.568033 22102 raft_consensus.cc:740] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.569494 22103 ts_tablet_manager.cc:1434] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:07:53.570470 22103 tablet_bootstrap.cc:492] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.577188 22103 tablet_bootstrap.cc:654] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.577188 22101 tablet_bootstrap.cc:654] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.578555 22139 raft_consensus.cc:493] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.579003 22139 raft_consensus.cc:515] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.581171 22139 leader_election.cc:290] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.581764 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7" is_pre_election: true
I20260709 13:07:53.582342 21909 raft_consensus.cc:2468] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.584120 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.584761 22058 raft_consensus.cc:2468] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.585937 21950 leader_election.cc:304] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.586689 22139 raft_consensus.cc:2804] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.587131 22139 raft_consensus.cc:493] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.587494 22139 raft_consensus.cc:3060] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.589913 22103 tablet_bootstrap.cc:492] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.590340 22103 ts_tablet_manager.cc:1403] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 13:07:53.592975 22103 raft_consensus.cc:359] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.593812 22103 raft_consensus.cc:385] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.594079 22103 raft_consensus.cc:740] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.594590 22139 raft_consensus.cc:515] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.594834 22103 consensus_queue.cc:260] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.595269 22101 tablet_bootstrap.cc:492] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.595906 22101 ts_tablet_manager.cc:1403] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.008s
I20260709 13:07:53.596742 22139 leader_election.cc:290] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.597363 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:53.597860 21909 raft_consensus.cc:3060] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.598417 22103 ts_tablet_manager.cc:1434] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:53.599265 22103 tablet_bootstrap.cc:492] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7: Bootstrap starting.
I20260709 13:07:53.601037 22101 raft_consensus.cc:359] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.604693 22103 tablet_bootstrap.cc:654] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.604796 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:53.605337 22058 raft_consensus.cc:3060] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.601671 22101 raft_consensus.cc:385] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.612032 22101 raft_consensus.cc:740] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.613399 22058 raft_consensus.cc:2468] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
I20260709 13:07:53.612898 22101 consensus_queue.cc:260] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.614045 21909 raft_consensus.cc:2468] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
I20260709 13:07:53.617761 22101 ts_tablet_manager.cc:1434] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:07:53.618860 22101 tablet_bootstrap.cc:492] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f: Bootstrap starting.
I20260709 13:07:53.622128 21950 leader_election.cc:304] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.622969 22139 raft_consensus.cc:2804] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.623581 22139 raft_consensus.cc:697] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:53.570250 22102 consensus_queue.cc:260] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.627996 22144 raft_consensus.cc:493] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.628623 22144 raft_consensus.cc:515] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.632589 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7" is_pre_election: true
I20260709 13:07:53.638587 21909 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.639722 21950 leader_election.cc:304] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.634944 22102 ts_tablet_manager.cc:1434] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.071s	user 0.000s	sys 0.006s
I20260709 13:07:53.624641 22139 consensus_queue.cc:237] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.640650 22146 raft_consensus.cc:2804] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.641037 22146 raft_consensus.cc:493] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.641353 22146 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.631419 22144 leader_election.cc:290] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.633306 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.647094 22101 tablet_bootstrap.cc:654] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.647385 22058 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.648954 22102 tablet_bootstrap.cc:492] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.650067 22146 raft_consensus.cc:515] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.652240 22146 leader_election.cc:290] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.654155 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:53.654922 22058 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.658910 22102 tablet_bootstrap.cc:654] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.660264 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:53.660806 21909 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.661964 22103 tablet_bootstrap.cc:492] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7: No bootstrap required, opened a new log
I20260709 13:07:53.662652 22058 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
I20260709 13:07:53.664324 22103 ts_tablet_manager.cc:1403] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.032s
I20260709 13:07:53.666584 21950 leader_election.cc:304] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.666918 22103 raft_consensus.cc:359] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.667689 22103 raft_consensus.cc:385] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.668020 22103 raft_consensus.cc:740] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.668913 22103 consensus_queue.cc:260] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.670644 21909 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
I20260709 13:07:53.670380 21805 catalog_manager.cc:5697] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.667312 22139 raft_consensus.cc:2804] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.672336 22139 raft_consensus.cc:697] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:53.673143 22139 consensus_queue.cc:237] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.676653 22101 tablet_bootstrap.cc:492] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f: No bootstrap required, opened a new log
I20260709 13:07:53.677093 22101 ts_tablet_manager.cc:1403] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.001s
I20260709 13:07:53.678018 22134 raft_consensus.cc:493] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.678488 22134 raft_consensus.cc:515] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.679637 22101 raft_consensus.cc:359] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.681948 22134 leader_election.cc:290] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.681974 22101 raft_consensus.cc:385] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.682964 22101 raft_consensus.cc:740] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.684059 22101 consensus_queue.cc:260] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.684578 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.685231 21984 raft_consensus.cc:2468] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 0.
I20260709 13:07:53.673162 22103 ts_tablet_manager.cc:1434] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:07:53.686844 21873 leader_election.cc:304] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.687566 22102 tablet_bootstrap.cc:492] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.688082 22102 ts_tablet_manager.cc:1403] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.014s
I20260709 13:07:53.688314 22101 ts_tablet_manager.cc:1434] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:07:53.689325 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
W20260709 13:07:53.690629 21875 leader_election.cc:343] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.690681 22102 raft_consensus.cc:359] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.691560 22102 raft_consensus.cc:385] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.691797 22134 raft_consensus.cc:2804] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.691896 22102 raft_consensus.cc:740] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.692322 22134 raft_consensus.cc:493] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.692694 22134 raft_consensus.cc:3060] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.692793 22102 consensus_queue.cc:260] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.698722 22102 ts_tablet_manager.cc:1434] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:07:53.699560 22102 tablet_bootstrap.cc:492] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Bootstrap starting.
I20260709 13:07:53.699409 22134 raft_consensus.cc:515] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.701349 22134 leader_election.cc:290] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.703189 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:53.703770 21984 raft_consensus.cc:3060] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.704872 22102 tablet_bootstrap.cc:654] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.705823 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:53.706370 22058 raft_consensus.cc:3060] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.711052 21984 raft_consensus.cc:2468] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 1.
I20260709 13:07:53.712195 21873 leader_election.cc:304] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.712738 22058 raft_consensus.cc:2468] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 1.
I20260709 13:07:53.713045 22134 raft_consensus.cc:2804] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.715175 22134 raft_consensus.cc:697] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:53.716009 22134 consensus_queue.cc:237] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.719040 22102 tablet_bootstrap.cc:492] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: No bootstrap required, opened a new log
I20260709 13:07:53.719455 22102 ts_tablet_manager.cc:1403] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.002s
I20260709 13:07:53.721935 22102 raft_consensus.cc:359] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.722853 22102 raft_consensus.cc:385] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.723142 22102 raft_consensus.cc:740] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.722095 21807 catalog_manager.cc:5697] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.723803 22102 consensus_queue.cc:260] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.725795 22102 ts_tablet_manager.cc:1434] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:53.735021 22108 raft_consensus.cc:493] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.735492 22108 raft_consensus.cc:515] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.739012 22108 leader_election.cc:290] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:53.740419 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b3f16113124de69ec9533712d5e781" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.741019 21984 raft_consensus.cc:2468] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 0.
I20260709 13:07:53.741278 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b3f16113124de69ec9533712d5e781" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7" is_pre_election: true
I20260709 13:07:53.741873 21909 raft_consensus.cc:2468] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 0.
I20260709 13:07:53.741767 21805 catalog_manager.cc:5697] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.742484 22022 leader_election.cc:304] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.743376 22108 raft_consensus.cc:2804] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.743749 22108 raft_consensus.cc:493] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.744052 22108 raft_consensus.cc:3060] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.753159 22108 raft_consensus.cc:515] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.754676 22108 leader_election.cc:290] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:53.755527 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b3f16113124de69ec9533712d5e781" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:53.755825 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b3f16113124de69ec9533712d5e781" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:53.756131 21909 raft_consensus.cc:3060] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.756330 21984 raft_consensus.cc:3060] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.762411 21909 raft_consensus.cc:2468] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 1.
I20260709 13:07:53.762418 21984 raft_consensus.cc:2468] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 1.
I20260709 13:07:53.763808 22024 leader_election.cc:304] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.764791 22108 raft_consensus.cc:2804] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.765748 22108 raft_consensus.cc:697] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 LEADER]: Becoming Leader. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:07:53.766700 22108 consensus_queue.cc:237] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.774433 21805 catalog_manager.cc:5697] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195). New cstate: current_term: 1 leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.800823 22108 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.817787 22108 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.831310 22134 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.849141 22134 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.858615 22139 raft_consensus.cc:493] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.859079 22139 raft_consensus.cc:515] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.861068 22139 leader_election.cc:290] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.862120 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae4798cecd84e89982e361221027a58" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.862756 22058 raft_consensus.cc:2468] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.862836 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae4798cecd84e89982e361221027a58" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7" is_pre_election: true
I20260709 13:07:53.863489 21909 raft_consensus.cc:2468] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 0.
I20260709 13:07:53.864006 21950 leader_election.cc:304] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:53.865492 22139 raft_consensus.cc:2804] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.865840 22139 raft_consensus.cc:493] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.866160 22139 raft_consensus.cc:3060] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.873900 22139 raft_consensus.cc:515] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.875905 22139 leader_election.cc:290] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:53.876995 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae4798cecd84e89982e361221027a58" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:53.876932 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae4798cecd84e89982e361221027a58" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:53.877581 21909 raft_consensus.cc:3060] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.877609 22058 raft_consensus.cc:3060] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.883170 22146 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.884558 21909 raft_consensus.cc:2468] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
W20260709 13:07:53.884701 21854 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:53.885582 22058 raft_consensus.cc:2468] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 1.
I20260709 13:07:53.886062 21950 leader_election.cc:304] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:53.886761 22146 raft_consensus.cc:2804] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.887223 22146 raft_consensus.cc:697] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:53.888056 22146 consensus_queue.cc:237] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:53.890223 22134 raft_consensus.cc:493] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.890662 22134 raft_consensus.cc:515] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:53.893178 22134 leader_election.cc:290] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:53.895501 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" is_pre_election: true
I20260709 13:07:53.896377 22058 raft_consensus.cc:2393] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e769de5650164cd4865787ac84f637e7 in current term 1: Already voted for candidate 4d6235ba51a1430f8e4cc4348769a14f in this term.
I20260709 13:07:53.896289 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f" is_pre_election: true
I20260709 13:07:53.898057 21873 leader_election.cc:304] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e769de5650164cd4865787ac84f637e7; no voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:53.899087 22134 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.905562 22134 raft_consensus.cc:2749] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.907275 22139 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.916530 21806 catalog_manager.cc:5697] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.014752 22146 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.023497 22139 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.041261 22139 consensus_queue.cc:1048] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.055378 22144 consensus_queue.cc:1048] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.096771 22176 consensus_queue.cc:1048] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.107712 22134 consensus_queue.cc:1048] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.116966 22144 consensus_queue.cc:1048] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.121179 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:60396
I20260709 13:07:54.121935 21984 raft_consensus.cc:606] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Received request to transfer leadership to TS e769de5650164cd4865787ac84f637e7
I20260709 13:07:54.132359 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:60396
I20260709 13:07:54.133010 21984 raft_consensus.cc:606] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Received request to transfer leadership to TS e769de5650164cd4865787ac84f637e7
I20260709 13:07:54.140005 22132 consensus_queue.cc:1048] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.146143 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:60396
I20260709 13:07:54.146735 21984 raft_consensus.cc:606] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Received request to transfer leadership to TS e769de5650164cd4865787ac84f637e7
I20260709 13:07:54.171356 22058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
mode: GRACEFUL
new_leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:51456
I20260709 13:07:54.171900 22058 raft_consensus.cc:606] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 LEADER]: Received request to transfer leadership to TS 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:54.191085 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
mode: GRACEFUL
new_leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:34102
I20260709 13:07:54.191587 21909 raft_consensus.cc:606] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Received request to transfer leadership to TS 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:54.298043 22133 consensus_queue.cc:1048] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.305612 22133 raft_consensus.cc:993] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: : Instructing follower 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:54.306051 22167 raft_consensus.cc:1081] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 LEADER]: Signalling peer 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:54.308053 21985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:60390
I20260709 13:07:54.308622 21985 raft_consensus.cc:493] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.308980 21985 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.315062 22167 consensus_queue.cc:1048] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.317406 21985 raft_consensus.cc:515] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.319448 21985 leader_election.cc:290] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 2 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:54.320587 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:54.321125 22058 raft_consensus.cc:3055] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.321439 22058 raft_consensus.cc:740] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:07:54.322444 22058 consensus_queue.cc:260] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.323088 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:54.323786 21909 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.324018 22058 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.330288 21909 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 2.
I20260709 13:07:54.333104 22058 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 2.
I20260709 13:07:54.334661 21950 leader_election.cc:304] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:54.335516 22176 raft_consensus.cc:2804] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.335997 22176 raft_consensus.cc:697] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:54.336790 22176 consensus_queue.cc:237] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.347441 21806 catalog_manager.cc:5697] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 1 to 2, leader changed from 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195) to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.448822 22176 consensus_queue.cc:1048] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.461745 22176 consensus_queue.cc:1048] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.515345 22144 raft_consensus.cc:993] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:07:54.515858 22176 raft_consensus.cc:1081] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Signalling peer e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:07:54.517293 21909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:34088
I20260709 13:07:54.517858 21909 raft_consensus.cc:493] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.518231 21909 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.523847 21909 raft_consensus.cc:515] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.526051 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:54.526348 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:54.526557 21984 raft_consensus.cc:3055] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.526477 21909 leader_election.cc:290] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:54.527330 22058 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.527359 21984 raft_consensus.cc:740] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:54.528321 21984 consensus_queue.cc:260] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.529263 21984 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.533418 21984 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:07:54.533768 22058 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:07:54.534541 21873 leader_election.cc:304] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:54.535410 22135 raft_consensus.cc:2804] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.535919 22135 raft_consensus.cc:697] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:54.536727 22135 consensus_queue.cc:237] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.543905 21806 catalog_manager.cc:5697] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 1 to 2, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.567485 22132 raft_consensus.cc:993] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7: : Instructing follower 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:54.567940 22135 raft_consensus.cc:1081] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Signalling peer 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:54.569438 21984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:07:54.569963 21984 raft_consensus.cc:493] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.570297 21984 raft_consensus.cc:3060] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.576884 21984 raft_consensus.cc:515] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.578824 21984 leader_election.cc:290] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 2 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:54.580282 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:54.580890 22058 raft_consensus.cc:3060] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.579713 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5564fd8e3a7b413cb4b2d04c298af553" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:54.581921 21909 raft_consensus.cc:3055] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.582293 21909 raft_consensus.cc:740] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:54.583200 21909 consensus_queue.cc:260] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.584529 21909 raft_consensus.cc:3060] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.589022 22058 raft_consensus.cc:2468] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 2.
I20260709 13:07:54.590983 21950 leader_election.cc:304] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:54.591849 22144 raft_consensus.cc:2804] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.592114 21909 raft_consensus.cc:2468] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 2.
I20260709 13:07:54.592331 22144 raft_consensus.cc:697] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:54.593202 22144 consensus_queue.cc:237] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.600129 21806 catalog_manager.cc:5697] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 1 to 2, leader changed from e769de5650164cd4865787ac84f637e7 (127.21.67.193) to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.612982 22146 raft_consensus.cc:993] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:07:54.613241 22139 raft_consensus.cc:993] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:07:54.613390 22146 raft_consensus.cc:1081] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Signalling peer e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:07:54.613622 22139 raft_consensus.cc:1081] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Signalling peer e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:07:54.615528 21910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:34088
I20260709 13:07:54.615952 21909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:34088
I20260709 13:07:54.616142 21910 raft_consensus.cc:493] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.616504 21909 raft_consensus.cc:493] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.616511 21910 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.616940 21909 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.623322 21909 raft_consensus.cc:515] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.623379 21910 raft_consensus.cc:515] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:54.625383 21909 leader_election.cc:290] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:54.626053 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:54.626587 21984 raft_consensus.cc:3055] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.626658 21910 leader_election.cc:290] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Requested vote from peers 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:54.626959 21984 raft_consensus.cc:740] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:54.627036 22058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:54.627624 22058 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.627774 21984 consensus_queue.cc:260] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.628260 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:54.628767 22056 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.629070 21984 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.632767 21985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:54.633351 21985 raft_consensus.cc:3055] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.633755 21985 raft_consensus.cc:740] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:54.634119 22058 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:07:54.634605 21985 consensus_queue.cc:260] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:54.635190 21875 leader_election.cc:304] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:54.635825 21985 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.637010 22056 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:07:54.638103 21875 leader_election.cc:304] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:54.638558 22135 raft_consensus.cc:2804] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.638881 22132 raft_consensus.cc:2804] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.639334 22132 raft_consensus.cc:697] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:54.639739 22135 raft_consensus.cc:697] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:54.640132 22132 consensus_queue.cc:237] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:54.640560 22135 consensus_queue.cc:237] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:54.642243 21985 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:07:54.644526 21984 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:07:54.649365 21806 catalog_manager.cc:5697] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 1 to 2, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.664296 21806 catalog_manager.cc:5697] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 1 to 2, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.784026 22056 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.785154 22176 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.792374 21910 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.794034 22139 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.928191 22056 raft_consensus.cc:1275] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.929327 22135 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.937438 21984 raft_consensus.cc:1275] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.939224 22132 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.984704 22056 raft_consensus.cc:1275] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.985898 22139 consensus_queue.cc:1048] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.993237 21910 raft_consensus.cc:1275] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.994503 22144 consensus_queue.cc:1048] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.033339 22056 raft_consensus.cc:1275] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.034396 22132 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.041011 21984 raft_consensus.cc:1275] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.042680 22134 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.151122 21984 raft_consensus.cc:1275] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.152315 22134 consensus_queue.cc:1048] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.160691 22056 raft_consensus.cc:1275] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.164295 22135 consensus_queue.cc:1048] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:57.250942 21775 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:07:57.251904 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:57.274107 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:60402
I20260709 13:07:57.274638 21984 raft_consensus.cc:606] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 LEADER]: Received request to transfer leadership to TS 1f1eb7ea19c44bdb907e84c6eb9ff1e4
I20260709 13:07:57.284734 21910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
mode: GRACEFUL
new_leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:34110
I20260709 13:07:57.285166 21910 raft_consensus.cc:606] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Received request to transfer leadership to TS 1f1eb7ea19c44bdb907e84c6eb9ff1e4
I20260709 13:07:57.286190 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:57.286620 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:57.322568 22144 raft_consensus.cc:993] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:07:57.322983 22144 raft_consensus.cc:1081] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 LEADER]: Signalling peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:07:57.324283 22056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:51440
I20260709 13:07:57.324733 22056 raft_consensus.cc:493] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.325021 22056 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:57.329790 22056 raft_consensus.cc:515] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:57.331362 22056 leader_election.cc:290] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 3 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:57.331949 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:57.332330 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:57.332530 21910 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:57.332839 21984 raft_consensus.cc:3055] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:57.333122 21984 raft_consensus.cc:740] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:57.333693 21984 consensus_queue.cc:260] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:57.334535 21984 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:57.337152 21910 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 3.
I20260709 13:07:57.338143 22024 leader_election.cc:304] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:57.338879 22197 raft_consensus.cc:2804] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:57.339219 21984 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 3.
I20260709 13:07:57.340054 22197 raft_consensus.cc:697] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 LEADER]: Becoming Leader. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:07:57.340898 22197 consensus_queue.cc:237] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:57.348829 21806 catalog_manager.cc:5697] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 reported cstate change: term changed from 2 to 3, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195). New cstate: current_term: 3 leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.459498 22080 debug-util.cc:398] Leaking SignalData structure 0x7b080016f060 after lost signal to thread 21778
W20260709 13:07:57.460443 22080 debug-util.cc:398] Leaking SignalData structure 0x7b080016f740 after lost signal to thread 21841
W20260709 13:07:57.462630 22080 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2120 after lost signal to thread 22083
I20260709 13:07:57.799005 22209 raft_consensus.cc:993] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7: : Instructing follower 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:07:57.799477 22198 raft_consensus.cc:1081] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Signalling peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:07:57.800884 22056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3"
dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:51430
I20260709 13:07:57.801343 22056 raft_consensus.cc:493] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.801640 22056 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.806578 22056 raft_consensus.cc:515] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:57.808579 22056 leader_election.cc:290] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 2 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:07:57.808918 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:57.809512 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:07:57.809562 21910 raft_consensus.cc:3055] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.810019 21984 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.810034 21910 raft_consensus.cc:740] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:57.810971 21910 consensus_queue.cc:260] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:57.812170 21910 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.816673 21984 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 2.
I20260709 13:07:57.817847 22022 leader_election.cc:304] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:57.818665 22203 raft_consensus.cc:2804] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.819120 22203 raft_consensus.cc:697] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 LEADER]: Becoming Leader. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:07:57.819509 21910 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 2.
I20260709 13:07:57.819965 22203 consensus_queue.cc:237] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:57.830447 21806 catalog_manager.cc:5697] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 reported cstate change: term changed from 1 to 2, leader changed from e769de5650164cd4865787ac84f637e7 (127.21.67.193) to 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195). New cstate: current_term: 2 leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.936962 21984 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:57.938683 22203 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.951490 21909 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:57.953518 22203 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.204805 21984 raft_consensus.cc:1275] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.205967 22203 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.217532 21909 raft_consensus.cc:1275] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.219135 22203 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.287362 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.298326 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
mode: GRACEFUL
new_leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:34102
I20260709 13:07:58.298833 21909 raft_consensus.cc:606] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Received request to transfer leadership to TS 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:58.303463 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
mode: GRACEFUL
new_leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:34102
I20260709 13:07:58.303977 21909 raft_consensus.cc:606] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Received request to transfer leadership to TS 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:58.308416 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
mode: GRACEFUL
new_leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:34102
I20260709 13:07:58.308851 21909 raft_consensus.cc:606] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Received request to transfer leadership to TS 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:58.313405 22056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3"
dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
mode: GRACEFUL
new_leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:51456
I20260709 13:07:58.313997 22056 raft_consensus.cc:606] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 LEADER]: Received request to transfer leadership to TS 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:58.318852 22056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
mode: GRACEFUL
new_leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:51456
I20260709 13:07:58.319377 22056 raft_consensus.cc:606] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 LEADER]: Received request to transfer leadership to TS 4d6235ba51a1430f8e4cc4348769a14f
I20260709 13:07:58.385016 22209 raft_consensus.cc:993] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7: : Instructing follower 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.385499 22198 raft_consensus.cc:1081] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Signalling peer 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.386868 21984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:07:58.387286 21984 raft_consensus.cc:493] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.387596 21984 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.391389 21984 raft_consensus.cc:515] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.392771 21984 leader_election.cc:290] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:58.393622 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:58.393990 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:58.394254 21909 raft_consensus.cc:3055] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:58.394510 22056 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.394595 21909 raft_consensus.cc:740] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:58.395473 21909 consensus_queue.cc:260] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.396642 21909 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.400879 22056 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.401999 21950 leader_election.cc:304] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:58.402797 21909 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.402755 22144 raft_consensus.cc:2804] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:58.404006 22144 raft_consensus.cc:697] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:58.404645 22144 consensus_queue.cc:237] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.411761 21804 catalog_manager.cc:5697] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 2 to 3, leader changed from e769de5650164cd4865787ac84f637e7 (127.21.67.193) to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 3 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.432914 22209 raft_consensus.cc:993] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7: : Instructing follower 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.433394 22198 raft_consensus.cc:1081] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Signalling peer 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.434717 21984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:07:58.435228 21984 raft_consensus.cc:493] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.435561 21984 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.442101 21984 raft_consensus.cc:515] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:58.443888 21984 leader_election.cc:290] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Requested vote from peers 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939), e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473)
I20260709 13:07:58.444890 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:58.444906 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:58.445444 22056 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.445500 21909 raft_consensus.cc:3055] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:58.445951 21909 raft_consensus.cc:740] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:58.446677 21909 consensus_queue.cc:260] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:58.447803 21909 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.449985 22056 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.450881 21950 leader_election.cc:304] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, 4d6235ba51a1430f8e4cc4348769a14f; no voters: 
I20260709 13:07:58.451535 22144 raft_consensus.cc:2804] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:58.452011 22144 raft_consensus.cc:697] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:58.452806 22144 consensus_queue.cc:237] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:07:58.454223 21909 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.459983 21804 catalog_manager.cc:5697] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 2 to 3, leader changed from e769de5650164cd4865787ac84f637e7 (127.21.67.193) to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 3 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.493544 22203 raft_consensus.cc:993] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: : Instructing follower 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.493973 22219 raft_consensus.cc:1081] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 LEADER]: Signalling peer 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.495378 21984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:60390
I20260709 13:07:58.495906 21984 raft_consensus.cc:493] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.496167 21984 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:58.499894 21984 raft_consensus.cc:515] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.501411 21984 leader_election.cc:290] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 4 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:58.502240 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:58.502758 21909 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:58.502660 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:58.503377 22056 raft_consensus.cc:3055] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:58.503759 22056 raft_consensus.cc:740] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:07:58.504571 22056 consensus_queue.cc:260] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.505818 22056 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:58.506820 21909 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 4.
I20260709 13:07:58.507762 21950 leader_election.cc:304] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:58.508407 22144 raft_consensus.cc:2804] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:58.508839 22144 raft_consensus.cc:697] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:58.509501 22144 consensus_queue.cc:237] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.513320 22056 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 4.
I20260709 13:07:58.515165 21804 catalog_manager.cc:5697] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 3 to 4, leader changed from 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195) to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 4 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.567149 22209 raft_consensus.cc:993] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7: : Instructing follower 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.567595 22198 raft_consensus.cc:1081] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Signalling peer 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.569013 21984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:07:58.569542 21984 raft_consensus.cc:493] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.569885 21984 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.576467 21984 raft_consensus.cc:515] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.578296 21984 leader_election.cc:290] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:58.579125 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:58.579499 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e40ab8d3d04064a60336a5cfc3236c" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:58.579707 21909 raft_consensus.cc:3055] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:58.580042 21909 raft_consensus.cc:740] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:07:58.580054 22056 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.580858 21909 consensus_queue.cc:260] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.581667 21909 raft_consensus.cc:3060] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.585274 21909 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.586097 21950 leader_election.cc:304] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:58.586742 22144 raft_consensus.cc:2804] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:58.587262 22144 raft_consensus.cc:697] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:58.587235 22056 raft_consensus.cc:2468] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.588135 22144 consensus_queue.cc:237] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.595327 21804 catalog_manager.cc:5697] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 2 to 3, leader changed from e769de5650164cd4865787ac84f637e7 (127.21.67.193) to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 3 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.702045 22203 raft_consensus.cc:993] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: : Instructing follower 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.702487 22219 raft_consensus.cc:1081] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 LEADER]: Signalling peer 4d6235ba51a1430f8e4cc4348769a14f to start an election
I20260709 13:07:58.703946 21984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
 from {username='slave'} at 127.0.0.1:60390
I20260709 13:07:58.704501 21984 raft_consensus.cc:493] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.704844 21984 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.711331 21984 raft_consensus.cc:515] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.713258 21984 leader_election.cc:290] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:07:58.713910 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:07:58.714426 21909 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.714671 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "4d6235ba51a1430f8e4cc4348769a14f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:07:58.715204 22056 raft_consensus.cc:3055] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:58.715590 22056 raft_consensus.cc:740] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:07:58.716367 22056 consensus_queue.cc:260] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.717430 22056 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:58.720275 21909 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.721288 21950 leader_election.cc:304] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6235ba51a1430f8e4cc4348769a14f, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:07:58.722061 22144 raft_consensus.cc:2804] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:58.722563 22144 raft_consensus.cc:697] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Becoming Leader. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:07:58.723291 22056 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6235ba51a1430f8e4cc4348769a14f in term 3.
I20260709 13:07:58.723404 22144 consensus_queue.cc:237] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:07:58.729967 21804 catalog_manager.cc:5697] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f reported cstate change: term changed from 2 to 3, leader changed from 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195) to 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194). New cstate: current_term: 3 leader_uuid: "4d6235ba51a1430f8e4cc4348769a14f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.783270 22056 raft_consensus.cc:1275] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:58.784538 22144 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.807018 21909 raft_consensus.cc:1275] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:58.808794 22144 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.881193 21909 raft_consensus.cc:1275] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:58.882568 22144 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.895493 22056 raft_consensus.cc:1275] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:58.897447 22212 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.995263 21909 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:58.996613 22230 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.003259 21909 raft_consensus.cc:1275] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:59.005470 22212 consensus_queue.cc:1048] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:59.009091 22056 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:59.010563 22230 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.024302 22056 raft_consensus.cc:1275] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:59.030720 22230 consensus_queue.cc:1048] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:59.109313 21909 raft_consensus.cc:1275] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:59.110579 22230 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:59.121305 22056 raft_consensus.cc:1275] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Refusing update from remote peer 4d6235ba51a1430f8e4cc4348769a14f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:59.123284 22237 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.332382 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:01.339299 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:60402
I20260709 13:08:01.339884 21984 raft_consensus.cc:606] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 LEADER]: Received request to transfer leadership to TS e769de5650164cd4865787ac84f637e7
I20260709 13:08:01.342074 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:60402
I20260709 13:08:01.342420 21984 raft_consensus.cc:606] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Received request to transfer leadership to TS e769de5650164cd4865787ac84f637e7
I20260709 13:08:01.344439 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:60402
I20260709 13:08:01.344774 21984 raft_consensus.cc:606] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Received request to transfer leadership to TS e769de5650164cd4865787ac84f637e7
I20260709 13:08:01.346589 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:60402
I20260709 13:08:01.346920 21984 raft_consensus.cc:606] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Received request to transfer leadership to TS 1f1eb7ea19c44bdb907e84c6eb9ff1e4
I20260709 13:08:01.348731 21984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27"
dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
mode: GRACEFUL
new_leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:60402
I20260709 13:08:01.349047 21984 raft_consensus.cc:606] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Received request to transfer leadership to TS 1f1eb7ea19c44bdb907e84c6eb9ff1e4
I20260709 13:08:01.349864 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:01.350270 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:01.458673 22243 raft_consensus.cc:993] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:08:01.459204 22242 raft_consensus.cc:1081] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Signalling peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:08:01.460754 22056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27"
dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:51440
I20260709 13:08:01.461221 22056 raft_consensus.cc:493] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.461541 22056 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.466513 22056 raft_consensus.cc:515] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:08:01.468441 22056 leader_election.cc:290] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 4 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473)
I20260709 13:08:01.469175 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:08:01.469800 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b5d7bdf4f4027b3180a826bb19d27" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:08:01.469961 21984 raft_consensus.cc:3055] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:01.470294 21909 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.470281 21984 raft_consensus.cc:740] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:08:01.471343 21984 consensus_queue.cc:260] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:08:01.472369 21984 raft_consensus.cc:3060] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.475210 21909 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 4.
I20260709 13:08:01.476440 22024 leader_election.cc:304] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:08:01.477280 22219 raft_consensus.cc:2804] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:01.477980 21984 raft_consensus.cc:2468] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 4.
I20260709 13:08:01.478055 22243 raft_consensus.cc:993] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:08:01.478471 22219 raft_consensus.cc:697] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 LEADER]: Becoming Leader. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:08:01.478783 22243 raft_consensus.cc:1081] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Signalling peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4 to start an election
I20260709 13:08:01.479548 22219 consensus_queue.cc:237] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } }
I20260709 13:08:01.480367 22056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3"
dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
 from {username='slave'} at 127.0.0.1:51440
I20260709 13:08:01.480794 22056 raft_consensus.cc:493] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.481174 22056 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.486294 22056 raft_consensus.cc:515] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.488282 22056 leader_election.cc:290] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 4 election: Requested vote from peers e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473), 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933)
I20260709 13:08:01.487524 21806 catalog_manager.cc:5697] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 reported cstate change: term changed from 3 to 4, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195). New cstate: current_term: 4 leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.488850 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e769de5650164cd4865787ac84f637e7"
I20260709 13:08:01.489364 21909 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.491415 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35dcb5b67044f49b7b588c4842b0cd3" candidate_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:08:01.491945 21984 raft_consensus.cc:3055] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:01.492249 21984 raft_consensus.cc:740] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:08:01.493016 21984 consensus_queue.cc:260] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.494076 21984 raft_consensus.cc:3060] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.495453 21909 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 4.
I20260709 13:08:01.496358 22024 leader_election.cc:304] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:08:01.497148 22219 raft_consensus.cc:2804] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:01.497586 22219 raft_consensus.cc:697] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 LEADER]: Becoming Leader. State: Replica: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, State: Running, Role: LEADER
I20260709 13:08:01.498368 22219 consensus_queue.cc:237] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.499403 21984 raft_consensus.cc:2468] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1eb7ea19c44bdb907e84c6eb9ff1e4 in term 4.
I20260709 13:08:01.507740 22242 raft_consensus.cc:993] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:08:01.508186 22243 raft_consensus.cc:1081] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 LEADER]: Signalling peer e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:08:01.510015 21909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:34088
I20260709 13:08:01.510499 21909 raft_consensus.cc:493] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.510828 21909 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:01.512118 21806 catalog_manager.cc:5697] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 reported cstate change: term changed from 3 to 4, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195). New cstate: current_term: 4 leader_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.515875 21909 raft_consensus.cc:515] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.517514 21909 leader_election.cc:290] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 5 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:08:01.518332 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:08:01.518643 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14af8fdd522646239ec50dff4a3b0d99" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:08:01.518841 21984 raft_consensus.cc:3055] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:01.519116 21984 raft_consensus.cc:740] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:08:01.519141 22056 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:01.519816 21984 consensus_queue.cc:260] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.522454 21984 raft_consensus.cc:3060] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:01.524838 22056 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 5.
I20260709 13:08:01.526029 21875 leader_election.cc:304] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:08:01.527784 22251 raft_consensus.cc:2804] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:01.528142 21984 raft_consensus.cc:2468] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 5.
I20260709 13:08:01.529045 22251 raft_consensus.cc:697] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 5 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:08:01.529858 22251 consensus_queue.cc:237] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.535887 21806 catalog_manager.cc:5697] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 4 to 5, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 5 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.562922 22242 raft_consensus.cc:993] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:08:01.563395 22243 raft_consensus.cc:1081] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Signalling peer e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:08:01.564740 21909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:34088
I20260709 13:08:01.565138 21909 raft_consensus.cc:493] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.565408 21909 raft_consensus.cc:3060] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:01.570583 21909 raft_consensus.cc:515] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.571964 21909 leader_election.cc:290] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:08:01.572921 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:08:01.573379 22056 raft_consensus.cc:3060] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:01.573374 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f46b5632e014bed850801e9d6bd1f24" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:08:01.574035 21984 raft_consensus.cc:3055] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:01.574362 21984 raft_consensus.cc:740] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:08:01.575104 21984 consensus_queue.cc:260] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.576275 21984 raft_consensus.cc:3060] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:01.579789 22056 raft_consensus.cc:2468] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:08:01.580791 21875 leader_election.cc:304] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:08:01.581432 22251 raft_consensus.cc:2804] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:01.581844 22251 raft_consensus.cc:697] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:08:01.582002 21984 raft_consensus.cc:2468] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 2.
I20260709 13:08:01.582669 22251 consensus_queue.cc:237] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.588968 21806 catalog_manager.cc:5697] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 1 to 2, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.822198 22242 raft_consensus.cc:993] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: : Instructing follower e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:08:01.822600 22243 raft_consensus.cc:1081] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Signalling peer e769de5650164cd4865787ac84f637e7 to start an election
I20260709 13:08:01.823832 21909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce"
dest_uuid: "e769de5650164cd4865787ac84f637e7"
 from {username='slave'} at 127.0.0.1:34088
I20260709 13:08:01.824312 21909 raft_consensus.cc:493] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.824636 21909 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.828639 21909 raft_consensus.cc:515] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.830107 21909 leader_election.cc:290] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 4 election: Requested vote from peers 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933), 1f1eb7ea19c44bdb907e84c6eb9ff1e4 (127.21.67.195:37939)
I20260709 13:08:01.830717 21984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d6235ba51a1430f8e4cc4348769a14f"
I20260709 13:08:01.831158 22056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492880dbe0b343e698bcdf99664cafce" candidate_uuid: "e769de5650164cd4865787ac84f637e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4"
I20260709 13:08:01.831214 21984 raft_consensus.cc:3055] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:01.831660 21984 raft_consensus.cc:740] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d6235ba51a1430f8e4cc4348769a14f, State: Running, Role: LEADER
I20260709 13:08:01.831708 22056 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.832531 21984 consensus_queue.cc:260] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.833374 21984 raft_consensus.cc:3060] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:01.835624 22056 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 4.
I20260709 13:08:01.836536 21875 leader_election.cc:304] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1eb7ea19c44bdb907e84c6eb9ff1e4, e769de5650164cd4865787ac84f637e7; no voters: 
I20260709 13:08:01.837189 22251 raft_consensus.cc:2804] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:01.837287 21984 raft_consensus.cc:2468] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e769de5650164cd4865787ac84f637e7 in term 4.
I20260709 13:08:01.837744 22251 raft_consensus.cc:697] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 4 LEADER]: Becoming Leader. State: Replica: e769de5650164cd4865787ac84f637e7, State: Running, Role: LEADER
I20260709 13:08:01.838675 22251 consensus_queue.cc:237] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } }
I20260709 13:08:01.845665 21806 catalog_manager.cc:5697] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 reported cstate change: term changed from 3 to 4, leader changed from 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194) to e769de5650164cd4865787ac84f637e7 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "e769de5650164cd4865787ac84f637e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.878921 21984 raft_consensus.cc:1275] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:01.880091 22219 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.892820 21909 raft_consensus.cc:1275] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:01.894632 22258 consensus_queue.cc:1048] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.970085 22056 raft_consensus.cc:1275] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.971272 22251 consensus_queue.cc:1048] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.979966 21984 raft_consensus.cc:1275] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.981894 22263 consensus_queue.cc:1048] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:02.016952 21984 raft_consensus.cc:1275] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:02.018172 22258 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.026362 21909 raft_consensus.cc:1275] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Refusing update from remote peer 1f1eb7ea19c44bdb907e84c6eb9ff1e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:02.028198 22244 consensus_queue.cc:1048] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e769de5650164cd4865787ac84f637e7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:02.118013 21984 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 5 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:02.119061 22251 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:02.127367 22056 raft_consensus.cc:1275] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 5 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:02.128845 22263 consensus_queue.cc:1048] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:02.294106 22056 raft_consensus.cc:1275] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:02.295220 22263 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1eb7ea19c44bdb907e84c6eb9ff1e4" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 37939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.303941 21984 raft_consensus.cc:1275] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Refusing update from remote peer e769de5650164cd4865787ac84f637e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:02.305462 22263 consensus_queue.cc:1048] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6235ba51a1430f8e4cc4348769a14f" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.351114 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:02.357388 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
I20260709 13:08:02.381597 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:02.381992 21950 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:02.382431 21775 tablet_replica.cc:333] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.383173 21775 raft_consensus.cc:2243] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.383780 21775 raft_consensus.cc:2272] T 71b3f16113124de69ec9533712d5e781 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:02.385228 21950 consensus_peers.cc:597] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f -> Peer e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473): Couldn't send request to peer e769de5650164cd4865787ac84f637e7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.386236 21775 tablet_replica.cc:333] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.386781 21775 raft_consensus.cc:2243] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.387168 21775 raft_consensus.cc:2272] T 5564fd8e3a7b413cb4b2d04c298af553 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.388988 21775 tablet_replica.cc:333] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.389490 21775 raft_consensus.cc:2243] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.389869 21775 raft_consensus.cc:2272] T eb4b5d7bdf4f4027b3180a826bb19d27 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.391867 21775 tablet_replica.cc:333] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.392362 21775 raft_consensus.cc:2243] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.393079 21775 raft_consensus.cc:2272] T 7f46b5632e014bed850801e9d6bd1f24 P e769de5650164cd4865787ac84f637e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.395123 21775 tablet_replica.cc:333] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.395851 21775 raft_consensus.cc:2243] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.396284 21775 raft_consensus.cc:2272] T c6e40ab8d3d04064a60336a5cfc3236c P e769de5650164cd4865787ac84f637e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.397852 21775 tablet_replica.cc:333] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.398298 21775 raft_consensus.cc:2243] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.398938 21775 raft_consensus.cc:2272] T 492880dbe0b343e698bcdf99664cafce P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.400743 21775 tablet_replica.cc:333] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.401194 21775 raft_consensus.cc:2243] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.401579 21775 raft_consensus.cc:2272] T b35dcb5b67044f49b7b588c4842b0cd3 P e769de5650164cd4865787ac84f637e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.403290 21775 tablet_replica.cc:333] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.403781 21775 raft_consensus.cc:2243] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.404420 21775 raft_consensus.cc:2272] T 14af8fdd522646239ec50dff4a3b0d99 P e769de5650164cd4865787ac84f637e7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.406082 21775 tablet_replica.cc:333] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7: stopping tablet replica
I20260709 13:08:02.406526 21775 raft_consensus.cc:2243] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.406873 21775 raft_consensus.cc:2272] T 3ae4798cecd84e89982e361221027a58 P e769de5650164cd4865787ac84f637e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.524075 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
W20260709 13:08:02.525892 22024 consensus_peers.cc:597] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 -> Peer e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473): Couldn't send request to peer e769de5650164cd4865787ac84f637e7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:38473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:02.526398 22024 consensus_peers.cc:597] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 -> Peer e769de5650164cd4865787ac84f637e7 (127.21.67.193:38473): Couldn't send request to peer e769de5650164cd4865787ac84f637e7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:38473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.542702 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
I20260709 13:08:02.564749 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:02.565433 21775 tablet_replica.cc:333] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.566053 21775 raft_consensus.cc:2243] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.566726 21775 raft_consensus.cc:2272] T 5564fd8e3a7b413cb4b2d04c298af553 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.568360 21775 tablet_replica.cc:333] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.568775 21775 raft_consensus.cc:2243] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.569120 21775 raft_consensus.cc:2272] T 71b3f16113124de69ec9533712d5e781 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.570598 21775 tablet_replica.cc:333] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.571089 21775 raft_consensus.cc:2243] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.571744 21775 raft_consensus.cc:2272] T 3ae4798cecd84e89982e361221027a58 P 4d6235ba51a1430f8e4cc4348769a14f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.573076 21775 tablet_replica.cc:333] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.573459 21775 raft_consensus.cc:2243] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.573832 21775 raft_consensus.cc:2272] T 7f46b5632e014bed850801e9d6bd1f24 P 4d6235ba51a1430f8e4cc4348769a14f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.575461 21775 tablet_replica.cc:333] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.575943 21775 raft_consensus.cc:2243] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.576638 21775 raft_consensus.cc:2272] T c6e40ab8d3d04064a60336a5cfc3236c P 4d6235ba51a1430f8e4cc4348769a14f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.578768 21775 tablet_replica.cc:333] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.579340 21775 raft_consensus.cc:2243] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.579708 21775 raft_consensus.cc:2272] T 492880dbe0b343e698bcdf99664cafce P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.581723 21775 tablet_replica.cc:333] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.582152 21775 raft_consensus.cc:2243] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.582512 21775 raft_consensus.cc:2272] T 14af8fdd522646239ec50dff4a3b0d99 P 4d6235ba51a1430f8e4cc4348769a14f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.584527 21775 tablet_replica.cc:333] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.584964 21775 raft_consensus.cc:2243] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.585317 21775 raft_consensus.cc:2272] T b35dcb5b67044f49b7b588c4842b0cd3 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:02.585656 22022 consensus_peers.cc:597] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 -> Peer 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933): Couldn't send request to peer 4d6235ba51a1430f8e4cc4348769a14f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.587121 21775 tablet_replica.cc:333] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f: stopping tablet replica
I20260709 13:08:02.587563 21775 raft_consensus.cc:2243] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.587973 21775 raft_consensus.cc:2272] T eb4b5d7bdf4f4027b3180a826bb19d27 P 4d6235ba51a1430f8e4cc4348769a14f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:02.604346 22022 consensus_peers.cc:597] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 -> Peer 4d6235ba51a1430f8e4cc4348769a14f (127.21.67.194:32933): Couldn't send request to peer 4d6235ba51a1430f8e4cc4348769a14f. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:32933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.614372 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
I20260709 13:08:02.629374 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
I20260709 13:08:02.650091 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:02.650700 21775 tablet_replica.cc:333] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.651345 21775 raft_consensus.cc:2243] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.652216 21775 raft_consensus.cc:2272] T 71b3f16113124de69ec9533712d5e781 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.653947 21775 tablet_replica.cc:333] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.654429 21775 raft_consensus.cc:2243] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.654810 21775 raft_consensus.cc:2272] T 5564fd8e3a7b413cb4b2d04c298af553 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.656304 21775 tablet_replica.cc:333] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.656759 21775 raft_consensus.cc:2243] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.657135 21775 raft_consensus.cc:2272] T 3ae4798cecd84e89982e361221027a58 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.658650 21775 tablet_replica.cc:333] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.659096 21775 raft_consensus.cc:2243] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.659461 21775 raft_consensus.cc:2272] T 7f46b5632e014bed850801e9d6bd1f24 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.661226 21775 tablet_replica.cc:333] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.661680 21775 raft_consensus.cc:2243] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.662334 21775 raft_consensus.cc:2272] T b35dcb5b67044f49b7b588c4842b0cd3 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.664145 21775 tablet_replica.cc:333] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.664587 21775 raft_consensus.cc:2243] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.665186 21775 raft_consensus.cc:2272] T eb4b5d7bdf4f4027b3180a826bb19d27 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.666847 21775 tablet_replica.cc:333] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.667294 21775 raft_consensus.cc:2243] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.667716 21775 raft_consensus.cc:2272] T 14af8fdd522646239ec50dff4a3b0d99 P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.669749 21775 tablet_replica.cc:333] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.670171 21775 raft_consensus.cc:2243] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.670531 21775 raft_consensus.cc:2272] T c6e40ab8d3d04064a60336a5cfc3236c P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.672016 21775 tablet_replica.cc:333] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4: stopping tablet replica
I20260709 13:08:02.672422 21775 raft_consensus.cc:2243] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:02.672817 21775 raft_consensus.cc:2272] T 492880dbe0b343e698bcdf99664cafce P 1f1eb7ea19c44bdb907e84c6eb9ff1e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.714325 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:08:02.729825 21775 master.cc:562] Master@127.21.67.254:45223 shutting down...
I20260709 13:08:02.873750 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:02.874366 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:02.874724 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P 98a984421a7c4cc1bc99584baa6bbf3c: stopping tablet replica
I20260709 13:08:02.894241 21775 master.cc:584] Master@127.21.67.254:45223 shutdown complete.
1f1eb7ea19c44bdb907e84c6eb9ff1e4  1
4d6235ba51a1430f8e4cc4348769a14f  4
e769de5650164cd4865787ac84f637e7  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12551 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:08:02.939186 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:40289
I20260709 13:08:02.940357 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:02.945809 22275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:02.947103 21775 server_base.cc:1061] running on GCE node
W20260709 13:08:02.947049 22276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:02.947242 22278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:02.948364 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:02.948583 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:02.948752 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602482948735 us; error 0 us; skew 500 ppm
I20260709 13:08:02.949285 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:02.951725 21775 webserver.cc:533] Webserver started at http://127.21.67.254:38763/ using document root <none> and password file <none>
I20260709 13:08:02.952256 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:02.952458 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:02.952739 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:02.953840 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "f56766354c2741b3bc30265a5c0378e8"
format_stamp: "Formatted at 2026-07-09 13:08:02 on dist-test-slave-zkvt"
I20260709 13:08:02.958194 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:08:02.961215 22283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:02.962023 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:08:02.962241 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "f56766354c2741b3bc30265a5c0378e8"
format_stamp: "Formatted at 2026-07-09 13:08:02 on dist-test-slave-zkvt"
I20260709 13:08:02.962466 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:02.974090 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:02.975240 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:03.011940 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:40289
I20260709 13:08:03.012063 22334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:40289 every 8 connection(s)
I20260709 13:08:03.015627 22335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.024763 22335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8: Bootstrap starting.
I20260709 13:08:03.029168 22335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.033245 22335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8: No bootstrap required, opened a new log
I20260709 13:08:03.035398 22335 raft_consensus.cc:359] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56766354c2741b3bc30265a5c0378e8" member_type: VOTER }
I20260709 13:08:03.035828 22335 raft_consensus.cc:385] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.036075 22335 raft_consensus.cc:740] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56766354c2741b3bc30265a5c0378e8, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.036782 22335 consensus_queue.cc:260] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56766354c2741b3bc30265a5c0378e8" member_type: VOTER }
I20260709 13:08:03.037247 22335 raft_consensus.cc:399] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:03.037488 22335 raft_consensus.cc:493] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:03.037791 22335 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.041736 22335 raft_consensus.cc:515] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56766354c2741b3bc30265a5c0378e8" member_type: VOTER }
I20260709 13:08:03.042237 22335 leader_election.cc:304] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f56766354c2741b3bc30265a5c0378e8; no voters: 
I20260709 13:08:03.043375 22335 leader_election.cc:290] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:03.043784 22338 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:03.045045 22338 raft_consensus.cc:697] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 1 LEADER]: Becoming Leader. State: Replica: f56766354c2741b3bc30265a5c0378e8, State: Running, Role: LEADER
I20260709 13:08:03.045732 22338 consensus_queue.cc:237] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56766354c2741b3bc30265a5c0378e8" member_type: VOTER }
I20260709 13:08:03.046262 22335 sys_catalog.cc:565] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:03.050426 22339 sys_catalog.cc:455] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f56766354c2741b3bc30265a5c0378e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56766354c2741b3bc30265a5c0378e8" member_type: VOTER } }
I20260709 13:08:03.050421 22340 sys_catalog.cc:455] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f56766354c2741b3bc30265a5c0378e8. Latest consensus state: current_term: 1 leader_uuid: "f56766354c2741b3bc30265a5c0378e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f56766354c2741b3bc30265a5c0378e8" member_type: VOTER } }
I20260709 13:08:03.051399 22339 sys_catalog.cc:458] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:03.051451 22340 sys_catalog.cc:458] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:03.053699 22345 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:03.058377 22345 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:03.063107 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:03.066401 22345 catalog_manager.cc:1383] Generated new cluster ID: 8d0e8eb9b33f481ba0db6805a0319077
I20260709 13:08:03.066628 22345 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:03.083132 22345 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:03.084227 22345 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:03.103924 22345 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8: Generated new TSK 0
I20260709 13:08:03.104457 22345 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:03.129652 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:03.135469 22356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:03.137041 22357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:03.138336 21775 server_base.cc:1061] running on GCE node
W20260709 13:08:03.138870 22359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:03.139732 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:03.139950 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:03.140116 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602483140100 us; error 0 us; skew 500 ppm
I20260709 13:08:03.140616 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:03.142746 21775 webserver.cc:533] Webserver started at http://127.21.67.193:39539/ using document root <none> and password file <none>
I20260709 13:08:03.143221 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:03.143419 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:03.143743 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:03.144825 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "0b45909b725546a59abaae76df2ddc1d"
format_stamp: "Formatted at 2026-07-09 13:08:03 on dist-test-slave-zkvt"
I20260709 13:08:03.149125 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:08:03.152156 22364 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.152990 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:03.153213 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "0b45909b725546a59abaae76df2ddc1d"
format_stamp: "Formatted at 2026-07-09 13:08:03 on dist-test-slave-zkvt"
I20260709 13:08:03.153450 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:03.179811 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:03.180963 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:03.182292 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:03.184473 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:03.184638 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.184921 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:03.185072 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.223176 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:41141
I20260709 13:08:03.223276 22426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:41141 every 8 connection(s)
I20260709 13:08:03.227828 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:03.234839 22431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:03.235477 22432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:03.238641 22434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:03.239362 21775 server_base.cc:1061] running on GCE node
I20260709 13:08:03.240236 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:03.240438 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:03.240609 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602483240590 us; error 0 us; skew 500 ppm
I20260709 13:08:03.241140 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:03.243595 21775 webserver.cc:533] Webserver started at http://127.21.67.194:38269/ using document root <none> and password file <none>
I20260709 13:08:03.244280 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:03.244514 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:03.244824 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:03.245262 22427 heartbeater.cc:344] Connected to a master server at 127.21.67.254:40289
I20260709 13:08:03.245630 22427 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:03.246273 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "2db95b2368fb4d598d4020801930f48a"
format_stamp: "Formatted at 2026-07-09 13:08:03 on dist-test-slave-zkvt"
I20260709 13:08:03.246438 22427 heartbeater.cc:507] Master 127.21.67.254:40289 requested a full tablet report, sending...
I20260709 13:08:03.248579 22300 ts_manager.cc:194] Registered new tserver with Master: 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141)
I20260709 13:08:03.250257 22300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57276
I20260709 13:08:03.251380 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:08:03.254925 22439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.255789 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:03.256013 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "2db95b2368fb4d598d4020801930f48a"
format_stamp: "Formatted at 2026-07-09 13:08:03 on dist-test-slave-zkvt"
I20260709 13:08:03.256234 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:03.279125 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:03.280287 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:03.281641 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:03.283700 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:03.283870 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.284159 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:03.284328 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.321905 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:34295
I20260709 13:08:03.321997 22501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:34295 every 8 connection(s)
I20260709 13:08:03.326351 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:03.332492 22505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:03.334460 22506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:03.336874 22508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:03.337898 22502 heartbeater.cc:344] Connected to a master server at 127.21.67.254:40289
I20260709 13:08:03.338104 21775 server_base.cc:1061] running on GCE node
I20260709 13:08:03.338296 22502 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:03.339066 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:08:03.339169 22502 heartbeater.cc:507] Master 127.21.67.254:40289 requested a full tablet report, sending...
W20260709 13:08:03.339367 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:03.339582 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602483339563 us; error 0 us; skew 500 ppm
I20260709 13:08:03.340252 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:03.341354 22300 ts_manager.cc:194] Registered new tserver with Master: 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:03.342722 21775 webserver.cc:533] Webserver started at http://127.21.67.195:42263/ using document root <none> and password file <none>
I20260709 13:08:03.342887 22300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57292
I20260709 13:08:03.343276 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:03.343500 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:03.343823 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:03.344926 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "d3fadb7179064032940ecc2946026a2e"
format_stamp: "Formatted at 2026-07-09 13:08:03 on dist-test-slave-zkvt"
I20260709 13:08:03.349105 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:03.352152 22513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.352990 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:03.353245 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "d3fadb7179064032940ecc2946026a2e"
format_stamp: "Formatted at 2026-07-09 13:08:03 on dist-test-slave-zkvt"
I20260709 13:08:03.353471 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:03.376415 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:03.377580 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:03.378888 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:03.380957 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:03.381141 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.381443 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:03.381618 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:03.418999 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:38197
I20260709 13:08:03.419087 22575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:38197 every 8 connection(s)
I20260709 13:08:03.432384 22576 heartbeater.cc:344] Connected to a master server at 127.21.67.254:40289
I20260709 13:08:03.432765 22576 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:03.433408 22576 heartbeater.cc:507] Master 127.21.67.254:40289 requested a full tablet report, sending...
I20260709 13:08:03.435242 22300 ts_manager.cc:194] Registered new tserver with Master: d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:03.436126 21775 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014172824s
I20260709 13:08:03.436565 22300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57308
I20260709 13:08:03.459121 22300 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57316:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:03.461946 22300 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:03.533131 22390 tablet_service.cc:1511] Processing CreateTablet for tablet aeabbb11aba941e6acf5610d696361cd (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:03.533691 22389 tablet_service.cc:1511] Processing CreateTablet for tablet f6326957da3e4006b224c1d3d2b998fd (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:03.534638 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeabbb11aba941e6acf5610d696361cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.535441 22389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6326957da3e4006b224c1d3d2b998fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.536607 22391 tablet_service.cc:1511] Processing CreateTablet for tablet 25aa7e92274d43edabbc5dac80dba801 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:03.537894 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25aa7e92274d43edabbc5dac80dba801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.539878 22388 tablet_service.cc:1511] Processing CreateTablet for tablet 21b653c31d9f43448bd5643a005fff69 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:03.540745 22392 tablet_service.cc:1511] Processing CreateTablet for tablet 7deb375c97bf4d0bb8866436bb2a5087 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:03.541577 22388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b653c31d9f43448bd5643a005fff69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.543979 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7deb375c97bf4d0bb8866436bb2a5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.545029 22387 tablet_service.cc:1511] Processing CreateTablet for tablet 82db56ce35754a34a2f5a937ddcb350e (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:03.546659 22387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82db56ce35754a34a2f5a937ddcb350e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.556722 22386 tablet_service.cc:1511] Processing CreateTablet for tablet 760daefba7734b6ab04de6d715067584 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:03.558471 22386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760daefba7734b6ab04de6d715067584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.565238 22385 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1b637054e14c87b9ff199a611ee5ee (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:03.566473 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1b637054e14c87b9ff199a611ee5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.569574 22384 tablet_service.cc:1511] Processing CreateTablet for tablet 81e81c6a7f864ad19ef285dfd52ae1e4 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:03.570802 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e81c6a7f864ad19ef285dfd52ae1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.597095 22385 tablet_service.cc:1511] Processing CreateTablet for tablet abb7533f7a6d41909e884b909624ce02 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:03.598426 22385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb7533f7a6d41909e884b909624ce02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.625958 22467 tablet_service.cc:1511] Processing CreateTablet for tablet 7deb375c97bf4d0bb8866436bb2a5087 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:03.627307 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7deb375c97bf4d0bb8866436bb2a5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.628818 22466 tablet_service.cc:1511] Processing CreateTablet for tablet 25aa7e92274d43edabbc5dac80dba801 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:03.629171 22462 tablet_service.cc:1511] Processing CreateTablet for tablet 82db56ce35754a34a2f5a937ddcb350e (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:03.630046 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25aa7e92274d43edabbc5dac80dba801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.630865 22462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82db56ce35754a34a2f5a937ddcb350e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.632153 22465 tablet_service.cc:1511] Processing CreateTablet for tablet aeabbb11aba941e6acf5610d696361cd (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:03.633373 22465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeabbb11aba941e6acf5610d696361cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.632943 22463 tablet_service.cc:1511] Processing CreateTablet for tablet 21b653c31d9f43448bd5643a005fff69 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:03.634351 22591 tablet_bootstrap.cc:492] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:03.635381 22464 tablet_service.cc:1511] Processing CreateTablet for tablet f6326957da3e4006b224c1d3d2b998fd (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:03.636842 22538 tablet_service.cc:1511] Processing CreateTablet for tablet f6326957da3e4006b224c1d3d2b998fd (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:03.637472 22537 tablet_service.cc:1511] Processing CreateTablet for tablet 21b653c31d9f43448bd5643a005fff69 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:03.638123 22538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6326957da3e4006b224c1d3d2b998fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.638729 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b653c31d9f43448bd5643a005fff69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.640202 22539 tablet_service.cc:1511] Processing CreateTablet for tablet aeabbb11aba941e6acf5610d696361cd (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:03.641485 22539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeabbb11aba941e6acf5610d696361cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.642233 22591 tablet_bootstrap.cc:654] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.644779 22540 tablet_service.cc:1511] Processing CreateTablet for tablet 25aa7e92274d43edabbc5dac80dba801 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:03.645059 22536 tablet_service.cc:1511] Processing CreateTablet for tablet 82db56ce35754a34a2f5a937ddcb350e (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:03.646050 22540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25aa7e92274d43edabbc5dac80dba801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.646705 22536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82db56ce35754a34a2f5a937ddcb350e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.648132 22541 tablet_service.cc:1511] Processing CreateTablet for tablet 7deb375c97bf4d0bb8866436bb2a5087 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:03.649379 22541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7deb375c97bf4d0bb8866436bb2a5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.635479 22461 tablet_service.cc:1511] Processing CreateTablet for tablet 760daefba7734b6ab04de6d715067584 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:03.634379 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b653c31d9f43448bd5643a005fff69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.656066 22535 tablet_service.cc:1511] Processing CreateTablet for tablet 760daefba7734b6ab04de6d715067584 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:03.656518 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6326957da3e4006b224c1d3d2b998fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.657303 22535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760daefba7734b6ab04de6d715067584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.661168 22461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760daefba7734b6ab04de6d715067584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.661645 22534 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1b637054e14c87b9ff199a611ee5ee (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:03.664824 22533 tablet_service.cc:1511] Processing CreateTablet for tablet 81e81c6a7f864ad19ef285dfd52ae1e4 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:03.674088 22532 tablet_service.cc:1511] Processing CreateTablet for tablet abb7533f7a6d41909e884b909624ce02 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:03.676016 22460 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1b637054e14c87b9ff199a611ee5ee (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:03.677765 22460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1b637054e14c87b9ff199a611ee5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.681123 22534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1b637054e14c87b9ff199a611ee5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.684365 22459 tablet_service.cc:1511] Processing CreateTablet for tablet 81e81c6a7f864ad19ef285dfd52ae1e4 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:03.685694 22459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e81c6a7f864ad19ef285dfd52ae1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.687996 22532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb7533f7a6d41909e884b909624ce02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.691943 22533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e81c6a7f864ad19ef285dfd52ae1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.717274 22458 tablet_service.cc:1511] Processing CreateTablet for tablet abb7533f7a6d41909e884b909624ce02 (DEFAULT_TABLE table=test-workload [id=8a3abd35355642cf9347b3e301fbf67e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:03.718616 22458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb7533f7a6d41909e884b909624ce02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.748535 22593 tablet_bootstrap.cc:492] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:03.749464 22591 tablet_bootstrap.cc:492] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:03.749950 22591 ts_tablet_manager.cc:1403] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.116s	user 0.024s	sys 0.021s
I20260709 13:08:03.754207 22591 raft_consensus.cc:359] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:03.756317 22591 raft_consensus.cc:385] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.756623 22591 raft_consensus.cc:740] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.757422 22591 consensus_queue.cc:260] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:03.773160 22593 tablet_bootstrap.cc:654] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.780643 22594 tablet_bootstrap.cc:492] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:03.794036 22594 tablet_bootstrap.cc:654] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.794159 22427 heartbeater.cc:499] Master 127.21.67.254:40289 was elected leader, sending a full tablet report...
I20260709 13:08:03.795603 22591 ts_tablet_manager.cc:1434] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.045s	user 0.013s	sys 0.018s
I20260709 13:08:03.796571 22591 tablet_bootstrap.cc:492] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:03.800650 22593 tablet_bootstrap.cc:492] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:03.801152 22593 ts_tablet_manager.cc:1403] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 13:08:03.804104 22593 raft_consensus.cc:359] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.804797 22591 tablet_bootstrap.cc:654] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.805037 22593 raft_consensus.cc:385] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.805521 22593 raft_consensus.cc:740] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.806313 22593 consensus_queue.cc:260] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.812067 22594 tablet_bootstrap.cc:492] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:03.812376 22591 tablet_bootstrap.cc:492] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:03.812511 22594 ts_tablet_manager.cc:1403] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.006s
I20260709 13:08:03.812803 22591 ts_tablet_manager.cc:1403] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:08:03.815441 22594 raft_consensus.cc:359] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.815619 22591 raft_consensus.cc:359] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.816200 22594 raft_consensus.cc:385] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.816304 22591 raft_consensus.cc:385] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.816534 22594 raft_consensus.cc:740] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.816612 22591 raft_consensus.cc:740] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.817348 22594 consensus_queue.cc:260] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.817507 22591 consensus_queue.cc:260] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.819903 22591 ts_tablet_manager.cc:1434] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:03.821094 22591 tablet_bootstrap.cc:492] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:03.829473 22591 tablet_bootstrap.cc:654] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.840059 22598 raft_consensus.cc:493] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.840144 22576 heartbeater.cc:499] Master 127.21.67.254:40289 was elected leader, sending a full tablet report...
I20260709 13:08:03.840545 22598 raft_consensus.cc:515] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.843916 22593 ts_tablet_manager.cc:1434] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.042s	user 0.014s	sys 0.022s
I20260709 13:08:03.844900 22593 tablet_bootstrap.cc:492] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:03.850993 22593 tablet_bootstrap.cc:654] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.857020 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
W20260709 13:08:03.858995 22515 leader_election.cc:343] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:03.889667 22598 leader_election.cc:290] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:03.890086 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
W20260709 13:08:03.892099 22514 leader_election.cc:343] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:03.892728 22514 leader_election.cc:304] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3fadb7179064032940ecc2946026a2e; no voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:03.893659 22502 heartbeater.cc:499] Master 127.21.67.254:40289 was elected leader, sending a full tablet report...
I20260709 13:08:03.894102 22594 ts_tablet_manager.cc:1434] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.081s	user 0.025s	sys 0.052s
I20260709 13:08:03.894490 22593 tablet_bootstrap.cc:492] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:03.894776 22594 tablet_bootstrap.cc:492] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:03.895033 22593 ts_tablet_manager.cc:1403] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.050s	user 0.032s	sys 0.015s
I20260709 13:08:03.895869 22598 raft_consensus.cc:2749] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:03.898072 22593 raft_consensus.cc:359] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.898818 22593 raft_consensus.cc:385] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.899163 22593 raft_consensus.cc:740] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.900054 22593 consensus_queue.cc:260] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.900838 22594 tablet_bootstrap.cc:654] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.902434 22593 ts_tablet_manager.cc:1434] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:03.903402 22593 tablet_bootstrap.cc:492] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:03.903509 22591 tablet_bootstrap.cc:492] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:03.904170 22591 ts_tablet_manager.cc:1403] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.083s	user 0.032s	sys 0.034s
I20260709 13:08:03.907971 22591 raft_consensus.cc:359] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.908890 22591 raft_consensus.cc:385] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.909276 22591 raft_consensus.cc:740] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.910531 22593 tablet_bootstrap.cc:654] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.910166 22591 consensus_queue.cc:260] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.913080 22591 ts_tablet_manager.cc:1434] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:03.914312 22591 tablet_bootstrap.cc:492] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:03.921931 22591 tablet_bootstrap.cc:654] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.934767 22591 tablet_bootstrap.cc:492] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:03.935350 22591 ts_tablet_manager.cc:1403] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:08:03.939119 22591 raft_consensus.cc:359] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.940056 22591 raft_consensus.cc:385] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.940445 22591 raft_consensus.cc:740] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.941514 22591 consensus_queue.cc:260] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.951258 22591 ts_tablet_manager.cc:1434] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:03.952932 22591 tablet_bootstrap.cc:492] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:03.953469 22594 tablet_bootstrap.cc:492] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:03.953943 22594 ts_tablet_manager.cc:1403] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.059s	user 0.030s	sys 0.023s
I20260709 13:08:03.957166 22593 tablet_bootstrap.cc:492] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:03.956961 22594 raft_consensus.cc:359] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.957726 22593 ts_tablet_manager.cc:1403] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.055s	user 0.039s	sys 0.009s
I20260709 13:08:03.957791 22594 raft_consensus.cc:385] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.958256 22594 raft_consensus.cc:740] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.959055 22594 consensus_queue.cc:260] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.960600 22591 tablet_bootstrap.cc:654] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.961042 22594 ts_tablet_manager.cc:1434] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:03.960732 22593 raft_consensus.cc:359] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.961441 22593 raft_consensus.cc:385] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.961738 22593 raft_consensus.cc:740] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.961918 22594 tablet_bootstrap.cc:492] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:03.962602 22593 consensus_queue.cc:260] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.967839 22595 raft_consensus.cc:493] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.968432 22594 tablet_bootstrap.cc:654] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.968273 22595 raft_consensus.cc:515] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.973068 22593 ts_tablet_manager.cc:1434] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:03.973598 22591 tablet_bootstrap.cc:492] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:03.974048 22591 ts_tablet_manager.cc:1403] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:08:03.974143 22593 tablet_bootstrap.cc:492] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:03.977545 22595 leader_election.cc:290] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:03.980377 22593 tablet_bootstrap.cc:654] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.976866 22591 raft_consensus.cc:359] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.981832 22591 raft_consensus.cc:385] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.982111 22591 raft_consensus.cc:740] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.982812 22591 consensus_queue.cc:260] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:03.984933 22591 ts_tablet_manager.cc:1434] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:08:03.985857 22591 tablet_bootstrap.cc:492] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:03.995432 22591 tablet_bootstrap.cc:654] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.995361 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
W20260709 13:08:03.997107 22365 leader_election.cc:343] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.000481 22593 tablet_bootstrap.cc:492] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:04.000488 22594 tablet_bootstrap.cc:492] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.001163 22593 ts_tablet_manager.cc:1403] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 13:08:04.001183 22594 ts_tablet_manager.cc:1403] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.000s
I20260709 13:08:04.002647 22591 tablet_bootstrap.cc:492] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:04.003082 22591 ts_tablet_manager.cc:1403] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:08:04.004544 22593 raft_consensus.cc:359] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.004820 22594 raft_consensus.cc:359] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.005677 22593 raft_consensus.cc:385] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.005762 22594 raft_consensus.cc:385] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.006124 22593 raft_consensus.cc:740] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.005872 22591 raft_consensus.cc:359] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.006354 22594 raft_consensus.cc:740] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.006682 22591 raft_consensus.cc:385] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.006942 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.007032 22591 raft_consensus.cc:740] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.007104 22593 consensus_queue.cc:260] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.007323 22594 consensus_queue.cc:260] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.008255 22551 raft_consensus.cc:2468] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.008044 22591 consensus_queue.cc:260] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.009426 22593 ts_tablet_manager.cc:1434] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:04.009999 22368 leader_election.cc:304] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.010356 22593 tablet_bootstrap.cc:492] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:04.011063 22591 ts_tablet_manager.cc:1434] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:04.011575 22595 raft_consensus.cc:2804] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.011976 22595 raft_consensus.cc:493] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.012172 22591 tablet_bootstrap.cc:492] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:04.012311 22595 raft_consensus.cc:3060] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.014707 22594 ts_tablet_manager.cc:1434] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:04.015604 22594 tablet_bootstrap.cc:492] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:04.017014 22593 tablet_bootstrap.cc:654] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.018676 22591 tablet_bootstrap.cc:654] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.021590 22594 tablet_bootstrap.cc:654] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.034027 22593 tablet_bootstrap.cc:492] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:04.034482 22593 ts_tablet_manager.cc:1403] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 13:08:04.037262 22593 raft_consensus.cc:359] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:04.037945 22593 raft_consensus.cc:385] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.038247 22593 raft_consensus.cc:740] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.038938 22593 consensus_queue.cc:260] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:04.039520 22594 tablet_bootstrap.cc:492] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.039978 22594 ts_tablet_manager.cc:1403] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:08:04.041397 22593 ts_tablet_manager.cc:1434] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:04.042308 22593 tablet_bootstrap.cc:492] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:04.042686 22594 raft_consensus.cc:359] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:04.043375 22594 raft_consensus.cc:385] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.043668 22594 raft_consensus.cc:740] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.044378 22594 consensus_queue.cc:260] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:04.048990 22593 tablet_bootstrap.cc:654] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.049229 22594 ts_tablet_manager.cc:1434] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:04.050190 22594 tablet_bootstrap.cc:492] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:04.056329 22600 raft_consensus.cc:493] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.056962 22600 raft_consensus.cc:515] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.057224 22595 raft_consensus.cc:515] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
W20260709 13:08:04.058148 22348 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:04.059521 22595 leader_election.cc:290] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.060256 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.060899 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.061458 22551 raft_consensus.cc:3060] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:04.062341 22365 leader_election.cc:343] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.064603 22593 tablet_bootstrap.cc:492] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:04.065269 22593 ts_tablet_manager.cc:1403] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:08:04.067067 22600 leader_election.cc:290] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.068506 22551 raft_consensus.cc:2468] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 1.
I20260709 13:08:04.069519 22368 leader_election.cc:304] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.070591 22595 raft_consensus.cc:2804] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.071695 22593 raft_consensus.cc:359] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.073462 22593 raft_consensus.cc:385] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.073771 22593 raft_consensus.cc:740] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.074522 22593 consensus_queue.cc:260] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.077000 22591 tablet_bootstrap.cc:492] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:04.077569 22591 ts_tablet_manager.cc:1403] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.026s
I20260709 13:08:04.078460 22593 ts_tablet_manager.cc:1434] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:08:04.079406 22593 tablet_bootstrap.cc:492] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:04.081247 22591 raft_consensus.cc:359] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.082171 22591 raft_consensus.cc:385] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.082530 22591 raft_consensus.cc:740] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.083441 22591 consensus_queue.cc:260] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.086066 22593 tablet_bootstrap.cc:654] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.086782 22595 raft_consensus.cc:697] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:04.087059 22598 raft_consensus.cc:493] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.087545 22598 raft_consensus.cc:515] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:04.087649 22595 consensus_queue.cc:237] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.089843 22598 leader_election.cc:290] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.093010 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.093394 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.093819 22402 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 0.
W20260709 13:08:04.094944 22441 leader_election.cc:343] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.095741 22594 tablet_bootstrap.cc:654] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.096316 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.097077 22477 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 0.
I20260709 13:08:04.098718 22515 leader_election.cc:304] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:04.108536 22598 raft_consensus.cc:2804] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.109165 22598 raft_consensus.cc:493] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.109673 22598 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.121898 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.122767 22551 raft_consensus.cc:2468] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 0.
I20260709 13:08:04.124661 22443 leader_election.cc:304] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:04.126680 22600 raft_consensus.cc:2804] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.127127 22600 raft_consensus.cc:493] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.127539 22600 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.142437 22598 raft_consensus.cc:515] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:04.145562 22619 raft_consensus.cc:493] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.147390 22619 raft_consensus.cc:515] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.148334 22591 ts_tablet_manager.cc:1434] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.070s	user 0.013s	sys 0.023s
I20260709 13:08:04.149320 22591 tablet_bootstrap.cc:492] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:04.149518 22619 leader_election.cc:290] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.145448 22600 raft_consensus.cc:515] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.152112 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeabbb11aba941e6acf5610d696361cd" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
W20260709 13:08:04.153867 22368 leader_election.cc:343] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.154042 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:04.155004 22600 leader_election.cc:290] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.155615 22591 tablet_bootstrap.cc:654] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.151640 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeabbb11aba941e6acf5610d696361cd" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.156752 22477 raft_consensus.cc:2468] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.158166 22365 leader_election.cc:304] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: d3fadb7179064032940ecc2946026a2e
W20260709 13:08:04.159005 22441 leader_election.cc:343] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.159706 22619 raft_consensus.cc:2804] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.160172 22619 raft_consensus.cc:493] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.160728 22619 raft_consensus.cc:3060] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.162381 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:04.163057 22402 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.160066 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.163995 22551 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.166031 22601 raft_consensus.cc:493] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.166596 22601 raft_consensus.cc:515] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.169080 22601 leader_election.cc:290] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.170512 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.171502 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.172643 22401 raft_consensus.cc:2468] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 0.
W20260709 13:08:04.174113 22514 leader_election.cc:343] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.174907 22515 leader_election.cc:304] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.176306 22601 raft_consensus.cc:2804] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.176749 22601 raft_consensus.cc:493] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.177145 22601 raft_consensus.cc:3060] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.181663 22620 raft_consensus.cc:493] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.182276 22620 raft_consensus.cc:515] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.186136 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
W20260709 13:08:04.187920 22365 leader_election.cc:343] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.190712 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.191573 22550 raft_consensus.cc:2468] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.192973 22551 raft_consensus.cc:2468] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 1.
I20260709 13:08:04.193132 22368 leader_election.cc:304] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.194550 22443 leader_election.cc:304] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:04.195973 22600 raft_consensus.cc:2804] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.198904 22619 raft_consensus.cc:515] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.202566 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeabbb11aba941e6acf5610d696361cd" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.227495 22594 tablet_bootstrap.cc:492] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.210067 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.203480 22601 raft_consensus.cc:515] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.228111 22593 tablet_bootstrap.cc:492] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:04.240206 22591 tablet_bootstrap.cc:492] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:04.207602 22620 leader_election.cc:290] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.212751 22619 leader_election.cc:290] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
W20260709 13:08:04.238319 22368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:38197, user_credentials={real_user=slave}} blocked reactor thread for 45312.7us
I20260709 13:08:04.251847 22593 ts_tablet_manager.cc:1403] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.173s	user 0.060s	sys 0.086s
I20260709 13:08:04.220674 22300 catalog_manager.cc:5697] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.254055 22601 leader_election.cc:290] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.207471 22402 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 1.
I20260709 13:08:04.255615 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeabbb11aba941e6acf5610d696361cd" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.255894 22515 leader_election.cc:304] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:04.255985 22593 raft_consensus.cc:359] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.256929 22593 raft_consensus.cc:385] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.257026 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:04.257346 22593 raft_consensus.cc:740] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.257699 22402 raft_consensus.cc:3060] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.257675 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.258320 22593 consensus_queue.cc:260] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
W20260709 13:08:04.259303 22514 leader_election.cc:343] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.252007 22591 ts_tablet_manager.cc:1403] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.030s
W20260709 13:08:04.260159 22368 leader_election.cc:343] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.260780 22601 raft_consensus.cc:2804] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.263134 22591 raft_consensus.cc:359] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.264000 22591 raft_consensus.cc:385] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.251099 22594 ts_tablet_manager.cc:1403] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.201s	user 0.044s	sys 0.034s
I20260709 13:08:04.266178 22402 raft_consensus.cc:2468] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 1.
I20260709 13:08:04.267710 22515 leader_election.cc:304] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.268468 22601 raft_consensus.cc:697] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:04.268178 22594 raft_consensus.cc:359] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.269111 22594 raft_consensus.cc:385] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.269505 22594 raft_consensus.cc:740] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.269568 22601 consensus_queue.cc:237] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:04.270576 22594 consensus_queue.cc:260] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.234464 22626 raft_consensus.cc:493] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.251376 22476 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.213887 22595 raft_consensus.cc:2804] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.271997 22595 raft_consensus.cc:493] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.272539 22595 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.210121 22598 leader_election.cc:290] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.203498 22477 raft_consensus.cc:3060] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.271924 22626 raft_consensus.cc:515] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.264298 22591 raft_consensus.cc:740] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.274580 22591 consensus_queue.cc:260] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.234625 22600 raft_consensus.cc:697] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Becoming Leader. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:04.276837 22598 raft_consensus.cc:2804] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.281379 22620 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.287366 22591 ts_tablet_manager.cc:1434] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:08:04.288738 22591 tablet_bootstrap.cc:492] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:04.281852 22620 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.290807 22626 leader_election.cc:290] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.291970 22600 consensus_queue.cc:237] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.293912 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.297148 22631 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.297093 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.297681 22631 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.298018 22401 raft_consensus.cc:2468] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 0.
I20260709 13:08:04.299480 22441 leader_election.cc:304] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:04.300421 22626 raft_consensus.cc:2804] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.300480 22631 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.300856 22626 raft_consensus.cc:493] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.301383 22626 raft_consensus.cc:3060] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.301673 22601 raft_consensus.cc:493] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.301568 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.302255 22601 raft_consensus.cc:515] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.300707 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.304844 22601 leader_election.cc:290] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.282495 22598 raft_consensus.cc:697] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:04.309530 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.309724 22593 ts_tablet_manager.cc:1434] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.056s	user 0.021s	sys 0.008s
I20260709 13:08:04.310087 22551 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.309846 22598 consensus_queue.cc:237] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.310724 22593 tablet_bootstrap.cc:492] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:04.310905 22591 tablet_bootstrap.cc:654] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:04.308900 22443 leader_election.cc:343] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.309069 22594 ts_tablet_manager.cc:1434] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.004s
I20260709 13:08:04.312639 22594 tablet_bootstrap.cc:492] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:04.291988 22620 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
W20260709 13:08:04.303272 22514 leader_election.cc:343] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.313709 22401 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 0.
I20260709 13:08:04.318909 22476 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 1.
I20260709 13:08:04.319730 22368 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:04.323331 22620 raft_consensus.cc:2804] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.323567 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.323843 22620 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.324347 22620 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:04.331688 22515 leader_election.cc:343] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.341051 22595 raft_consensus.cc:515] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.340917 22515 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.331491 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.342303 22598 raft_consensus.cc:2804] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.326002 22477 raft_consensus.cc:2468] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 1.
I20260709 13:08:04.342660 22598 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.343151 22598 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:04.343250 22365 leader_election.cc:343] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.343854 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.344681 22365 leader_election.cc:304] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: d3fadb7179064032940ecc2946026a2e
I20260709 13:08:04.346268 22619 raft_consensus.cc:2804] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.346896 22619 raft_consensus.cc:697] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:04.349176 22594 tablet_bootstrap.cc:654] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.348943 22619 consensus_queue.cc:237] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.352174 22620 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.355270 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.355896 22598 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
W20260709 13:08:04.356803 22365 leader_election.cc:343] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.357234 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.357594 22551 raft_consensus.cc:2393] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b45909b725546a59abaae76df2ddc1d in current term 1: Already voted for candidate d3fadb7179064032940ecc2946026a2e in this term.
I20260709 13:08:04.357892 22595 leader_election.cc:290] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
W20260709 13:08:04.359689 22365 leader_election.cc:343] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.359905 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.360455 22368 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d; no voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e
W20260709 13:08:04.361133 22514 leader_election.cc:343] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.362229 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
W20260709 13:08:04.363687 22514 leader_election.cc:343] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.364105 22514 leader_election.cc:304] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3fadb7179064032940ecc2946026a2e; no voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.367267 22591 tablet_bootstrap.cc:492] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:04.367795 22591 ts_tablet_manager.cc:1403] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.022s
I20260709 13:08:04.358244 22598 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.358914 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.368634 22550 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.370463 22591 raft_consensus.cc:359] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.371122 22591 raft_consensus.cc:385] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.371429 22591 raft_consensus.cc:740] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.372238 22591 consensus_queue.cc:260] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.374337 22591 ts_tablet_manager.cc:1434] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:04.375171 22591 tablet_bootstrap.cc:492] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d: Bootstrap starting.
I20260709 13:08:04.376201 22550 raft_consensus.cc:2468] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 1.
I20260709 13:08:04.377311 22368 leader_election.cc:304] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.364979 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:04.379737 22629 raft_consensus.cc:2749] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.378216 22625 raft_consensus.cc:2804] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.366453 22595 raft_consensus.cc:2749] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.366267 22626 raft_consensus.cc:515] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.366649 22620 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.386909 22401 raft_consensus.cc:2393] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3fadb7179064032940ecc2946026a2e in current term 1: Already voted for candidate 0b45909b725546a59abaae76df2ddc1d in this term.
I20260709 13:08:04.388023 22594 tablet_bootstrap.cc:492] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.388469 22594 ts_tablet_manager.cc:1403] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.001s
I20260709 13:08:04.388793 22515 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3fadb7179064032940ecc2946026a2e; no voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.389962 22629 raft_consensus.cc:2749] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.391173 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:04.391758 22401 raft_consensus.cc:3060] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.390080 22297 catalog_manager.cc:5697] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2db95b2368fb4d598d4020801930f48a (127.21.67.194). New cstate: current_term: 1 leader_uuid: "2db95b2368fb4d598d4020801930f48a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.392395 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.392244 22594 raft_consensus.cc:359] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.394032 22594 raft_consensus.cc:385] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:04.394483 22443 leader_election.cc:343] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.394755 22594 raft_consensus.cc:740] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.396544 22593 tablet_bootstrap.cc:654] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.383055 22299 catalog_manager.cc:5697] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.392596 22626 leader_election.cc:290] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.396442 22594 consensus_queue.cc:260] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.398476 22591 tablet_bootstrap.cc:654] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.400995 22594 ts_tablet_manager.cc:1434] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:04.403225 22594 tablet_bootstrap.cc:492] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:04.404960 22401 raft_consensus.cc:2468] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 1.
I20260709 13:08:04.406461 22441 leader_election.cc:304] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: d3fadb7179064032940ecc2946026a2e
I20260709 13:08:04.407452 22626 raft_consensus.cc:2804] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.408325 22626 raft_consensus.cc:697] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Becoming Leader. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:04.409364 22626 consensus_queue.cc:237] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.411474 22593 tablet_bootstrap.cc:492] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:04.412189 22593 ts_tablet_manager.cc:1403] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.009s
I20260709 13:08:04.414695 22593 raft_consensus.cc:359] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.415534 22593 raft_consensus.cc:385] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.415890 22593 raft_consensus.cc:740] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.416699 22593 consensus_queue.cc:260] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.417344 22594 tablet_bootstrap.cc:654] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.419710 22593 ts_tablet_manager.cc:1434] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:04.420615 22593 tablet_bootstrap.cc:492] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:04.420759 22625 raft_consensus.cc:697] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:04.421552 22625 consensus_queue.cc:237] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.426890 22593 tablet_bootstrap.cc:654] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.431574 22591 tablet_bootstrap.cc:492] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d: No bootstrap required, opened a new log
I20260709 13:08:04.432143 22591 ts_tablet_manager.cc:1403] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.008s
I20260709 13:08:04.435458 22591 raft_consensus.cc:359] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.455376 22591 raft_consensus.cc:385] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.455746 22591 raft_consensus.cc:740] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.456719 22591 consensus_queue.cc:260] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.460069 22591 ts_tablet_manager.cc:1434] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:08:04.461529 22299 catalog_manager.cc:5697] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2db95b2368fb4d598d4020801930f48a (127.21.67.194). New cstate: current_term: 1 leader_uuid: "2db95b2368fb4d598d4020801930f48a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.464248 22594 tablet_bootstrap.cc:492] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.464339 22593 tablet_bootstrap.cc:492] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:04.464743 22594 ts_tablet_manager.cc:1403] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.062s	user 0.030s	sys 0.022s
I20260709 13:08:04.464818 22593 ts_tablet_manager.cc:1403] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.016s
I20260709 13:08:04.467440 22593 raft_consensus.cc:359] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.467638 22594 raft_consensus.cc:359] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.468134 22593 raft_consensus.cc:385] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.468344 22594 raft_consensus.cc:385] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.468472 22593 raft_consensus.cc:740] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.468710 22594 raft_consensus.cc:740] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.469187 22593 consensus_queue.cc:260] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.469470 22594 consensus_queue.cc:260] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.470971 22593 ts_tablet_manager.cc:1434] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:08:04.471709 22594 ts_tablet_manager.cc:1434] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:04.471812 22593 tablet_bootstrap.cc:492] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e: Bootstrap starting.
I20260709 13:08:04.471518 22297 catalog_manager.cc:5697] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.472694 22594 tablet_bootstrap.cc:492] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:04.478334 22593 tablet_bootstrap.cc:654] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.480120 22594 tablet_bootstrap.cc:654] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.492961 22594 tablet_bootstrap.cc:492] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.493281 22593 tablet_bootstrap.cc:492] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e: No bootstrap required, opened a new log
I20260709 13:08:04.493403 22594 ts_tablet_manager.cc:1403] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:08:04.493709 22593 ts_tablet_manager.cc:1403] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:08:04.493536 22300 catalog_manager.cc:5697] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.495404 22300 catalog_manager.cc:5697] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.496125 22594 raft_consensus.cc:359] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.496860 22594 raft_consensus.cc:385] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.496704 22593 raft_consensus.cc:359] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.497208 22594 raft_consensus.cc:740] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.497390 22593 raft_consensus.cc:385] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.497689 22593 raft_consensus.cc:740] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.497859 22594 consensus_queue.cc:260] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.498934 22593 consensus_queue.cc:260] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.499912 22594 ts_tablet_manager.cc:1434] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:04.500802 22594 tablet_bootstrap.cc:492] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:04.501377 22593 ts_tablet_manager.cc:1434] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:04.506055 22594 tablet_bootstrap.cc:654] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.511351 22594 tablet_bootstrap.cc:492] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.511847 22594 ts_tablet_manager.cc:1403] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:08:04.514189 22639 consensus_queue.cc:1048] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:04.515424 22639 raft_consensus.cc:493] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.515836 22639 raft_consensus.cc:515] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.516188 22594 raft_consensus.cc:359] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.516872 22594 raft_consensus.cc:385] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.517129 22594 raft_consensus.cc:740] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.517778 22594 consensus_queue.cc:260] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.520402 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.521231 22476 raft_consensus.cc:2468] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.523023 22594 ts_tablet_manager.cc:1434] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:08:04.523362 22365 leader_election.cc:304] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:04.523916 22594 tablet_bootstrap.cc:492] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a: Bootstrap starting.
I20260709 13:08:04.524170 22625 raft_consensus.cc:2804] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.524519 22625 raft_consensus.cc:493] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.524845 22625 raft_consensus.cc:3060] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.528491 22639 leader_election.cc:290] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.529738 22594 tablet_bootstrap.cc:654] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.530004 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.530627 22551 raft_consensus.cc:2468] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.538919 22625 raft_consensus.cc:515] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.545600 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.545888 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.546345 22476 raft_consensus.cc:3060] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.546629 22551 raft_consensus.cc:3060] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.556591 22476 raft_consensus.cc:2468] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 1.
I20260709 13:08:04.557718 22475 raft_consensus.cc:3060] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.557938 22365 leader_election.cc:304] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:04.558743 22639 raft_consensus.cc:2804] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.559357 22639 raft_consensus.cc:697] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:04.561159 22639 consensus_queue.cc:237] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.564858 22551 raft_consensus.cc:2468] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 1.
I20260709 13:08:04.564908 22595 consensus_queue.cc:1048] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.566057 22625 leader_election.cc:290] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.570900 22594 tablet_bootstrap.cc:492] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a: No bootstrap required, opened a new log
I20260709 13:08:04.571358 22594 ts_tablet_manager.cc:1403] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a: Time spent bootstrapping tablet: real 0.048s	user 0.030s	sys 0.016s
I20260709 13:08:04.573973 22594 raft_consensus.cc:359] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.574599 22594 raft_consensus.cc:385] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.574848 22594 raft_consensus.cc:740] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.575477 22594 consensus_queue.cc:260] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.575064 22300 catalog_manager.cc:5697] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.577378 22594 ts_tablet_manager.cc:1434] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:04.617024 22595 raft_consensus.cc:493] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.617446 22595 raft_consensus.cc:515] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.618952 22595 leader_election.cc:290] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.619721 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.619956 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.620397 22475 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.620509 22550 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 0.
I20260709 13:08:04.621451 22365 leader_election.cc:304] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:04.622051 22595 raft_consensus.cc:2804] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.622365 22595 raft_consensus.cc:493] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.622648 22595 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.626806 22595 raft_consensus.cc:515] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.628528 22595 leader_election.cc:290] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.629340 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:04.629491 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:04.629783 22475 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.630072 22550 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.634016 22475 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 1.
I20260709 13:08:04.634354 22550 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 1.
I20260709 13:08:04.634924 22365 leader_election.cc:304] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:04.635718 22595 raft_consensus.cc:2804] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.636175 22595 raft_consensus.cc:697] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:04.636909 22595 consensus_queue.cc:237] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.643100 22297 catalog_manager.cc:5697] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.644229 22626 raft_consensus.cc:493] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.644706 22626 raft_consensus.cc:515] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.646504 22626 leader_election.cc:290] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.647112 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.647478 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.648272 22550 raft_consensus.cc:2393] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2db95b2368fb4d598d4020801930f48a in current term 1: Already voted for candidate 0b45909b725546a59abaae76df2ddc1d in this term.
I20260709 13:08:04.649224 22595 raft_consensus.cc:493] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.649155 22443 leader_election.cc:304] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a; no voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e
I20260709 13:08:04.649721 22595 raft_consensus.cc:515] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.649986 22626 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.652774 22595 leader_election.cc:290] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.653452 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.653640 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.654234 22550 raft_consensus.cc:2393] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b45909b725546a59abaae76df2ddc1d in current term 1: Already voted for candidate 2db95b2368fb4d598d4020801930f48a in this term.
I20260709 13:08:04.655592 22368 leader_election.cc:304] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d; no voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e
I20260709 13:08:04.656282 22595 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.657356 22626 raft_consensus.cc:2749] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.660755 22595 raft_consensus.cc:2749] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.672847 22626 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.673255 22626 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.674854 22626 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:04.675562 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.675830 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3fadb7179064032940ecc2946026a2e" is_pre_election: true
I20260709 13:08:04.676285 22401 raft_consensus.cc:2393] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2db95b2368fb4d598d4020801930f48a in current term 1: Already voted for candidate 0b45909b725546a59abaae76df2ddc1d in this term.
I20260709 13:08:04.676456 22550 raft_consensus.cc:2393] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2db95b2368fb4d598d4020801930f48a in current term 1: Already voted for candidate d3fadb7179064032940ecc2946026a2e in this term.
I20260709 13:08:04.677484 22443 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a; no voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e
I20260709 13:08:04.678088 22626 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.682564 22626 raft_consensus.cc:2749] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.706755 22629 raft_consensus.cc:493] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.707149 22629 raft_consensus.cc:515] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.708626 22629 leader_election.cc:290] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.709509 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeabbb11aba941e6acf5610d696361cd" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.709705 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeabbb11aba941e6acf5610d696361cd" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.710441 22475 raft_consensus.cc:2393] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3fadb7179064032940ecc2946026a2e in current term 1: Already voted for candidate 0b45909b725546a59abaae76df2ddc1d in this term.
I20260709 13:08:04.711335 22514 leader_election.cc:304] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3fadb7179064032940ecc2946026a2e; no voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.711906 22629 raft_consensus.cc:3060] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.716548 22629 raft_consensus.cc:2749] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.733989 22626 consensus_queue.cc:1048] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.743633 22626 consensus_queue.cc:1048] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:04.756199 22629 consensus_queue.cc:1048] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.765901 22475 raft_consensus.cc:3060] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.771845 22598 consensus_queue.cc:1048] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.772336 22595 consensus_queue.cc:1048] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.783215 22595 consensus_queue.cc:1048] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.801508 22598 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.811107 22601 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.858959 22601 raft_consensus.cc:493] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.859367 22601 raft_consensus.cc:515] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:04.861044 22601 leader_election.cc:290] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:04.861733 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:04.862021 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:04.862524 22401 raft_consensus.cc:2393] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3fadb7179064032940ecc2946026a2e in current term 1: Already voted for candidate 2db95b2368fb4d598d4020801930f48a in this term.
I20260709 13:08:04.863564 22515 leader_election.cc:304] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3fadb7179064032940ecc2946026a2e; no voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:04.864209 22601 raft_consensus.cc:3060] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.868793 22601 raft_consensus.cc:2749] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.971029 22595 consensus_queue.cc:1048] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.978698 22639 consensus_queue.cc:1048] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.022831 22626 consensus_queue.cc:1048] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.028646 22625 consensus_queue.cc:1048] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.033354 22627 consensus_queue.cc:1048] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.046562 22595 consensus_queue.cc:1048] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:05.063756 22348 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:05.071810 22625 consensus_queue.cc:1048] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.081141 22595 consensus_queue.cc:1048] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:06.068907 22348 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:06.333352 22676 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.333731 22676 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:06.335213 22676 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:06.335922 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d" is_pre_election: true
I20260709 13:08:06.336192 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a" is_pre_election: true
I20260709 13:08:06.336557 22401 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 1.
I20260709 13:08:06.336733 22475 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 1.
I20260709 13:08:06.337668 22515 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:06.338323 22676 raft_consensus.cc:2804] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.338686 22676 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.338951 22676 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.343302 22676 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:06.344857 22676 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:06.345443 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:06.345754 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:06.346011 22401 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.346287 22475 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.352629 22401 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 2.
I20260709 13:08:06.352629 22475 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 2.
I20260709 13:08:06.353790 22514 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:06.354387 22676 raft_consensus.cc:2804] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:06.355264 22676 raft_consensus.cc:697] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:06.356104 22676 consensus_queue.cc:237] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:06.363085 22299 catalog_manager.cc:5697] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 0 to 2, leader changed from <none> to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.800791 22475 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:06.801853 22677 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:06.813509 22401 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:06.814949 22676 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:06.900566 22550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
mode: GRACEFUL
new_leader_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:42834
I20260709 13:08:06.901250 22550 raft_consensus.cc:606] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Received request to transfer leadership to TS 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:06.919529 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
mode: GRACEFUL
new_leader_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:51892
I20260709 13:08:06.920061 22475 raft_consensus.cc:606] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Received request to transfer leadership to TS 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:06.928784 22550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "760daefba7734b6ab04de6d715067584"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
mode: GRACEFUL
new_leader_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:42834
I20260709 13:08:06.929247 22550 raft_consensus.cc:606] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Received request to transfer leadership to TS 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:06.940828 22401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:08:06.941310 22401 raft_consensus.cc:606] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Received request to transfer leadership to TS 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:06.945556 22550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
mode: GRACEFUL
new_leader_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:42834
I20260709 13:08:06.946015 22550 raft_consensus.cc:606] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Received request to transfer leadership to TS 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:06.950484 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:08:06.950958 22402 raft_consensus.cc:606] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Received request to transfer leadership to TS d3fadb7179064032940ecc2946026a2e
I20260709 13:08:06.951052 22676 raft_consensus.cc:993] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: : Instructing follower 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:06.951615 22677 raft_consensus.cc:1081] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Signalling peer 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:06.952979 22402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:55168
I20260709 13:08:06.953410 22402 raft_consensus.cc:493] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.953706 22402 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.958333 22402 raft_consensus.cc:515] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:06.960011 22402 leader_election.cc:290] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 2 election: Requested vote from peers d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:06.960609 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:06.960930 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:06.961179 22550 raft_consensus.cc:3055] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:06.961465 22475 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.961498 22550 raft_consensus.cc:740] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:06.962356 22550 consensus_queue.cc:260] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:06.963532 22550 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.968032 22475 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 2.
I20260709 13:08:06.969054 22365 leader_election.cc:304] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:06.969691 22683 raft_consensus.cc:2804] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:06.969749 22550 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 2.
I20260709 13:08:06.970139 22683 raft_consensus.cc:697] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:06.970973 22683 consensus_queue.cc:237] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:06.977247 22299 catalog_manager.cc:5697] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 1 to 2, leader changed from d3fadb7179064032940ecc2946026a2e (127.21.67.195) to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.101945 22639 raft_consensus.cc:993] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:07.102362 22683 raft_consensus.cc:1081] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Signalling peer 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:07.103649 22475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:51882
I20260709 13:08:07.104147 22475 raft_consensus.cc:493] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.104458 22475 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.108711 22475 raft_consensus.cc:515] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.110230 22475 leader_election.cc:290] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 2 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:07.111027 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:07.111369 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:07.111608 22402 raft_consensus.cc:3055] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.111939 22550 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.111974 22402 raft_consensus.cc:740] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:07.112875 22402 consensus_queue.cc:260] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.114058 22402 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.118544 22550 raft_consensus.cc:2468] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 2.
I20260709 13:08:07.119726 22443 leader_election.cc:304] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:07.120466 22626 raft_consensus.cc:2804] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.120805 22402 raft_consensus.cc:2468] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 2.
I20260709 13:08:07.121775 22626 raft_consensus.cc:697] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Becoming Leader. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:07.122709 22626 consensus_queue.cc:237] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.126272 22639 raft_consensus.cc:993] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:07.126703 22683 raft_consensus.cc:1081] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Signalling peer d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:07.128367 22550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:08:07.128885 22550 raft_consensus.cc:493] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.129238 22550 raft_consensus.cc:3060] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.131178 22299 catalog_manager.cc:5697] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a reported cstate change: term changed from 1 to 2, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to 2db95b2368fb4d598d4020801930f48a (127.21.67.194). New cstate: current_term: 2 leader_uuid: "2db95b2368fb4d598d4020801930f48a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.135152 22550 raft_consensus.cc:515] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.136801 22550 leader_election.cc:290] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:07.137344 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:07.137847 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb7533f7a6d41909e884b909624ce02" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:07.138178 22402 raft_consensus.cc:3055] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.138355 22475 raft_consensus.cc:3060] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.138520 22402 raft_consensus.cc:740] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:07.139344 22402 consensus_queue.cc:260] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.140548 22402 raft_consensus.cc:3060] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.144779 22475 raft_consensus.cc:2468] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 2.
I20260709 13:08:07.145874 22514 leader_election.cc:304] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:07.146610 22677 raft_consensus.cc:2804] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.146998 22402 raft_consensus.cc:2468] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 2.
I20260709 13:08:07.147078 22677 raft_consensus.cc:697] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:07.148068 22677 consensus_queue.cc:237] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.153254 22699 raft_consensus.cc:993] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a: : Instructing follower 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:07.153653 22626 raft_consensus.cc:1081] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Signalling peer 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:07.155136 22402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 13:08:07.155712 22402 raft_consensus.cc:493] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.156064 22402 raft_consensus.cc:3060] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.155479 22299 catalog_manager.cc:5697] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 1 to 2, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.160987 22402 raft_consensus.cc:515] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.162865 22402 leader_election.cc:290] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 2 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:07.163582 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:07.164212 22475 raft_consensus.cc:3055] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.164198 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6326957da3e4006b224c1d3d2b998fd" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:07.164721 22475 raft_consensus.cc:740] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:07.164881 22550 raft_consensus.cc:3060] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.165522 22475 consensus_queue.cc:260] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.166692 22475 raft_consensus.cc:3060] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.171382 22550 raft_consensus.cc:2468] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 2.
I20260709 13:08:07.172451 22368 leader_election.cc:304] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:07.172932 22475 raft_consensus.cc:2468] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 2.
I20260709 13:08:07.173079 22683 raft_consensus.cc:2804] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.173527 22683 raft_consensus.cc:697] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:07.174226 22683 consensus_queue.cc:237] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.181406 22299 catalog_manager.cc:5697] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 1 to 2, leader changed from 2db95b2368fb4d598d4020801930f48a (127.21.67.194) to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.219887 22676 raft_consensus.cc:993] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e: : Instructing follower 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:07.220289 22677 raft_consensus.cc:1081] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Signalling peer 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:07.221565 22475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "760daefba7734b6ab04de6d715067584"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:51876
I20260709 13:08:07.221947 22475 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.222193 22475 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.226548 22475 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.227923 22475 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 3 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:07.228755 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:07.228924 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:07.229236 22402 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.229420 22550 raft_consensus.cc:3055] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.229751 22550 raft_consensus.cc:740] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:07.230441 22550 consensus_queue.cc:260] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.231299 22550 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.233606 22402 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 3.
I20260709 13:08:07.234606 22441 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:07.235253 22626 raft_consensus.cc:2804] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:07.235750 22626 raft_consensus.cc:697] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 LEADER]: Becoming Leader. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:07.236611 22550 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 3.
I20260709 13:08:07.236536 22626 consensus_queue.cc:237] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.242380 22299 catalog_manager.cc:5697] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a reported cstate change: term changed from 2 to 3, leader changed from d3fadb7179064032940ecc2946026a2e (127.21.67.195) to 2db95b2368fb4d598d4020801930f48a (127.21.67.194). New cstate: current_term: 3 leader_uuid: "2db95b2368fb4d598d4020801930f48a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.275893 22676 raft_consensus.cc:993] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e: : Instructing follower 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:07.276298 22677 raft_consensus.cc:1081] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Signalling peer 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:07.277480 22475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:51876
I20260709 13:08:07.277881 22475 raft_consensus.cc:493] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.278134 22475 raft_consensus.cc:3060] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.282151 22475 raft_consensus.cc:515] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.283527 22475 leader_election.cc:290] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 2 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:07.284253 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:07.284536 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e81c6a7f864ad19ef285dfd52ae1e4" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:07.284744 22402 raft_consensus.cc:3060] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.285038 22550 raft_consensus.cc:3055] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.285316 22550 raft_consensus.cc:740] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:07.285909 22550 consensus_queue.cc:260] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.286725 22550 raft_consensus.cc:3060] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.289314 22402 raft_consensus.cc:2468] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 2.
I20260709 13:08:07.290239 22441 leader_election.cc:304] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:07.290994 22626 raft_consensus.cc:2804] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.291361 22626 raft_consensus.cc:697] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Becoming Leader. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:07.291420 22550 raft_consensus.cc:2468] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 2.
I20260709 13:08:07.292153 22626 consensus_queue.cc:237] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:07.298501 22299 catalog_manager.cc:5697] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a reported cstate change: term changed from 1 to 2, leader changed from d3fadb7179064032940ecc2946026a2e (127.21.67.195) to 2db95b2368fb4d598d4020801930f48a (127.21.67.194). New cstate: current_term: 2 leader_uuid: "2db95b2368fb4d598d4020801930f48a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.454197 22550 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.455487 22683 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.466892 22475 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.468408 22639 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.568852 22550 raft_consensus.cc:1275] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.569938 22707 consensus_queue.cc:1048] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.577654 22475 raft_consensus.cc:1275] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.579090 22683 consensus_queue.cc:1048] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:07.594524 22402 raft_consensus.cc:1275] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.595563 22626 consensus_queue.cc:1048] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.597668 22550 raft_consensus.cc:1275] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.599028 22699 consensus_queue.cc:1048] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.639323 22402 raft_consensus.cc:1275] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.640466 22677 consensus_queue.cc:1048] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.648063 22475 raft_consensus.cc:1275] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.650022 22716 consensus_queue.cc:1048] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.699568 22550 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:07.700785 22699 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.707441 22402 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:07.709399 22626 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.865080 22402 raft_consensus.cc:1275] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.866308 22626 consensus_queue.cc:1048] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.874329 22550 raft_consensus.cc:1275] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.876030 22719 consensus_queue.cc:1048] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:10.273437 21775 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:08:10.274299 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:10.292786 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:10.293308 22402 raft_consensus.cc:606] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Received request to transfer leadership to TS d3fadb7179064032940ecc2946026a2e
I20260709 13:08:10.295953 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:10.296327 22402 raft_consensus.cc:606] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Received request to transfer leadership to TS d3fadb7179064032940ecc2946026a2e
I20260709 13:08:10.297138 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:10.297542 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:10.482782 22711 raft_consensus.cc:993] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:10.484035 22639 raft_consensus.cc:1081] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Signalling peer d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:10.486352 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:08:10.486924 22551 raft_consensus.cc:493] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.487267 22551 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.494508 22551 raft_consensus.cc:515] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:10.496989 22551 leader_election.cc:290] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 3 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:10.498463 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:10.498948 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:10.499276 22402 raft_consensus.cc:3055] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:10.499536 22475 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.499634 22402 raft_consensus.cc:740] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:10.500689 22402 consensus_queue.cc:260] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:10.502302 22402 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.507056 22475 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 3.
I20260709 13:08:10.508446 22514 leader_election.cc:304] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:10.509416 22722 raft_consensus.cc:2804] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:10.509711 22402 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 3.
I20260709 13:08:10.510584 22722 raft_consensus.cc:697] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:10.511854 22722 consensus_queue.cc:237] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:10.527040 22297 catalog_manager.cc:5697] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 2 to 3, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 3 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.577209 22711 raft_consensus.cc:993] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:10.577656 22639 raft_consensus.cc:1081] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Signalling peer d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:10.579144 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:08:10.579538 22551 raft_consensus.cc:493] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.579788 22551 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.586539 22551 raft_consensus.cc:515] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:10.588737 22551 leader_election.cc:290] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:10.589397 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:10.589913 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:10.589998 22402 raft_consensus.cc:3055] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:10.590356 22402 raft_consensus.cc:740] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:10.590406 22475 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.591192 22402 consensus_queue.cc:260] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:10.592190 22402 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.594584 22475 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 2.
I20260709 13:08:10.595425 22514 leader_election.cc:304] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:10.596248 22722 raft_consensus.cc:2804] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:10.596621 22722 raft_consensus.cc:697] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:10.597194 22402 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 2.
I20260709 13:08:10.597379 22722 consensus_queue.cc:237] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:10.603531 22297 catalog_manager.cc:5697] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 1 to 2, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.985447 22402 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:10.986459 22722 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.998276 22475 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:10.999917 22740 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:11.015550 22423 debug-util.cc:398] Leaking SignalData structure 0x7b0800156660 after lost signal to thread 21778
W20260709 13:08:11.016481 22423 debug-util.cc:398] Leaking SignalData structure 0x7b0800156d40 after lost signal to thread 22334
W20260709 13:08:11.017917 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5f20 after lost signal to thread 22501
W20260709 13:08:11.018790 22423 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4280 after lost signal to thread 22575
I20260709 13:08:11.032629 22475 raft_consensus.cc:1275] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.033946 22740 consensus_queue.cc:1048] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.043362 22402 raft_consensus.cc:1275] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.049286 22740 consensus_queue.cc:1048] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:11.151789 22331 debug-util.cc:398] Leaking SignalData structure 0x7b080004d580 after lost signal to thread 21778
W20260709 13:08:11.152813 22331 debug-util.cc:398] Leaking SignalData structure 0x7b080004dc60 after lost signal to thread 22334
W20260709 13:08:11.153872 22331 debug-util.cc:398] Leaking SignalData structure 0x7b0800133a40 after lost signal to thread 22426
W20260709 13:08:11.154861 22331 debug-util.cc:398] Leaking SignalData structure 0x7b0800083b00 after lost signal to thread 22501
W20260709 13:08:11.155972 22331 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf320 after lost signal to thread 22575
I20260709 13:08:11.298599 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:11.314926 22551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
mode: GRACEFUL
new_leader_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:42834
I20260709 13:08:11.315737 22551 raft_consensus.cc:606] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 LEADER]: Received request to transfer leadership to TS 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:11.322340 22551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
mode: GRACEFUL
new_leader_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:42834
I20260709 13:08:11.322953 22551 raft_consensus.cc:606] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Received request to transfer leadership to TS 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:11.340358 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
mode: GRACEFUL
new_leader_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:51892
I20260709 13:08:11.340946 22475 raft_consensus.cc:606] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Received request to transfer leadership to TS 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:11.349994 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "760daefba7734b6ab04de6d715067584"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
mode: GRACEFUL
new_leader_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:51892
I20260709 13:08:11.350543 22475 raft_consensus.cc:606] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 LEADER]: Received request to transfer leadership to TS 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:11.356858 22475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
mode: GRACEFUL
new_leader_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:51892
I20260709 13:08:11.357427 22475 raft_consensus.cc:606] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Received request to transfer leadership to TS 0b45909b725546a59abaae76df2ddc1d
I20260709 13:08:11.562666 22746 raft_consensus.cc:993] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: : Instructing follower 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.563148 22740 raft_consensus.cc:1081] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 LEADER]: Signalling peer 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.564790 22402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:55168
I20260709 13:08:11.565435 22402 raft_consensus.cc:493] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.565814 22402 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.574985 22402 raft_consensus.cc:515] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:11.577337 22402 leader_election.cc:290] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 4 election: Requested vote from peers d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:11.578538 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:11.579138 22551 raft_consensus.cc:3055] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:11.579429 22551 raft_consensus.cc:740] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:11.580077 22551 consensus_queue.cc:260] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:11.580850 22551 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.583705 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:11.584208 22475 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.586485 22551 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 4.
I20260709 13:08:11.587793 22368 leader_election.cc:304] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:11.588701 22639 raft_consensus.cc:2804] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:11.590561 22475 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 4.
I20260709 13:08:11.598762 22740 raft_consensus.cc:993] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e: : Instructing follower 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.601941 22746 raft_consensus.cc:1081] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Signalling peer 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.604182 22402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:55168
I20260709 13:08:11.604693 22402 raft_consensus.cc:493] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.605181 22402 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.608966 22639 raft_consensus.cc:697] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:11.609803 22639 consensus_queue.cc:237] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:11.614037 22402 raft_consensus.cc:515] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.616425 22402 leader_election.cc:290] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 3 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:11.618213 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:11.618732 22475 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.620182 22297 catalog_manager.cc:5697] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 3 to 4, leader changed from d3fadb7179064032940ecc2946026a2e (127.21.67.195) to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.624073 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25aa7e92274d43edabbc5dac80dba801" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:11.624446 22475 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 3.
I20260709 13:08:11.624639 22551 raft_consensus.cc:3055] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:11.625147 22551 raft_consensus.cc:740] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:11.626317 22551 consensus_queue.cc:260] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.627606 22551 raft_consensus.cc:3060] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.636101 22551 raft_consensus.cc:2468] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 3.
I20260709 13:08:11.637712 22365 leader_election.cc:304] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:11.638710 22748 raft_consensus.cc:2804] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:11.639256 22748 raft_consensus.cc:697] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 3 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:11.644050 22748 consensus_queue.cc:237] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.650106 22751 raft_consensus.cc:993] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a: : Instructing follower 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.650700 22731 raft_consensus.cc:1081] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Signalling peer 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.652602 22402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 13:08:11.653234 22402 raft_consensus.cc:493] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.653652 22402 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.665854 22402 raft_consensus.cc:515] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.668603 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:11.669129 22475 raft_consensus.cc:3055] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:11.669430 22475 raft_consensus.cc:740] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:11.670265 22475 consensus_queue.cc:260] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.671289 22475 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.678058 22475 raft_consensus.cc:2468] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 3.
I20260709 13:08:11.679111 22365 leader_election.cc:304] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:11.680414 22639 raft_consensus.cc:2804] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:11.680888 22639 raft_consensus.cc:697] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 3 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:11.681774 22639 consensus_queue.cc:237] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.682672 22402 leader_election.cc:290] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 3 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:11.686254 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b637054e14c87b9ff199a611ee5ee" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:11.686780 22551 raft_consensus.cc:3060] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.687443 22297 catalog_manager.cc:5697] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 2 to 3, leader changed from d3fadb7179064032940ecc2946026a2e (127.21.67.195) to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.700562 22551 raft_consensus.cc:2468] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 3.
I20260709 13:08:11.704558 22297 catalog_manager.cc:5697] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 2 to 3, leader changed from 2db95b2368fb4d598d4020801930f48a (127.21.67.194) to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.780843 22751 raft_consensus.cc:993] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a: : Instructing follower 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.781347 22731 raft_consensus.cc:1081] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 LEADER]: Signalling peer 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.782979 22402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "760daefba7734b6ab04de6d715067584"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 13:08:11.783493 22402 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.783849 22402 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.792076 22402 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.793949 22402 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 4 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:11.795058 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:11.795594 22551 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.796057 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:11.796584 22475 raft_consensus.cc:3055] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:11.796883 22475 raft_consensus.cc:740] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:11.797703 22475 consensus_queue.cc:260] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.798935 22475 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.802232 22551 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 4.
I20260709 13:08:11.803228 22368 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:11.804085 22639 raft_consensus.cc:2804] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:11.806552 22639 raft_consensus.cc:697] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:11.807394 22475 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 4.
I20260709 13:08:11.807469 22639 consensus_queue.cc:237] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.816586 22297 catalog_manager.cc:5697] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 3 to 4, leader changed from 2db95b2368fb4d598d4020801930f48a (127.21.67.194) to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.878747 22751 raft_consensus.cc:993] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a: : Instructing follower 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.879273 22731 raft_consensus.cc:1081] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Signalling peer 0b45909b725546a59abaae76df2ddc1d to start an election
I20260709 13:08:11.880960 22402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 13:08:11.881564 22402 raft_consensus.cc:493] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.881976 22402 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.889117 22402 raft_consensus.cc:515] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.891304 22402 leader_election.cc:290] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 2 election: Requested vote from peers 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:11.892261 22475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:11.892858 22475 raft_consensus.cc:3055] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:11.893168 22475 raft_consensus.cc:740] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:11.893973 22475 consensus_queue.cc:260] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.895012 22475 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.900032 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "0b45909b725546a59abaae76df2ddc1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:11.900640 22551 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.902359 22475 raft_consensus.cc:2468] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 2.
I20260709 13:08:11.903473 22365 leader_election.cc:304] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b45909b725546a59abaae76df2ddc1d, 2db95b2368fb4d598d4020801930f48a; no voters: 
I20260709 13:08:11.904418 22639 raft_consensus.cc:2804] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:11.905567 22639 raft_consensus.cc:697] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Becoming Leader. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:11.907627 22551 raft_consensus.cc:2468] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b45909b725546a59abaae76df2ddc1d in term 2.
I20260709 13:08:11.909718 22639 consensus_queue.cc:237] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:11.918258 22297 catalog_manager.cc:5697] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d reported cstate change: term changed from 1 to 2, leader changed from 2db95b2368fb4d598d4020801930f48a (127.21.67.194) to 0b45909b725546a59abaae76df2ddc1d (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0b45909b725546a59abaae76df2ddc1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.043149 22551 raft_consensus.cc:1275] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:12.044490 22639 consensus_queue.cc:1048] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:12.064369 22477 raft_consensus.cc:1275] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:12.067791 22748 consensus_queue.cc:1048] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:12.162034 22551 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 4 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:12.163394 22639 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:12.175446 22477 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 4 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:12.182721 22752 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:12.196305 22551 raft_consensus.cc:1275] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:12.197784 22752 consensus_queue.cc:1048] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:12.206314 22477 raft_consensus.cc:1275] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:12.207976 22748 consensus_queue.cc:1048] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:12.336884 22551 raft_consensus.cc:1275] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:12.338636 22752 consensus_queue.cc:1048] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.349406 22475 raft_consensus.cc:1275] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:12.355513 22639 consensus_queue.cc:1048] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.359618 22475 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 4 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:12.363108 22639 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:12.385886 22551 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 4 FOLLOWER]: Refusing update from remote peer 0b45909b725546a59abaae76df2ddc1d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:12.387427 22748 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.366539 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:14.373450 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:14.373894 22402 raft_consensus.cc:606] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Received request to transfer leadership to TS 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:14.375994 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "760daefba7734b6ab04de6d715067584"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:14.376392 22402 raft_consensus.cc:606] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Received request to transfer leadership to TS 2db95b2368fb4d598d4020801930f48a
I20260709 13:08:14.378151 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:14.378523 22402 raft_consensus.cc:606] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Received request to transfer leadership to TS d3fadb7179064032940ecc2946026a2e
I20260709 13:08:14.380306 22402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e"
dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
mode: GRACEFUL
new_leader_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:14.380687 22402 raft_consensus.cc:606] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Received request to transfer leadership to TS d3fadb7179064032940ecc2946026a2e
I20260709 13:08:14.381492 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:14.381865 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:14.396682 22773 raft_consensus.cc:993] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:14.397135 22639 raft_consensus.cc:1081] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Signalling peer 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:14.398178 22639 raft_consensus.cc:993] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:14.398603 22773 raft_consensus.cc:1081] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Signalling peer 2db95b2368fb4d598d4020801930f48a to start an election
I20260709 13:08:14.398527 22477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "760daefba7734b6ab04de6d715067584"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:51882
I20260709 13:08:14.399195 22477 raft_consensus.cc:493] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.399554 22477 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.400116 22475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69"
dest_uuid: "2db95b2368fb4d598d4020801930f48a"
 from {username='slave'} at 127.0.0.1:51882
I20260709 13:08:14.400503 22475 raft_consensus.cc:493] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.400789 22475 raft_consensus.cc:3060] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.404517 22477 raft_consensus.cc:515] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.404608 22475 raft_consensus.cc:515] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.406148 22475 leader_election.cc:290] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 2 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:14.406291 22477 leader_election.cc:290] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 5 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), d3fadb7179064032940ecc2946026a2e (127.21.67.195:38197)
I20260709 13:08:14.407150 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:14.407434 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b653c31d9f43448bd5643a005fff69" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:14.407701 22402 raft_consensus.cc:3055] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.407840 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d3fadb7179064032940ecc2946026a2e"
I20260709 13:08:14.407981 22551 raft_consensus.cc:3060] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.408020 22402 raft_consensus.cc:740] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:14.408380 22549 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.409006 22402 consensus_queue.cc:260] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.408006 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760daefba7734b6ab04de6d715067584" candidate_uuid: "2db95b2368fb4d598d4020801930f48a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:14.410203 22401 raft_consensus.cc:3055] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:14.410494 22401 raft_consensus.cc:740] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:14.411197 22401 consensus_queue.cc:260] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.412412 22401 raft_consensus.cc:3060] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.414032 22549 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 5.
I20260709 13:08:14.415218 22443 leader_election.cc:304] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:14.415911 22731 raft_consensus.cc:2804] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:14.416321 22402 raft_consensus.cc:3060] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.416472 22551 raft_consensus.cc:2468] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 2.
I20260709 13:08:14.417591 22731 raft_consensus.cc:697] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 5 LEADER]: Becoming Leader. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:14.417737 22443 leader_election.cc:304] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:14.418485 22775 raft_consensus.cc:2804] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.418455 22731 consensus_queue.cc:237] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.422374 22402 raft_consensus.cc:2468] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 2.
I20260709 13:08:14.425815 22401 raft_consensus.cc:2468] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db95b2368fb4d598d4020801930f48a in term 5.
I20260709 13:08:14.426846 22775 raft_consensus.cc:697] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Becoming Leader. State: Replica: 2db95b2368fb4d598d4020801930f48a, State: Running, Role: LEADER
I20260709 13:08:14.427662 22775 consensus_queue.cc:237] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.429473 22297 catalog_manager.cc:5697] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a reported cstate change: term changed from 4 to 5, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to 2db95b2368fb4d598d4020801930f48a (127.21.67.194). New cstate: current_term: 5 leader_uuid: "2db95b2368fb4d598d4020801930f48a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.441880 22639 raft_consensus.cc:993] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:14.442312 22773 raft_consensus.cc:1081] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Signalling peer d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:14.443481 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:08:14.443908 22551 raft_consensus.cc:493] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.444159 22551 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.444267 22297 catalog_manager.cc:5697] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a reported cstate change: term changed from 1 to 2, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to 2db95b2368fb4d598d4020801930f48a (127.21.67.194). New cstate: current_term: 2 leader_uuid: "2db95b2368fb4d598d4020801930f48a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.449075 22551 raft_consensus.cc:515] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.450464 22551 leader_election.cc:290] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 3 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:14.451095 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:14.451642 22401 raft_consensus.cc:3055] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:14.451990 22401 raft_consensus.cc:740] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:14.452001 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82db56ce35754a34a2f5a937ddcb350e" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:14.452721 22477 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.452811 22401 consensus_queue.cc:260] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.453730 22401 raft_consensus.cc:3060] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.458041 22477 raft_consensus.cc:2468] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 3.
I20260709 13:08:14.459062 22514 leader_election.cc:304] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:14.459455 22401 raft_consensus.cc:2468] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 3.
I20260709 13:08:14.459784 22772 raft_consensus.cc:2804] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:14.461037 22772 raft_consensus.cc:697] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 3 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:14.461763 22772 consensus_queue.cc:237] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } }
I20260709 13:08:14.467522 22297 catalog_manager.cc:5697] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 2 to 3, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 3 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.733314 22773 raft_consensus.cc:993] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: : Instructing follower d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:14.733701 22639 raft_consensus.cc:1081] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Signalling peer d3fadb7179064032940ecc2946026a2e to start an election
I20260709 13:08:14.734892 22551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087"
dest_uuid: "d3fadb7179064032940ecc2946026a2e"
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:08:14.735255 22551 raft_consensus.cc:493] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.735462 22551 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.739395 22551 raft_consensus.cc:515] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:14.740936 22551 leader_election.cc:290] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 5 election: Requested vote from peers 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141), 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295)
I20260709 13:08:14.741636 22401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0b45909b725546a59abaae76df2ddc1d"
I20260709 13:08:14.741945 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7deb375c97bf4d0bb8866436bb2a5087" candidate_uuid: "d3fadb7179064032940ecc2946026a2e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2db95b2368fb4d598d4020801930f48a"
I20260709 13:08:14.742134 22401 raft_consensus.cc:3055] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:14.742451 22401 raft_consensus.cc:740] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b45909b725546a59abaae76df2ddc1d, State: Running, Role: LEADER
I20260709 13:08:14.742456 22477 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.743196 22401 consensus_queue.cc:260] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:14.744064 22401 raft_consensus.cc:3060] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.747124 22477 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 5.
I20260709 13:08:14.748027 22514 leader_election.cc:304] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db95b2368fb4d598d4020801930f48a, d3fadb7179064032940ecc2946026a2e; no voters: 
I20260709 13:08:14.748637 22401 raft_consensus.cc:2468] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3fadb7179064032940ecc2946026a2e in term 5.
I20260709 13:08:14.748687 22772 raft_consensus.cc:2804] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:14.749260 22772 raft_consensus.cc:697] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 5 LEADER]: Becoming Leader. State: Replica: d3fadb7179064032940ecc2946026a2e, State: Running, Role: LEADER
I20260709 13:08:14.750388 22772 consensus_queue.cc:237] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } }
I20260709 13:08:14.756842 22297 catalog_manager.cc:5697] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e reported cstate change: term changed from 4 to 5, leader changed from 0b45909b725546a59abaae76df2ddc1d (127.21.67.193) to d3fadb7179064032940ecc2946026a2e (127.21.67.195). New cstate: current_term: 5 leader_uuid: "d3fadb7179064032940ecc2946026a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.833676 22551 raft_consensus.cc:1275] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.834762 22775 consensus_queue.cc:1048] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.844542 22401 raft_consensus.cc:1275] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.846125 22775 consensus_queue.cc:1048] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.857756 22401 raft_consensus.cc:1275] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:14.858950 22772 consensus_queue.cc:1048] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.868103 22477 raft_consensus.cc:1275] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:14.869701 22772 consensus_queue.cc:1048] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.900065 22551 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 5 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:14.901450 22731 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3fadb7179064032940ecc2946026a2e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:14.910239 22401 raft_consensus.cc:1275] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Refusing update from remote peer 2db95b2368fb4d598d4020801930f48a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:14.911818 22776 consensus_queue.cc:1048] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:15.276340 22401 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:15.277418 22772 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b45909b725546a59abaae76df2ddc1d" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:15.281910 22477 raft_consensus.cc:1275] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 5 FOLLOWER]: Refusing update from remote peer d3fadb7179064032940ecc2946026a2e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:15.283187 22772 consensus_queue.cc:1048] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db95b2368fb4d598d4020801930f48a" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:15.382485 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:15.388135 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
W20260709 13:08:15.396008 22441 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:08:15.399777 22441 consensus_peers.cc:597] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a -> Peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Couldn't send request to peer 0b45909b725546a59abaae76df2ddc1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:15.421305 22515 consensus_peers.cc:597] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e -> Peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Couldn't send request to peer 0b45909b725546a59abaae76df2ddc1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.421793 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:15.421871 22515 consensus_peers.cc:597] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e -> Peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Couldn't send request to peer 0b45909b725546a59abaae76df2ddc1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.422554 21775 tablet_replica.cc:333] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.423163 21775 raft_consensus.cc:2243] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.423588 21775 raft_consensus.cc:2272] T 82db56ce35754a34a2f5a937ddcb350e P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.425662 21775 tablet_replica.cc:333] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.426154 21775 raft_consensus.cc:2243] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.426524 21775 raft_consensus.cc:2272] T 21b653c31d9f43448bd5643a005fff69 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.428447 21775 tablet_replica.cc:333] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.428937 21775 raft_consensus.cc:2243] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.429335 21775 raft_consensus.cc:2272] T abb7533f7a6d41909e884b909624ce02 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.430959 21775 tablet_replica.cc:333] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.431416 21775 raft_consensus.cc:2243] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.431823 21775 raft_consensus.cc:2272] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.433314 21775 tablet_replica.cc:333] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.433797 21775 raft_consensus.cc:2243] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.434478 21775 raft_consensus.cc:2272] T f6326957da3e4006b224c1d3d2b998fd P 0b45909b725546a59abaae76df2ddc1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.437494 21775 tablet_replica.cc:333] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.438323 21775 raft_consensus.cc:2243] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.440968 21775 raft_consensus.cc:2272] T 760daefba7734b6ab04de6d715067584 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:15.443516 22441 consensus_peers.cc:597] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a -> Peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Couldn't send request to peer 0b45909b725546a59abaae76df2ddc1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.443826 21775 tablet_replica.cc:333] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
W20260709 13:08:15.444496 22441 consensus_peers.cc:597] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a -> Peer 0b45909b725546a59abaae76df2ddc1d (127.21.67.193:41141): Couldn't send request to peer 0b45909b725546a59abaae76df2ddc1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.444536 21775 raft_consensus.cc:2243] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.445093 21775 raft_consensus.cc:2272] T 7deb375c97bf4d0bb8866436bb2a5087 P 0b45909b725546a59abaae76df2ddc1d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.447781 21775 tablet_replica.cc:333] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.448343 21775 raft_consensus.cc:2243] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.448916 21775 raft_consensus.cc:2272] T 5a1b637054e14c87b9ff199a611ee5ee P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.450388 21775 tablet_replica.cc:333] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.450779 21775 raft_consensus.cc:2243] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.451367 21775 raft_consensus.cc:2272] T 25aa7e92274d43edabbc5dac80dba801 P 0b45909b725546a59abaae76df2ddc1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.453205 21775 tablet_replica.cc:333] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d: stopping tablet replica
I20260709 13:08:15.453763 21775 raft_consensus.cc:2243] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.454504 21775 raft_consensus.cc:2272] T aeabbb11aba941e6acf5610d696361cd P 0b45909b725546a59abaae76df2ddc1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.499459 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
I20260709 13:08:15.516408 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
I20260709 13:08:15.540066 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:15.540623 21775 tablet_replica.cc:333] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.541265 21775 raft_consensus.cc:2243] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.542011 21775 raft_consensus.cc:2272] T 21b653c31d9f43448bd5643a005fff69 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.544175 21775 tablet_replica.cc:333] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.544683 21775 raft_consensus.cc:2243] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.545351 21775 raft_consensus.cc:2272] T 760daefba7734b6ab04de6d715067584 P 2db95b2368fb4d598d4020801930f48a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.547556 21775 tablet_replica.cc:333] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.548082 21775 raft_consensus.cc:2243] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.548452 21775 raft_consensus.cc:2272] T 5a1b637054e14c87b9ff199a611ee5ee P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.550168 21775 tablet_replica.cc:333] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.550611 21775 raft_consensus.cc:2243] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.550990 21775 raft_consensus.cc:2272] T 7deb375c97bf4d0bb8866436bb2a5087 P 2db95b2368fb4d598d4020801930f48a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.552770 21775 tablet_replica.cc:333] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.553256 21775 raft_consensus.cc:2243] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.553761 21775 raft_consensus.cc:2272] T f6326957da3e4006b224c1d3d2b998fd P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.555960 21775 tablet_replica.cc:333] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.556547 21775 raft_consensus.cc:2243] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:08:15.557185 22514 consensus_peers.cc:597] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e -> Peer 2db95b2368fb4d598d4020801930f48a (127.21.67.194:34295): Couldn't send request to peer 2db95b2368fb4d598d4020801930f48a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.557379 21775 raft_consensus.cc:2272] T 81e81c6a7f864ad19ef285dfd52ae1e4 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.559100 21775 tablet_replica.cc:333] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.559544 21775 raft_consensus.cc:2243] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.559955 21775 raft_consensus.cc:2272] T abb7533f7a6d41909e884b909624ce02 P 2db95b2368fb4d598d4020801930f48a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.561385 21775 tablet_replica.cc:333] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.561785 21775 raft_consensus.cc:2243] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.562094 21775 raft_consensus.cc:2272] T 82db56ce35754a34a2f5a937ddcb350e P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.564064 21775 tablet_replica.cc:333] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.564508 21775 raft_consensus.cc:2243] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.564813 21775 raft_consensus.cc:2272] T 25aa7e92274d43edabbc5dac80dba801 P 2db95b2368fb4d598d4020801930f48a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.566131 21775 tablet_replica.cc:333] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a: stopping tablet replica
I20260709 13:08:15.566484 21775 raft_consensus.cc:2243] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.566816 21775 raft_consensus.cc:2272] T aeabbb11aba941e6acf5610d696361cd P 2db95b2368fb4d598d4020801930f48a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.585314 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
I20260709 13:08:15.604136 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
I20260709 13:08:15.623301 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:15.623971 21775 tablet_replica.cc:333] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.624584 21775 raft_consensus.cc:2243] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.624964 21775 raft_consensus.cc:2272] T aeabbb11aba941e6acf5610d696361cd P d3fadb7179064032940ecc2946026a2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.626833 21775 tablet_replica.cc:333] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.627280 21775 raft_consensus.cc:2243] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.627604 21775 raft_consensus.cc:2272] T 25aa7e92274d43edabbc5dac80dba801 P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.629105 21775 tablet_replica.cc:333] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.629519 21775 raft_consensus.cc:2243] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.630151 21775 raft_consensus.cc:2272] T abb7533f7a6d41909e884b909624ce02 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.632043 21775 tablet_replica.cc:333] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.632472 21775 raft_consensus.cc:2243] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.632813 21775 raft_consensus.cc:2272] T 81e81c6a7f864ad19ef285dfd52ae1e4 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.634160 21775 tablet_replica.cc:333] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.634562 21775 raft_consensus.cc:2243] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.634900 21775 raft_consensus.cc:2272] T f6326957da3e4006b224c1d3d2b998fd P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.636373 21775 tablet_replica.cc:333] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.636783 21775 raft_consensus.cc:2243] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.637178 21775 raft_consensus.cc:2272] T 5a1b637054e14c87b9ff199a611ee5ee P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.638645 21775 tablet_replica.cc:333] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.639091 21775 raft_consensus.cc:2243] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.639521 21775 raft_consensus.cc:2272] T 760daefba7734b6ab04de6d715067584 P d3fadb7179064032940ecc2946026a2e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.641333 21775 tablet_replica.cc:333] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.641786 21775 raft_consensus.cc:2243] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.642447 21775 raft_consensus.cc:2272] T 7deb375c97bf4d0bb8866436bb2a5087 P d3fadb7179064032940ecc2946026a2e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.644731 21775 tablet_replica.cc:333] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.645246 21775 raft_consensus.cc:2243] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.645601 21775 raft_consensus.cc:2272] T 21b653c31d9f43448bd5643a005fff69 P d3fadb7179064032940ecc2946026a2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.647277 21775 tablet_replica.cc:333] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e: stopping tablet replica
I20260709 13:08:15.647769 21775 raft_consensus.cc:2243] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.648392 21775 raft_consensus.cc:2272] T 82db56ce35754a34a2f5a937ddcb350e P d3fadb7179064032940ecc2946026a2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.675011 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:08:15.691792 21775 master.cc:562] Master@127.21.67.254:40289 shutting down...
I20260709 13:08:15.710541 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.711004 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.711269 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P f56766354c2741b3bc30265a5c0378e8: stopping tablet replica
I20260709 13:08:15.746850 21775 master.cc:584] Master@127.21.67.254:40289 shutdown complete.
0b45909b725546a59abaae76df2ddc1d  5
2db95b2368fb4d598d4020801930f48a  4
d3fadb7179064032940ecc2946026a2e  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12846 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:08:15.785742 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:36129
I20260709 13:08:15.786870 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:15.792312 22805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.792548 22804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.793303 22807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:15.795763 21775 server_base.cc:1061] running on GCE node
I20260709 13:08:15.796615 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:15.796792 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:15.796901 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602495796891 us; error 0 us; skew 500 ppm
I20260709 13:08:15.797386 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:15.799518 21775 webserver.cc:533] Webserver started at http://127.21.67.254:41953/ using document root <none> and password file <none>
I20260709 13:08:15.799986 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:15.800133 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:15.800333 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:15.801355 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "84f66d81ef21415a8d9a0c01ca7125b0"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-zkvt"
I20260709 13:08:15.805372 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:15.808337 22812 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.809002 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:08:15.809260 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "84f66d81ef21415a8d9a0c01ca7125b0"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-zkvt"
I20260709 13:08:15.809516 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:15.825402 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:15.826558 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:15.862941 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:36129
I20260709 13:08:15.863034 22863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:36129 every 8 connection(s)
I20260709 13:08:15.866848 22864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.876173 22864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Bootstrap starting.
I20260709 13:08:15.880631 22864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:15.884460 22864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: No bootstrap required, opened a new log
I20260709 13:08:15.886371 22864 raft_consensus.cc:359] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" member_type: VOTER }
I20260709 13:08:15.886710 22864 raft_consensus.cc:385] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:15.886883 22864 raft_consensus.cc:740] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84f66d81ef21415a8d9a0c01ca7125b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:15.887427 22864 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" member_type: VOTER }
I20260709 13:08:15.887845 22864 raft_consensus.cc:399] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:15.888034 22864 raft_consensus.cc:493] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:15.888242 22864 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:15.892119 22864 raft_consensus.cc:515] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" member_type: VOTER }
I20260709 13:08:15.892558 22864 leader_election.cc:304] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84f66d81ef21415a8d9a0c01ca7125b0; no voters: 
I20260709 13:08:15.893545 22864 leader_election.cc:290] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:15.893858 22867 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:15.895104 22867 raft_consensus.cc:697] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 1 LEADER]: Becoming Leader. State: Replica: 84f66d81ef21415a8d9a0c01ca7125b0, State: Running, Role: LEADER
I20260709 13:08:15.895777 22867 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" member_type: VOTER }
I20260709 13:08:15.896373 22864 sys_catalog.cc:565] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:15.900332 22869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84f66d81ef21415a8d9a0c01ca7125b0. Latest consensus state: current_term: 1 leader_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" member_type: VOTER } }
I20260709 13:08:15.900323 22868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84f66d81ef21415a8d9a0c01ca7125b0" member_type: VOTER } }
I20260709 13:08:15.901222 22869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:15.901288 22868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:15.904774 22874 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:15.909412 22874 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:15.912955 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:15.917776 22874 catalog_manager.cc:1383] Generated new cluster ID: e6a99530cc0440cc84fa71d072b54853
I20260709 13:08:15.918025 22874 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:15.957819 22874 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:15.959062 22874 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:15.971021 22874 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Generated new TSK 0
I20260709 13:08:15.971623 22874 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:15.979369 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:15.984908 22885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.986037 22886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.988031 22888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:15.988067 21775 server_base.cc:1061] running on GCE node
I20260709 13:08:15.989117 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:15.989329 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:15.989521 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602495989499 us; error 0 us; skew 500 ppm
I20260709 13:08:15.990097 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:15.992374 21775 webserver.cc:533] Webserver started at http://127.21.67.193:43989/ using document root <none> and password file <none>
I20260709 13:08:15.992859 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:15.993070 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:15.993348 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:15.994481 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-zkvt"
I20260709 13:08:15.999125 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:16.002269 22893 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.002965 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:16.003250 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-zkvt"
I20260709 13:08:16.003527 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:16.017688 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:16.018813 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:16.020195 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:16.022276 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:16.022482 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.022707 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:16.022888 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.060981 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:39171
I20260709 13:08:16.061085 22955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:39171 every 8 connection(s)
I20260709 13:08:16.065830 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:16.072844 22960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:16.079423 22961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:16.081234 22963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:16.082047 21775 server_base.cc:1061] running on GCE node
I20260709 13:08:16.083817 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:16.084079 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:16.084264 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602496084249 us; error 0 us; skew 500 ppm
I20260709 13:08:16.084911 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:16.085887 22956 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36129
I20260709 13:08:16.086290 22956 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:16.086984 22956 heartbeater.cc:507] Master 127.21.67.254:36129 requested a full tablet report, sending...
I20260709 13:08:16.087577 21775 webserver.cc:533] Webserver started at http://127.21.67.194:33827/ using document root <none> and password file <none>
I20260709 13:08:16.088215 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:16.088449 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:16.088726 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:16.089036 22829 ts_manager.cc:194] Registered new tserver with Master: 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:16.089874 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "216ff6323e434e399d196d8ba262c8f3"
format_stamp: "Formatted at 2026-07-09 13:08:16 on dist-test-slave-zkvt"
I20260709 13:08:16.090768 22829 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35496
I20260709 13:08:16.094220 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:16.097513 22968 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.098259 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:16.098503 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "216ff6323e434e399d196d8ba262c8f3"
format_stamp: "Formatted at 2026-07-09 13:08:16 on dist-test-slave-zkvt"
I20260709 13:08:16.098729 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:16.113596 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:16.114619 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:16.115964 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:16.118408 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:16.118605 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.118932 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:16.119153 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.159789 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:39749
I20260709 13:08:16.159785 23030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:39749 every 8 connection(s)
I20260709 13:08:16.164942 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:16.172539 23034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:16.172672 23035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:16.175712 23037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:16.176597 21775 server_base.cc:1061] running on GCE node
I20260709 13:08:16.177593 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:16.177830 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:16.178037 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602496178017 us; error 0 us; skew 500 ppm
I20260709 13:08:16.178113 23031 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36129
I20260709 13:08:16.178496 23031 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:16.178906 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:16.179458 23031 heartbeater.cc:507] Master 127.21.67.254:36129 requested a full tablet report, sending...
I20260709 13:08:16.181592 21775 webserver.cc:533] Webserver started at http://127.21.67.195:36591/ using document root <none> and password file <none>
I20260709 13:08:16.181602 22829 ts_manager.cc:194] Registered new tserver with Master: 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:16.182133 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:16.182348 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:16.182622 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:16.183172 22829 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35508
I20260709 13:08:16.183799 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "b655449a388a41e3a606c6ea794825ad"
format_stamp: "Formatted at 2026-07-09 13:08:16 on dist-test-slave-zkvt"
I20260709 13:08:16.188023 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:16.190791 23042 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.191627 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:16.192044 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "b655449a388a41e3a606c6ea794825ad"
format_stamp: "Formatted at 2026-07-09 13:08:16 on dist-test-slave-zkvt"
I20260709 13:08:16.192286 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:16.221699 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:16.222780 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:16.224205 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:16.226279 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:16.226501 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.226732 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:16.226902 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.266757 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:45219
I20260709 13:08:16.266855 23104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:45219 every 8 connection(s)
I20260709 13:08:16.280299 23105 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36129
I20260709 13:08:16.280663 23105 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:16.281375 23105 heartbeater.cc:507] Master 127.21.67.254:36129 requested a full tablet report, sending...
I20260709 13:08:16.283701 22829 ts_manager.cc:194] Registered new tserver with Master: b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:16.284215 21775 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014308519s
I20260709 13:08:16.285158 22829 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35510
I20260709 13:08:16.308547 22829 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35514:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:16.314517 22829 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:16.499823 23070 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3bed822a364ea9afe4d449542afc6b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:16.501277 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3bed822a364ea9afe4d449542afc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.501132 23068 tablet_service.cc:1511] Processing CreateTablet for tablet 94bcbf412cf54b0fa378f2ce70dec99f (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:16.502907 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bcbf412cf54b0fa378f2ce70dec99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.504865 23069 tablet_service.cc:1511] Processing CreateTablet for tablet 003d4c22ec774af79682d96196a7e8b7 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:16.505265 23067 tablet_service.cc:1511] Processing CreateTablet for tablet ee9d7188ba094ea3b277000bf9f3a73e (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:16.506181 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003d4c22ec774af79682d96196a7e8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.509825 23066 tablet_service.cc:1511] Processing CreateTablet for tablet 2806bd6497384caf84700ae1cb863e9b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:16.511113 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2806bd6497384caf84700ae1cb863e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.511925 22919 tablet_service.cc:1511] Processing CreateTablet for tablet 94bcbf412cf54b0fa378f2ce70dec99f (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:16.513226 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bcbf412cf54b0fa378f2ce70dec99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.512975 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3bed822a364ea9afe4d449542afc6b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:16.514183 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3bed822a364ea9afe4d449542afc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.516044 22920 tablet_service.cc:1511] Processing CreateTablet for tablet 003d4c22ec774af79682d96196a7e8b7 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:16.517313 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003d4c22ec774af79682d96196a7e8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.517428 22918 tablet_service.cc:1511] Processing CreateTablet for tablet ee9d7188ba094ea3b277000bf9f3a73e (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:16.518698 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9d7188ba094ea3b277000bf9f3a73e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.518853 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9d7188ba094ea3b277000bf9f3a73e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.524471 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 2806bd6497384caf84700ae1cb863e9b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:16.525763 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2806bd6497384caf84700ae1cb863e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.528872 22995 tablet_service.cc:1511] Processing CreateTablet for tablet 003d4c22ec774af79682d96196a7e8b7 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:16.530164 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003d4c22ec774af79682d96196a7e8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.530485 23064 tablet_service.cc:1511] Processing CreateTablet for tablet 492dd607be6348c79999243a8383806d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:16.531801 23064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492dd607be6348c79999243a8383806d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.532723 22994 tablet_service.cc:1511] Processing CreateTablet for tablet 94bcbf412cf54b0fa378f2ce70dec99f (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:16.534036 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bcbf412cf54b0fa378f2ce70dec99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.534181 23063 tablet_service.cc:1511] Processing CreateTablet for tablet 9c57d9be04024fee96aa769711f72d7c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:16.535423 23063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c57d9be04024fee96aa769711f72d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.536718 22993 tablet_service.cc:1511] Processing CreateTablet for tablet ee9d7188ba094ea3b277000bf9f3a73e (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:16.537994 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9d7188ba094ea3b277000bf9f3a73e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.537954 23062 tablet_service.cc:1511] Processing CreateTablet for tablet 7c435cd2efc84579b5b18dbaa04ee538 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:16.539316 23062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c435cd2efc84579b5b18dbaa04ee538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.541600 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 22342f9fc8d5439e9dc7755716c74fdb (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:16.541827 22916 tablet_service.cc:1511] Processing CreateTablet for tablet 22342f9fc8d5439e9dc7755716c74fdb (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:16.542805 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22342f9fc8d5439e9dc7755716c74fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.543138 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22342f9fc8d5439e9dc7755716c74fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.544788 23065 tablet_service.cc:1511] Processing CreateTablet for tablet 22342f9fc8d5439e9dc7755716c74fdb (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:16.546029 23065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22342f9fc8d5439e9dc7755716c74fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.548717 22992 tablet_service.cc:1511] Processing CreateTablet for tablet 2806bd6497384caf84700ae1cb863e9b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:16.549980 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2806bd6497384caf84700ae1cb863e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.552842 23061 tablet_service.cc:1511] Processing CreateTablet for tablet f09dae9312b04b4c8d390ab7d430e7cb (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:16.554095 23061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09dae9312b04b4c8d390ab7d430e7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.527268 22996 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3bed822a364ea9afe4d449542afc6b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:16.560663 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3bed822a364ea9afe4d449542afc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.568797 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 9c57d9be04024fee96aa769711f72d7c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:16.570143 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c57d9be04024fee96aa769711f72d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.572877 22913 tablet_service.cc:1511] Processing CreateTablet for tablet 7c435cd2efc84579b5b18dbaa04ee538 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:16.574334 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c435cd2efc84579b5b18dbaa04ee538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.575018 22912 tablet_service.cc:1511] Processing CreateTablet for tablet f09dae9312b04b4c8d390ab7d430e7cb (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:16.576360 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09dae9312b04b4c8d390ab7d430e7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.580798 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 492dd607be6348c79999243a8383806d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:16.582116 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492dd607be6348c79999243a8383806d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.601826 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 9c57d9be04024fee96aa769711f72d7c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:16.613781 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c57d9be04024fee96aa769711f72d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.616729 22988 tablet_service.cc:1511] Processing CreateTablet for tablet f09dae9312b04b4c8d390ab7d430e7cb (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:16.618010 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09dae9312b04b4c8d390ab7d430e7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.625610 23068 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7d0f07529640fcbd96e1a627491d86 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:16.626895 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7d0f07529640fcbd96e1a627491d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.628505 22994 tablet_service.cc:1511] Processing CreateTablet for tablet 492dd607be6348c79999243a8383806d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:16.629715 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492dd607be6348c79999243a8383806d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.636838 22987 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7d0f07529640fcbd96e1a627491d86 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:16.638239 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7d0f07529640fcbd96e1a627491d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.643678 23068 tablet_service.cc:1511] Processing CreateTablet for tablet 0633fbe8ee1c4284a67d72b00a0285a0 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:16.644477 22989 tablet_service.cc:1511] Processing CreateTablet for tablet 7c435cd2efc84579b5b18dbaa04ee538 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:16.645012 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0633fbe8ee1c4284a67d72b00a0285a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.645349 22993 tablet_service.cc:1511] Processing CreateTablet for tablet 0633fbe8ee1c4284a67d72b00a0285a0 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:16.645793 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c435cd2efc84579b5b18dbaa04ee538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.646577 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0633fbe8ee1c4284a67d72b00a0285a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.653182 22987 tablet_service.cc:1511] Processing CreateTablet for tablet 1a642095ff8a4146b8e977c3af22c826 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:16.660435 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a642095ff8a4146b8e977c3af22c826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.663959 22918 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7d0f07529640fcbd96e1a627491d86 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:16.665179 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7d0f07529640fcbd96e1a627491d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.675050 22912 tablet_service.cc:1511] Processing CreateTablet for tablet 0633fbe8ee1c4284a67d72b00a0285a0 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:16.676401 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0633fbe8ee1c4284a67d72b00a0285a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.695816 23063 tablet_service.cc:1511] Processing CreateTablet for tablet 1a642095ff8a4146b8e977c3af22c826 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:16.697057 23063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a642095ff8a4146b8e977c3af22c826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.702073 22995 tablet_service.cc:1511] Processing CreateTablet for tablet 23b2c8978a514c01ba48a8c4a08a7570 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:16.709132 22996 tablet_service.cc:1511] Processing CreateTablet for tablet d9dd0ac5baf440fc96bcfc581bb5d2de (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:16.713423 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 1a642095ff8a4146b8e977c3af22c826 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:16.714634 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a642095ff8a4146b8e977c3af22c826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.703290 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b2c8978a514c01ba48a8c4a08a7570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.740214 23120 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:16.740828 22918 tablet_service.cc:1511] Processing CreateTablet for tablet d3222d52f8784a58a81fe1c534bbaf98 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:16.740890 22917 tablet_service.cc:1511] Processing CreateTablet for tablet d9dd0ac5baf440fc96bcfc581bb5d2de (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:16.742131 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3222d52f8784a58a81fe1c534bbaf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.742666 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9dd0ac5baf440fc96bcfc581bb5d2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.744095 22916 tablet_service.cc:1511] Processing CreateTablet for tablet ce98d2857d3f449c8d9052124b418f8c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:16.745261 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce98d2857d3f449c8d9052124b418f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.748626 23064 tablet_service.cc:1511] Processing CreateTablet for tablet d9dd0ac5baf440fc96bcfc581bb5d2de (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:16.753084 23121 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:16.749125 23062 tablet_service.cc:1511] Processing CreateTablet for tablet d3222d52f8784a58a81fe1c534bbaf98 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:16.759768 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9dd0ac5baf440fc96bcfc581bb5d2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.761802 22919 tablet_service.cc:1511] Processing CreateTablet for tablet 37e2e961b20a4588ba99edcaeaaf578c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:16.762962 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e2e961b20a4588ba99edcaeaaf578c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.764345 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 23b2c8978a514c01ba48a8c4a08a7570 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:16.765535 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b2c8978a514c01ba48a8c4a08a7570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.769100 23068 tablet_service.cc:1511] Processing CreateTablet for tablet ce98d2857d3f449c8d9052124b418f8c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:16.770265 23064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9dd0ac5baf440fc96bcfc581bb5d2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.784330 23062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3222d52f8784a58a81fe1c534bbaf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.785473 22913 tablet_service.cc:1511] Processing CreateTablet for tablet 682d24a2200c4222a401f9ab803af214 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:16.786772 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682d24a2200c4222a401f9ab803af214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.786839 23121 tablet_bootstrap.cc:654] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.791183 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 387a947805334b78b3ac130dee5e4d40 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:16.780865 23120 tablet_bootstrap.cc:654] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.803617 22991 tablet_service.cc:1511] Processing CreateTablet for tablet d3222d52f8784a58a81fe1c534bbaf98 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:16.809931 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3222d52f8784a58a81fe1c534bbaf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.816521 23067 tablet_service.cc:1511] Processing CreateTablet for tablet 387a947805334b78b3ac130dee5e4d40 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:16.817608 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387a947805334b78b3ac130dee5e4d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.821246 23066 tablet_service.cc:1511] Processing CreateTablet for tablet ca18e836a5464ec5b09378b03ae8b23f (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:16.817970 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce98d2857d3f449c8d9052124b418f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.817790 23065 tablet_service.cc:1511] Processing CreateTablet for tablet 19265c3b4d3344e492485458bb4cc867 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:16.830844 22913 tablet_service.cc:1511] Processing CreateTablet for tablet ca18e836a5464ec5b09378b03ae8b23f (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:16.820263 22918 tablet_service.cc:1511] Processing CreateTablet for tablet 19265c3b4d3344e492485458bb4cc867 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:16.831302 23065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19265c3b4d3344e492485458bb4cc867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.815219 23069 tablet_service.cc:1511] Processing CreateTablet for tablet 682d24a2200c4222a401f9ab803af214 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:16.843930 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682d24a2200c4222a401f9ab803af214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.845245 23070 tablet_service.cc:1511] Processing CreateTablet for tablet 37e2e961b20a4588ba99edcaeaaf578c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:16.846454 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e2e961b20a4588ba99edcaeaaf578c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.848105 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca18e836a5464ec5b09378b03ae8b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.849784 23062 tablet_service.cc:1511] Processing CreateTablet for tablet e257e4274a884c2b87551c41d6072956 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:16.850512 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387a947805334b78b3ac130dee5e4d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.854858 23062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e257e4274a884c2b87551c41d6072956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.840353 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca18e836a5464ec5b09378b03ae8b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.853569 22992 tablet_service.cc:1511] Processing CreateTablet for tablet ce98d2857d3f449c8d9052124b418f8c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:16.871765 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce98d2857d3f449c8d9052124b418f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.877851 22993 tablet_service.cc:1511] Processing CreateTablet for tablet 387a947805334b78b3ac130dee5e4d40 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:16.879401 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387a947805334b78b3ac130dee5e4d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.875409 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19265c3b4d3344e492485458bb4cc867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.875793 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 682d24a2200c4222a401f9ab803af214 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:16.856413 22994 tablet_service.cc:1511] Processing CreateTablet for tablet 37e2e961b20a4588ba99edcaeaaf578c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:16.860972 23122 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:16.850852 23061 tablet_service.cc:1511] Processing CreateTablet for tablet 23b2c8978a514c01ba48a8c4a08a7570 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:16.888348 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682d24a2200c4222a401f9ab803af214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.925818 23061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b2c8978a514c01ba48a8c4a08a7570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.907269 22989 tablet_service.cc:1511] Processing CreateTablet for tablet ca18e836a5464ec5b09378b03ae8b23f (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:16.928787 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca18e836a5464ec5b09378b03ae8b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.921196 22914 tablet_service.cc:1511] Processing CreateTablet for tablet eccda721d3ee4ac79479134d323b9640 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:16.897895 22916 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf6397d6bc54a22915e0146962b443d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:16.940439 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf6397d6bc54a22915e0146962b443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.940740 22912 tablet_service.cc:1511] Processing CreateTablet for tablet f5db53771823404097dd71493c3b242b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:16.942137 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5db53771823404097dd71493c3b242b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.944010 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e2e961b20a4588ba99edcaeaaf578c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.946218 23120 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:16.946712 23120 ts_tablet_manager.cc:1403] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.207s	user 0.006s	sys 0.008s
I20260709 13:08:16.949993 23120 raft_consensus.cc:359] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:16.931511 23068 tablet_service.cc:1511] Processing CreateTablet for tablet f5db53771823404097dd71493c3b242b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:16.892644 22988 tablet_service.cc:1511] Processing CreateTablet for tablet 19265c3b4d3344e492485458bb4cc867 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:16.950830 23120 raft_consensus.cc:385] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.951208 23120 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.951586 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19265c3b4d3344e492485458bb4cc867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.897797 23063 tablet_service.cc:1511] Processing CreateTablet for tablet 72f4ca03b8704b4ca2ad66da9add8692 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:08:16.908555 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:16.910009 23062 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf6397d6bc54a22915e0146962b443d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:16.890020 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 72f4ca03b8704b4ca2ad66da9add8692 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:16.915000 23064 tablet_service.cc:1511] Processing CreateTablet for tablet eccda721d3ee4ac79479134d323b9640 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:16.937294 23066 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfb822e7cb640e68719af6e16591c4a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:08:16.893038 22814 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44092.4us
I20260709 13:08:16.965277 23120 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:16.953079 23063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f4ca03b8704b4ca2ad66da9add8692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.968187 23062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf6397d6bc54a22915e0146962b443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.969152 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfb822e7cb640e68719af6e16591c4a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:16.970666 23064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccda721d3ee4ac79479134d323b9640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.971623 23121 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:16.972101 23121 ts_tablet_manager.cc:1403] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.013s
I20260709 13:08:16.958355 23122 tablet_bootstrap.cc:654] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.958199 22987 tablet_service.cc:1511] Processing CreateTablet for tablet 72f4ca03b8704b4ca2ad66da9add8692 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:16.960577 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f4ca03b8704b4ca2ad66da9add8692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.960700 22996 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf6397d6bc54a22915e0146962b443d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:16.981838 22991 tablet_service.cc:1511] Processing CreateTablet for tablet eccda721d3ee4ac79479134d323b9640 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:16.983032 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccda721d3ee4ac79479134d323b9640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.983830 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f4ca03b8704b4ca2ad66da9add8692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.992110 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5db53771823404097dd71493c3b242b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.886132 22920 tablet_service.cc:1511] Processing CreateTablet for tablet e257e4274a884c2b87551c41d6072956 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:16.996423 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e257e4274a884c2b87551c41d6072956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.912020 22995 tablet_service.cc:1511] Processing CreateTablet for tablet e257e4274a884c2b87551c41d6072956 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:17.003568 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e257e4274a884c2b87551c41d6072956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.013511 23121 raft_consensus.cc:359] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:17.014228 23121 raft_consensus.cc:385] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.004030 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccda721d3ee4ac79479134d323b9640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.014511 23121 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.017411 23069 tablet_service.cc:1511] Processing CreateTablet for tablet a5f4021a98714bc6b65420cc163e3a91 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:17.020016 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf6397d6bc54a22915e0146962b443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.017760 23065 tablet_service.cc:1511] Processing CreateTablet for tablet da207091d69d47c2a67b181645327e1c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:17.002825 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfb822e7cb640e68719af6e16591c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.018633 22990 tablet_service.cc:1511] Processing CreateTablet for tablet f5db53771823404097dd71493c3b242b (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:17.044842 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5db53771823404097dd71493c3b242b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.050776 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f4021a98714bc6b65420cc163e3a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.056176 23125 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.056629 23125 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.059132 23125 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:17.059769 23031 heartbeater.cc:499] Master 127.21.67.254:36129 was elected leader, sending a full tablet report...
I20260709 13:08:17.039268 23121 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:17.049239 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfb822e7cb640e68719af6e16591c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.106750 23105 heartbeater.cc:499] Master 127.21.67.254:36129 was elected leader, sending a full tablet report...
I20260709 13:08:17.107442 22913 tablet_service.cc:1511] Processing CreateTablet for tablet d86fa0480a7543048d2dc4f8046cd314 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:17.108721 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86fa0480a7543048d2dc4f8046cd314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.111804 22988 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfb822e7cb640e68719af6e16591c4a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:17.112999 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfb822e7cb640e68719af6e16591c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.113381 23067 tablet_service.cc:1511] Processing CreateTablet for tablet d86fa0480a7543048d2dc4f8046cd314 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:17.100071 22956 heartbeater.cc:499] Master 127.21.67.254:36129 was elected leader, sending a full tablet report...
I20260709 13:08:17.114239 23069 tablet_service.cc:1511] Processing CreateTablet for tablet 5adc1058fd2948e382bcd0ee2213ab3a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:17.124460 22919 tablet_service.cc:1511] Processing CreateTablet for tablet 5adc1058fd2948e382bcd0ee2213ab3a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:17.124691 22916 tablet_service.cc:1511] Processing CreateTablet for tablet a5f4021a98714bc6b65420cc163e3a91 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:17.125869 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f4021a98714bc6b65420cc163e3a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.125753 22989 tablet_service.cc:1511] Processing CreateTablet for tablet a5f4021a98714bc6b65420cc163e3a91 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:17.126940 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f4021a98714bc6b65420cc163e3a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.146013 23063 tablet_service.cc:1511] Processing CreateTablet for tablet 20adeb7c99154724bd868029eb5ed0df (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:17.104514 23065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da207091d69d47c2a67b181645327e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.156431 22992 tablet_service.cc:1511] Processing CreateTablet for tablet d86fa0480a7543048d2dc4f8046cd314 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:17.157852 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86fa0480a7543048d2dc4f8046cd314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.159950 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adc1058fd2948e382bcd0ee2213ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.164004 23120 ts_tablet_manager.cc:1434] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.217s	user 0.015s	sys 0.024s
I20260709 13:08:17.165132 23120 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:17.168866 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 952ed8a46c5e4f158f63440eb6fbef0a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:17.170182 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ed8a46c5e4f158f63440eb6fbef0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.178339 22987 tablet_service.cc:1511] Processing CreateTablet for tablet 5adc1058fd2948e382bcd0ee2213ab3a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:17.183383 22912 tablet_service.cc:1511] Processing CreateTablet for tablet 20adeb7c99154724bd868029eb5ed0df (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:17.184656 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20adeb7c99154724bd868029eb5ed0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.185642 23131 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.186100 23131 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:17.188776 23131 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:17.119270 23064 tablet_service.cc:1511] Processing CreateTablet for tablet 952ed8a46c5e4f158f63440eb6fbef0a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:17.201223 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86fa0480a7543048d2dc4f8046cd314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.201145 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adc1058fd2948e382bcd0ee2213ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:17.195479 22814 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 82223.5us
I20260709 13:08:17.217166 23068 tablet_service.cc:1511] Processing CreateTablet for tablet a0fd26ed0b904e01959f5f0d30437e69 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:17.217975 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adc1058fd2948e382bcd0ee2213ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.223301 22995 tablet_service.cc:1511] Processing CreateTablet for tablet 952ed8a46c5e4f158f63440eb6fbef0a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:17.224087 23064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ed8a46c5e4f158f63440eb6fbef0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.224730 23121 ts_tablet_manager.cc:1434] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.252s	user 0.020s	sys 0.011s
I20260709 13:08:17.224574 22994 tablet_service.cc:1511] Processing CreateTablet for tablet da207091d69d47c2a67b181645327e1c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:17.225697 23121 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:17.226377 23063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20adeb7c99154724bd868029eb5ed0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.223459 22918 tablet_service.cc:1511] Processing CreateTablet for tablet da207091d69d47c2a67b181645327e1c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:17.240309 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da207091d69d47c2a67b181645327e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.248075 23122 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:17.249661 23122 ts_tablet_manager.cc:1403] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.389s	user 0.028s	sys 0.053s
I20260709 13:08:17.252475 23122 raft_consensus.cc:359] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.253161 23122 raft_consensus.cc:385] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.253435 23122 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.254066 23122 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.267443 23121 tablet_bootstrap.cc:654] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.267930 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fd26ed0b904e01959f5f0d30437e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.275336 22989 tablet_service.cc:1511] Processing CreateTablet for tablet a0fd26ed0b904e01959f5f0d30437e69 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:17.276427 23062 tablet_service.cc:1511] Processing CreateTablet for tablet 808909fe49ff4730b32151fb7a7b559e (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:17.277702 23062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808909fe49ff4730b32151fb7a7b559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.277828 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da207091d69d47c2a67b181645327e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.271029 22996 tablet_service.cc:1511] Processing CreateTablet for tablet 20adeb7c99154724bd868029eb5ed0df (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:17.307233 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ed8a46c5e4f158f63440eb6fbef0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.310333 23120 tablet_bootstrap.cc:654] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.319085 23061 tablet_service.cc:1511] Processing CreateTablet for tablet defec66b69804f8c85671fbdd904172d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:17.320580 23061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defec66b69804f8c85671fbdd904172d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.320513 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:17.322095 22970 leader_election.cc:343] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.277681 22990 tablet_service.cc:1511] Processing CreateTablet for tablet defec66b69804f8c85671fbdd904172d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:17.344259 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20adeb7c99154724bd868029eb5ed0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.346729 22991 tablet_service.cc:1511] Processing CreateTablet for tablet e54cbb7e06ba404b91d84809d3aa8548 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:17.348372 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54cbb7e06ba404b91d84809d3aa8548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.346472 23065 tablet_service.cc:1511] Processing CreateTablet for tablet e54cbb7e06ba404b91d84809d3aa8548 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:17.344746 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:17.374107 22972 leader_election.cc:343] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.374581 22972 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:17.314787 22914 tablet_service.cc:1511] Processing CreateTablet for tablet a0fd26ed0b904e01959f5f0d30437e69 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:17.357097 22917 tablet_service.cc:1511] Processing CreateTablet for tablet defec66b69804f8c85671fbdd904172d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:17.375533 23126 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.376513 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fd26ed0b904e01959f5f0d30437e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.378894 23065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54cbb7e06ba404b91d84809d3aa8548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.360957 23066 tablet_service.cc:1511] Processing CreateTablet for tablet 2534f3909dce4851918d5cc9a252f085 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:17.365152 23070 tablet_service.cc:1511] Processing CreateTablet for tablet 71491ce9117b44a08c83b84589d0ba9d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:17.359488 23068 tablet_service.cc:1511] Processing CreateTablet for tablet e45d03aff8ab48f6bc531f18ca6d386c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:17.380170 23122 ts_tablet_manager.cc:1434] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.130s	user 0.013s	sys 0.029s
I20260709 13:08:17.403381 23122 tablet_bootstrap.cc:492] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:17.406167 22916 tablet_service.cc:1511] Processing CreateTablet for tablet e54cbb7e06ba404b91d84809d3aa8548 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:17.415941 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45d03aff8ab48f6bc531f18ca6d386c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.416652 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71491ce9117b44a08c83b84589d0ba9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.420040 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2534f3909dce4851918d5cc9a252f085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.421747 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 2534f3909dce4851918d5cc9a252f085 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:17.423146 22988 tablet_service.cc:1511] Processing CreateTablet for tablet 2534f3909dce4851918d5cc9a252f085 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:17.424077 22920 tablet_service.cc:1511] Processing CreateTablet for tablet 808909fe49ff4730b32151fb7a7b559e (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:17.387952 23062 tablet_service.cc:1511] Processing CreateTablet for tablet 09c7979afa3c4fcb83838f29edec3b67 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:17.391853 22993 tablet_service.cc:1511] Processing CreateTablet for tablet 808909fe49ff4730b32151fb7a7b559e (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:17.391469 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fd26ed0b904e01959f5f0d30437e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.399166 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:17.400602 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defec66b69804f8c85671fbdd904172d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:17.431737 23046 leader_election.cc:343] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.431977 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808909fe49ff4730b32151fb7a7b559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.432425 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54cbb7e06ba404b91d84809d3aa8548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.437769 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2534f3909dce4851918d5cc9a252f085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.445392 22912 tablet_service.cc:1511] Processing CreateTablet for tablet e45d03aff8ab48f6bc531f18ca6d386c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:17.448709 22919 tablet_service.cc:1511] Processing CreateTablet for tablet 71491ce9117b44a08c83b84589d0ba9d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:17.449874 23062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c7979afa3c4fcb83838f29edec3b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.450019 22913 tablet_service.cc:1511] Processing CreateTablet for tablet 09c7979afa3c4fcb83838f29edec3b67 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:17.451843 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2534f3909dce4851918d5cc9a252f085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.452741 22918 tablet_service.cc:1511] Processing CreateTablet for tablet b8c270d6f9de4942999edb2e7e999066 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:17.453763 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45d03aff8ab48f6bc531f18ca6d386c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.458643 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:17.459723 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defec66b69804f8c85671fbdd904172d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:17.460827 23045 leader_election.cc:343] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.461277 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:17.462083 23131 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.463755 23120 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:17.464289 23120 ts_tablet_manager.cc:1403] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.299s	user 0.027s	sys 0.023s
I20260709 13:08:17.469017 22996 tablet_service.cc:1511] Processing CreateTablet for tablet e45d03aff8ab48f6bc531f18ca6d386c (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:17.469682 23120 raft_consensus.cc:359] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.470361 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45d03aff8ab48f6bc531f18ca6d386c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.470418 23120 raft_consensus.cc:385] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.470839 23120 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.472093 23121 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:17.472577 23121 ts_tablet_manager.cc:1403] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.247s	user 0.009s	sys 0.015s
I20260709 13:08:17.476080 22995 tablet_service.cc:1511] Processing CreateTablet for tablet 71491ce9117b44a08c83b84589d0ba9d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:17.477689 23069 tablet_service.cc:1511] Processing CreateTablet for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:17.484787 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71491ce9117b44a08c83b84589d0ba9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.483428 23120 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.515313 22992 tablet_service.cc:1511] Processing CreateTablet for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:17.517551 23120 ts_tablet_manager.cc:1434] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.053s	user 0.002s	sys 0.004s
I20260709 13:08:17.518532 23120 tablet_bootstrap.cc:492] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:17.492012 23064 tablet_service.cc:1511] Processing CreateTablet for tablet f56c90b2fb06459db835049dbf5a060d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:17.475543 23121 raft_consensus.cc:359] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.520131 23121 raft_consensus.cc:385] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.520468 23121 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.495872 23122 tablet_bootstrap.cc:654] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.500288 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.521399 23121 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.501228 23067 tablet_service.cc:1511] Processing CreateTablet for tablet b8c270d6f9de4942999edb2e7e999066 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:17.523907 23121 ts_tablet_manager.cc:1434] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.003s
I20260709 13:08:17.524544 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c270d6f9de4942999edb2e7e999066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.524636 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c270d6f9de4942999edb2e7e999066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.506634 22921 tablet_service.cc:1511] Processing CreateTablet for tablet f56c90b2fb06459db835049dbf5a060d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:17.529771 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56c90b2fb06459db835049dbf5a060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.534955 23063 tablet_service.cc:1511] Processing CreateTablet for tablet 6c18ae3a17d947e8b70820e473626cb8 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:17.492488 22917 tablet_service.cc:1511] Processing CreateTablet for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:17.512683 22987 tablet_service.cc:1511] Processing CreateTablet for tablet 09c7979afa3c4fcb83838f29edec3b67 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:17.536149 23063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18ae3a17d947e8b70820e473626cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.536337 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808909fe49ff4730b32151fb7a7b559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.537122 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.538599 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c7979afa3c4fcb83838f29edec3b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.545090 23064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56c90b2fb06459db835049dbf5a060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.545853 22994 tablet_service.cc:1511] Processing CreateTablet for tablet f56c90b2fb06459db835049dbf5a060d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:17.552090 23121 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:17.556098 23137 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.513674 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71491ce9117b44a08c83b84589d0ba9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.556612 23137 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.559337 23137 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:17.555893 22988 tablet_service.cc:1511] Processing CreateTablet for tablet 6c18ae3a17d947e8b70820e473626cb8 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:17.514003 22991 tablet_service.cc:1511] Processing CreateTablet for tablet b8c270d6f9de4942999edb2e7e999066 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:17.565624 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c7979afa3c4fcb83838f29edec3b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.568051 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56c90b2fb06459db835049dbf5a060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.570479 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8b5f462dc44c7d96f09188ade5c13d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:17.576954 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.589159 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 6c18ae3a17d947e8b70820e473626cb8 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:17.604728 23070 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8b5f462dc44c7d96f09188ade5c13d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:17.614567 23121 tablet_bootstrap.cc:654] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.617137 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18ae3a17d947e8b70820e473626cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.621176 23061 tablet_service.cc:1511] Processing CreateTablet for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:17.622392 23061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.634519 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:17.635938 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c270d6f9de4942999edb2e7e999066. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:17.636601 22895 leader_election.cc:343] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.637091 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8b5f462dc44c7d96f09188ade5c13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.638044 22916 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8b5f462dc44c7d96f09188ade5c13d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:17.640866 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8b5f462dc44c7d96f09188ade5c13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.648501 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8b5f462dc44c7d96f09188ade5c13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.656093 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:17.656406 22993 tablet_service.cc:1511] Processing CreateTablet for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:17.658031 23120 tablet_bootstrap.cc:654] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.660993 23068 tablet_service.cc:1511] Processing CreateTablet for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:17.662138 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:17.664206 22896 leader_election.cc:343] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.664652 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:17.665719 23137 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.665954 23065 tablet_service.cc:1511] Processing CreateTablet for tablet adf5adaae5184191bdaff064d051da2a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:17.667131 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18ae3a17d947e8b70820e473626cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.667251 23065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf5adaae5184191bdaff064d051da2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.668599 22996 tablet_service.cc:1511] Processing CreateTablet for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:17.669752 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.672254 22989 tablet_service.cc:1511] Processing CreateTablet for tablet adf5adaae5184191bdaff064d051da2a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:17.673578 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf5adaae5184191bdaff064d051da2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.674821 23122 tablet_bootstrap.cc:492] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:17.675266 23122 ts_tablet_manager.cc:1403] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.272s	user 0.021s	sys 0.025s
I20260709 13:08:17.678247 23122 raft_consensus.cc:359] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.680353 23122 raft_consensus.cc:385] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.687911 23122 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.688087 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.689628 23122 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.692122 23122 ts_tablet_manager.cc:1434] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 13:08:17.693142 23122 tablet_bootstrap.cc:492] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:17.696184 22914 tablet_service.cc:1511] Processing CreateTablet for tablet adf5adaae5184191bdaff064d051da2a (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:17.697412 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf5adaae5184191bdaff064d051da2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.705358 23126 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.705607 23121 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:17.706187 23121 ts_tablet_manager.cc:1403] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.007s
I20260709 13:08:17.705843 23126 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.708140 23126 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:17.710151 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:17.710785 23080 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:17.712172 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:17.710382 23121 raft_consensus.cc:359] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.712831 23121 raft_consensus.cc:385] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.713146 23121 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
W20260709 13:08:17.713616 22972 leader_election.cc:343] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.715533 22970 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:17.720762 23122 tablet_bootstrap.cc:654] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.725253 23126 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.725752 23126 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.726166 23126 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.729516 23066 tablet_service.cc:1511] Processing CreateTablet for tablet f9d4f6ae66214bcb808947c251df9862 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:17.731169 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d4f6ae66214bcb808947c251df9862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.732656 22993 tablet_service.cc:1511] Processing CreateTablet for tablet f9d4f6ae66214bcb808947c251df9862 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:17.733820 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d4f6ae66214bcb808947c251df9862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.734779 22921 tablet_service.cc:1511] Processing CreateTablet for tablet f9d4f6ae66214bcb808947c251df9862 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:17.736406 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d4f6ae66214bcb808947c251df9862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.686723 22919 tablet_service.cc:1511] Processing CreateTablet for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:17.743103 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.763847 22920 tablet_service.cc:1511] Processing CreateTablet for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:17.765592 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.765717 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 2aadad04f3914b6998492885aaba04f6 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:17.766958 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aadad04f3914b6998492885aaba04f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.713858 23121 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.773897 23121 ts_tablet_manager.cc:1434] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.066s	user 0.001s	sys 0.004s
I20260709 13:08:17.775146 23121 tablet_bootstrap.cc:492] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:17.788470 22992 tablet_service.cc:1511] Processing CreateTablet for tablet 2aadad04f3914b6998492885aaba04f6 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:17.789455 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aadad04f3914b6998492885aaba04f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.798097 23061 tablet_service.cc:1511] Processing CreateTablet for tablet 2aadad04f3914b6998492885aaba04f6 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:17.799302 23061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aadad04f3914b6998492885aaba04f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.801329 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 8a155859ea9d41f4a7ccad8246c9c2ba (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:17.802585 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a155859ea9d41f4a7ccad8246c9c2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.808779 22995 tablet_service.cc:1511] Processing CreateTablet for tablet 8a155859ea9d41f4a7ccad8246c9c2ba (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:17.809971 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a155859ea9d41f4a7ccad8246c9c2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.814431 23126 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.825619 23120 tablet_bootstrap.cc:492] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:17.826092 23120 ts_tablet_manager.cc:1403] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.308s	user 0.007s	sys 0.039s
I20260709 13:08:17.828986 23120 raft_consensus.cc:359] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.829648 23120 raft_consensus.cc:385] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.829923 23120 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.830175 23122 tablet_bootstrap.cc:492] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:17.839960 23122 ts_tablet_manager.cc:1403] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.147s	user 0.025s	sys 0.046s
I20260709 13:08:17.840070 23065 tablet_service.cc:1511] Processing CreateTablet for tablet 590119d9a7e74f099c0a28550f4fb3f5 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:17.841333 23065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590119d9a7e74f099c0a28550f4fb3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.841068 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 590119d9a7e74f099c0a28550f4fb3f5 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:17.841413 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 65ec39fe8fb84cf39e1a859ea7b735d1 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:17.842289 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590119d9a7e74f099c0a28550f4fb3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.842655 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec39fe8fb84cf39e1a859ea7b735d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.843294 23122 raft_consensus.cc:359] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.844080 23122 raft_consensus.cc:385] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.844424 23122 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.844681 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:17.845321 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:17.845860 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.831701 23120 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.833571 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:17.836824 23067 tablet_service.cc:1511] Processing CreateTablet for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:17.838042 22912 tablet_service.cc:1511] Processing CreateTablet for tablet 590119d9a7e74f099c0a28550f4fb3f5 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:17.845430 23122 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.857827 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.845888 23080 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.852092 22991 tablet_service.cc:1511] Processing CreateTablet for tablet a934a76e20344681bde221224fb9da0d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:17.845867 22916 tablet_service.cc:1511] Processing CreateTablet for tablet a934a76e20344681bde221224fb9da0d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:17.860435 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a934a76e20344681bde221224fb9da0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.856637 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590119d9a7e74f099c0a28550f4fb3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.864007 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a934a76e20344681bde221224fb9da0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.864661 23121 tablet_bootstrap.cc:654] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.847980 23126 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:17.857641 22972 leader_election.cc:343] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.848456 23068 tablet_service.cc:1511] Processing CreateTablet for tablet 8a155859ea9d41f4a7ccad8246c9c2ba (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:17.859465 23122 ts_tablet_manager.cc:1434] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:08:17.872898 23122 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:17.881538 22994 tablet_service.cc:1511] Processing CreateTablet for tablet 65ec39fe8fb84cf39e1a859ea7b735d1 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:17.882824 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec39fe8fb84cf39e1a859ea7b735d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.885982 23122 tablet_bootstrap.cc:654] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.886816 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a155859ea9d41f4a7ccad8246c9c2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.896835 23069 tablet_service.cc:1511] Processing CreateTablet for tablet 65ec39fe8fb84cf39e1a859ea7b735d1 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:17.900543 23066 tablet_service.cc:1511] Processing CreateTablet for tablet a934a76e20344681bde221224fb9da0d (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:17.898525 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec39fe8fb84cf39e1a859ea7b735d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.836252 22989 tablet_service.cc:1511] Processing CreateTablet for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:17.887305 23080 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:17.924650 22970 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:17.925690 23126 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.926141 23126 raft_consensus.cc:697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:17.926923 23126 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.932370 23068 tablet_service.cc:1511] Processing CreateTablet for tablet 6238b133cf6c4b948cf771c94b860716 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:17.933493 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6238b133cf6c4b948cf771c94b860716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.937115 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 58c95f8b8069443eb62239e90ed53fa1 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:17.938339 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c95f8b8069443eb62239e90ed53fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.963819 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.970669 22913 tablet_service.cc:1511] Processing CreateTablet for tablet 6238b133cf6c4b948cf771c94b860716 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:08:17.971282 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:17.971431 23070 tablet_service.cc:1511] Processing CreateTablet for tablet 58c95f8b8069443eb62239e90ed53fa1 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:17.971947 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6238b133cf6c4b948cf771c94b860716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.971858 23137 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.972640 23121 tablet_bootstrap.cc:492] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:17.972437 23137 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:17.970366 22987 tablet_service.cc:1511] Processing CreateTablet for tablet 6238b133cf6c4b948cf771c94b860716 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:17.973125 23121 ts_tablet_manager.cc:1403] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.198s	user 0.025s	sys 0.044s
I20260709 13:08:17.974443 23137 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:17.975961 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:17.976575 23006 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:17.965443 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a934a76e20344681bde221224fb9da0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.977406 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c95f8b8069443eb62239e90ed53fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.978107 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:17.978896 23137 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.979249 23137 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.979573 23137 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.980876 22826 catalog_manager.cc:5697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.988677 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:17.990221 22895 leader_election.cc:343] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.989156 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6238b133cf6c4b948cf771c94b860716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.992396 22993 tablet_service.cc:1511] Processing CreateTablet for tablet 58c95f8b8069443eb62239e90ed53fa1 (DEFAULT_TABLE table=test-workload [id=872230e774634a39b5e9768204a6ad91]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:17.993572 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c95f8b8069443eb62239e90ed53fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.002699 23120 ts_tablet_manager.cc:1434] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.176s	user 0.010s	sys 0.007s
I20260709 13:08:18.003692 23120 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.008782 23137 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.010291 23120 tablet_bootstrap.cc:654] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.021426 23122 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.028605 23122 ts_tablet_manager.cc:1403] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.012s
I20260709 13:08:18.032858 23122 raft_consensus.cc:359] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.033594 23122 raft_consensus.cc:385] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.033885 23122 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.036088 23122 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.038641 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:18.039198 23006 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.040405 23121 raft_consensus.cc:359] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.041126 23121 raft_consensus.cc:385] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.041409 23121 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.041754 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:18.042215 23121 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:18.043442 22895 leader_election.cc:343] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.044162 23137 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.046772 23006 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:18.048337 23121 ts_tablet_manager.cc:1434] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.002s
I20260709 13:08:18.049286 23121 tablet_bootstrap.cc:492] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.050338 23131 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.050587 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:18.050794 23131 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.056900 23131 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:18.059129 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:18.061306 23046 leader_election.cc:343] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.064965 23137 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.065585 23137 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:18.066674 23137 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.068934 23121 tablet_bootstrap.cc:654] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.070626 23120 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.069504 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:18.071133 23120 ts_tablet_manager.cc:1403] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.004s
W20260709 13:08:18.073345 23045 leader_election.cc:343] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.073726 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:18.074327 23131 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.075778 23120 raft_consensus.cc:359] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.076797 23120 raft_consensus.cc:385] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.077253 23120 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.078363 23120 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.082578 23120 ts_tablet_manager.cc:1434] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:08:18.083463 23120 tablet_bootstrap.cc:492] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.084635 23122 ts_tablet_manager.cc:1434] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.056s	user 0.015s	sys 0.031s
I20260709 13:08:18.085619 23122 tablet_bootstrap.cc:492] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.092723 23120 tablet_bootstrap.cc:654] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.097440 23122 tablet_bootstrap.cc:654] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.096494 22828 catalog_manager.cc:5697] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.112178 23122 tablet_bootstrap.cc:492] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.112759 23122 ts_tablet_manager.cc:1403] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.003s
I20260709 13:08:18.114710 23121 tablet_bootstrap.cc:492] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.115156 23121 ts_tablet_manager.cc:1403] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.013s
I20260709 13:08:18.115520 23122 raft_consensus.cc:359] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.116263 23122 raft_consensus.cc:385] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.116534 23122 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.117405 23122 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.117935 23121 raft_consensus.cc:359] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.118623 23121 raft_consensus.cc:385] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.118896 23121 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.119915 23122 ts_tablet_manager.cc:1434] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:18.119724 23121 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.120858 23122 tablet_bootstrap.cc:492] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.125723 23121 ts_tablet_manager.cc:1434] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:08:18.126672 23121 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.127271 23122 tablet_bootstrap.cc:654] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.133931 23121 tablet_bootstrap.cc:654] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.140152 23122 tablet_bootstrap.cc:492] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.140733 23122 ts_tablet_manager.cc:1403] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:08:18.143784 23121 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.143630 23122 raft_consensus.cc:359] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.144227 23121 ts_tablet_manager.cc:1403] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:08:18.144351 23122 raft_consensus.cc:385] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.144652 23122 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.145499 23122 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.147902 23122 ts_tablet_manager.cc:1434] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:18.148887 23122 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.150233 23120 tablet_bootstrap.cc:492] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.150640 23120 ts_tablet_manager.cc:1403] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.067s	user 0.032s	sys 0.018s
I20260709 13:08:18.153427 23120 raft_consensus.cc:359] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.154111 23120 raft_consensus.cc:385] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.154400 23120 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.147044 23121 raft_consensus.cc:359] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.155047 23122 tablet_bootstrap.cc:654] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.155018 23121 raft_consensus.cc:385] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.155462 23121 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.155218 23120 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.156369 23121 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.159183 23121 ts_tablet_manager.cc:1434] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:18.160151 23153 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.160327 23121 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.160596 23153 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.162634 23153 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.164386 23120 ts_tablet_manager.cc:1434] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:08:18.165011 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:18.166363 22896 leader_election.cc:343] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.166836 23121 tablet_bootstrap.cc:654] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.167604 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.168466 23080 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:18.170344 23120 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.169986 22895 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:18.171526 23153 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.172031 23153 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.172469 23153 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.176991 23120 tablet_bootstrap.cc:654] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.178898 23122 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.179416 23122 ts_tablet_manager.cc:1403] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.010s
I20260709 13:08:18.180967 23153 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.182454 23122 raft_consensus.cc:359] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.183207 23122 raft_consensus.cc:385] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.183538 23122 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.183614 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:18.184516 23122 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:18.184954 22896 leader_election.cc:343] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.186882 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:18.187402 23080 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.190536 23137 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.190984 23137 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.193022 23137 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.194307 23122 ts_tablet_manager.cc:1434] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:18.194710 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.196521 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:18.198035 22895 leader_election.cc:343] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:18.198741 22896 leader_election.cc:343] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.199167 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:18.200392 23137 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.202661 23122 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.205686 23080 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:18.206867 22895 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:18.207868 23137 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.209093 23121 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.209699 23121 ts_tablet_manager.cc:1403] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.024s
I20260709 13:08:18.210071 23153 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.212232 23122 tablet_bootstrap.cc:654] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.213546 23121 raft_consensus.cc:359] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.214483 23121 raft_consensus.cc:385] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.214856 23121 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.215768 23137 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:18.215873 23121 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.218923 23121 ts_tablet_manager.cc:1434] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:18.221925 23153 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.222359 23153 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.224792 23121 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.225124 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:18.225714 23006 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:18.216989 23137 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.233350 23121 tablet_bootstrap.cc:654] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.235976 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.236745 23080 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:18.238083 22895 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:18.248208 23153 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.248839 23153 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.249250 23166 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.249377 23153 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.256528 23153 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.256726 23120 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.252215 23121 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.257256 23120 ts_tablet_manager.cc:1403] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.087s	user 0.039s	sys 0.046s
I20260709 13:08:18.257598 23121 ts_tablet_manager.cc:1403] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.005s
I20260709 13:08:18.257647 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.258409 23080 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:18.259450 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:18.260366 23153 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.260249 23120 raft_consensus.cc:359] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:18.260720 23153 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.260977 23120 raft_consensus.cc:385] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.261076 23153 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.261309 23120 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.261147 23121 raft_consensus.cc:359] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.262164 23121 raft_consensus.cc:385] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.262527 23121 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.263235 23121 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.265195 23121 ts_tablet_manager.cc:1434] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:18.249855 23166 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.266497 23120 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:18.267458 23166 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.253412 23170 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.268311 23170 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.268641 23170 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.270038 23120 ts_tablet_manager.cc:1434] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:18.271838 23122 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.272315 23122 ts_tablet_manager.cc:1403] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.070s	user 0.028s	sys 0.018s
I20260709 13:08:18.272621 23120 tablet_bootstrap.cc:492] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.274724 23121 tablet_bootstrap.cc:492] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.272341 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.276479 23080 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:18.278545 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:18.278646 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:18.279075 23120 tablet_bootstrap.cc:654] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:18.280215 22896 leader_election.cc:343] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.280583 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:18.285214 23166 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.285072 23153 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.285698 23166 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:18.285707 22896 leader_election.cc:343] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.286187 23166 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.285070 23122 raft_consensus.cc:359] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.289095 23122 raft_consensus.cc:385] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.289378 23122 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.290580 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:18.287784 23153 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.291126 23080 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.289388 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:18.297755 23121 tablet_bootstrap.cc:654] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.290161 23122 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.301563 23080 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:18.302670 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:18.302045 22828 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.303407 23153 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.301306 23122 ts_tablet_manager.cc:1434] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:08:18.303885 23153 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:18.304068 23170 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:18.304157 22896 leader_election.cc:343] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.305099 23153 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.305761 23131 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.305270 23122 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.306213 23131 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.308221 23131 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:18.310174 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:18.311465 23045 leader_election.cc:343] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.312846 23122 tablet_bootstrap.cc:654] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.312637 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:18.314471 23046 leader_election.cc:343] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.314760 23166 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.315047 23046 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:18.317085 23166 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.317257 23131 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.317821 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:18.318778 23170 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.318866 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:18.319602 23080 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:18.319872 22896 leader_election.cc:343] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.320727 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:18.321441 23006 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.328586 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:18.329304 23079 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.320741 23120 tablet_bootstrap.cc:492] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.331641 23120 ts_tablet_manager.cc:1403] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.011s
I20260709 13:08:18.334590 23126 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.335196 23126 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.339143 23120 raft_consensus.cc:359] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.332402 23006 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:18.340392 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.344305 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:08:18.344626 22970 leader_election.cc:343] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.341012 23126 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.341780 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:18.345366 23170 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.345808 23120 raft_consensus.cc:385] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.345937 23170 raft_consensus.cc:697] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:18.331982 23131 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.347200 23170 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.347572 23131 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.350178 23131 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:18.351572 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:18.352118 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:18.352927 22931 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
W20260709 13:08:18.353305 23045 leader_election.cc:343] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.354461 23046 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:18.360880 23166 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.361347 23166 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.363255 23166 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:18.346705 22972 leader_election.cc:343] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.363806 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:18.364348 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:18.365160 23006 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:18.365871 23126 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.366407 22896 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:18.367393 23166 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.367808 23166 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.368181 23166 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:18.368275 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.368945 23121 tablet_bootstrap.cc:492] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.369411 23121 ts_tablet_manager.cc:1403] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.095s	user 0.027s	sys 0.006s
I20260709 13:08:18.369629 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:18.370750 22895 leader_election.cc:343] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.363286 23131 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.346534 23120 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.371879 23131 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.372248 23131 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.372325 23120 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.372561 23121 raft_consensus.cc:359] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.373314 23121 raft_consensus.cc:385] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.373611 23121 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.373755 23080 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:18.374578 23120 ts_tablet_manager.cc:1434] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:08:18.374435 23121 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.374740 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:18.375838 23153 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.376309 23153 raft_consensus.cc:697] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:18.377177 23153 consensus_queue.cc:237] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.379572 23166 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.375556 23120 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.381932 23131 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.373160 23079 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:18.384718 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:18.385300 22931 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.386659 23121 ts_tablet_manager.cc:1434] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:08:18.391484 23121 tablet_bootstrap.cc:492] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.390205 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:18.388937 22828 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.393031 23122 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.394193 23006 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.394697 23122 ts_tablet_manager.cc:1403] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.021s
I20260709 13:08:18.395246 23126 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.397243 23122 raft_consensus.cc:359] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.397867 23122 raft_consensus.cc:385] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.398135 23122 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.398785 23122 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.393118 23166 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.393755 23120 tablet_bootstrap.cc:654] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.399085 22828 catalog_manager.cc:5697] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.403142 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:18.403761 23122 ts_tablet_manager.cc:1434] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:18.404620 23122 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
W20260709 13:08:18.404500 22895 leader_election.cc:343] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.407393 23006 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:18.411669 22896 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:18.413018 23122 tablet_bootstrap.cc:654] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.413332 23153 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.414016 23153 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:18.415150 23153 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.417667 23120 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.418144 23120 ts_tablet_manager.cc:1403] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.002s
I20260709 13:08:18.420538 23121 tablet_bootstrap.cc:654] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.421067 23120 raft_consensus.cc:359] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.421797 23120 raft_consensus.cc:385] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.422186 23120 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.423182 23120 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.425010 22931 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:18.426641 23046 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:18.428093 23176 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.430306 23120 ts_tablet_manager.cc:1434] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:18.431413 23120 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.438511 23126 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.438947 23120 tablet_bootstrap.cc:654] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.439121 23126 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:18.444756 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:18.446899 22972 leader_election.cc:343] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.447606 23126 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:18.448761 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.449546 23080 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:18.450929 22970 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:18.452497 23126 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.452972 23126 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.453397 23126 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.466958 23120 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.467576 23120 ts_tablet_manager.cc:1403] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.001s
I20260709 13:08:18.471091 23120 raft_consensus.cc:359] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.471885 23120 raft_consensus.cc:385] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.472195 23120 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.473093 23120 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.477867 22829 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.480439 22829 catalog_manager.cc:5697] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:18.492750 22895 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.504571 23120 ts_tablet_manager.cc:1434] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 13:08:18.515167 23120 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.517534 23176 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:18.549427 23147 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.550100 23147 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.556440 23176 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.565029 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:18.567020 23045 leader_election.cc:343] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.572542 23147 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.572760 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:18.574084 22970 leader_election.cc:343] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.578991 23126 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:18.557195 23131 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:18.598762 23122 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.599284 23122 ts_tablet_manager.cc:1403] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.195s	user 0.059s	sys 0.077s
I20260709 13:08:18.599391 23126 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:18.599924 23120 tablet_bootstrap.cc:654] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.606528 23122 raft_consensus.cc:359] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:18.607295 23122 raft_consensus.cc:385] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.607589 23122 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.608587 23122 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:18.611256 23121 tablet_bootstrap.cc:492] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.611541 23122 ts_tablet_manager.cc:1434] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:08:18.611891 23121 ts_tablet_manager.cc:1403] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.221s	user 0.053s	sys 0.030s
I20260709 13:08:18.612568 23122 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.616212 23121 raft_consensus.cc:359] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.616956 23121 raft_consensus.cc:385] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.617326 23121 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.620731 23121 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.623034 23121 ts_tablet_manager.cc:1434] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:18.625243 23121 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.626061 23120 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.626547 23120 ts_tablet_manager.cc:1403] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.008s
I20260709 13:08:18.628413 23122 tablet_bootstrap.cc:654] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.629515 23120 raft_consensus.cc:359] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.630277 23120 raft_consensus.cc:385] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.630573 23120 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.631645 23121 tablet_bootstrap.cc:654] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.631305 23120 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.633880 23120 ts_tablet_manager.cc:1434] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:18.634850 23120 tablet_bootstrap.cc:492] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.641613 23120 tablet_bootstrap.cc:654] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.644613 23122 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.645222 23122 ts_tablet_manager.cc:1403] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.015s
I20260709 13:08:18.648721 23122 raft_consensus.cc:359] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.649436 23122 raft_consensus.cc:385] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.649734 23122 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.650446 23122 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.651985 23131 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.652477 23131 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.652987 23122 ts_tablet_manager.cc:1434] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:08:18.653934 23122 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.654362 23120 tablet_bootstrap.cc:492] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.654717 23120 ts_tablet_manager.cc:1403] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:08:18.654623 23131 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:18.657497 23120 raft_consensus.cc:359] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.658178 23120 raft_consensus.cc:385] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.658464 23120 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.658721 23121 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.659229 23121 ts_tablet_manager.cc:1403] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.006s
I20260709 13:08:18.659192 23120 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.662983 23120 ts_tablet_manager.cc:1434] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:18.663630 23122 tablet_bootstrap.cc:654] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.663893 23120 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.664480 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:18.664718 23121 raft_consensus.cc:359] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:18.667428 23046 leader_election.cc:343] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.665463 23121 raft_consensus.cc:385] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.670027 23121 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.670902 23120 tablet_bootstrap.cc:654] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.670917 23121 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.673334 23121 ts_tablet_manager.cc:1434] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:08:18.674274 23121 tablet_bootstrap.cc:492] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.674932 23122 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.675412 23122 ts_tablet_manager.cc:1403] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:08:18.678269 23122 raft_consensus.cc:359] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.679003 23122 raft_consensus.cc:385] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.679301 23122 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.680239 23122 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.680768 23126 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.681264 23126 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.681730 23121 tablet_bootstrap.cc:654] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.682642 23122 ts_tablet_manager.cc:1434] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:18.683336 23126 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.683611 23122 tablet_bootstrap.cc:492] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:18.692972 23188 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.693475 23188 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.696108 23188 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.698587 23121 tablet_bootstrap.cc:492] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:18.699102 23121 ts_tablet_manager.cc:1403] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.006s
I20260709 13:08:18.699235 23122 tablet_bootstrap.cc:654] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.686522 23120 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:18.700225 23120 ts_tablet_manager.cc:1403] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.004s
I20260709 13:08:18.702716 23121 raft_consensus.cc:359] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.703414 23121 raft_consensus.cc:385] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.703747 23121 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.703951 23120 raft_consensus.cc:359] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.704768 23120 raft_consensus.cc:385] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.704571 23121 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.705040 23120 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.705811 23120 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.706517 23121 ts_tablet_manager.cc:1434] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:08:18.708987 23120 ts_tablet_manager.cc:1434] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:08:18.709981 23120 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:18.710832 23121 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:18.713996 23122 tablet_bootstrap.cc:492] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:18.714491 23122 ts_tablet_manager.cc:1403] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.011s
I20260709 13:08:18.717269 23121 tablet_bootstrap.cc:654] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.717320 23122 raft_consensus.cc:359] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.718274 23122 raft_consensus.cc:385] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.718560 23122 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.717269 23120 tablet_bootstrap.cc:654] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.719235 23122 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.720136 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:18.720801 22931 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:18.722543 23006 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.953147 23202 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.953975 23202 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.956240 23200 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.956732 23200 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:18.958029 23201 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:18.958711 23200 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:18.959918 23201 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.960167 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.960637 23207 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:18.963164 23079 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.965067 23202 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.965107 23200 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:18.976531 23005 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.977850 23207 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.978336 23207 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.980496 23207 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:18.980973 23212 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.981345 23075 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.981469 23212 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:18.984267 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:18.984416 23202 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.984863 22931 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:18.985950 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:18.986624 23074 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:18.988464 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:18.990839 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:18.991819 23202 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.991101 23212 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:18.992173 23202 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.992545 23202 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.993284 23212 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.997753 23212 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.998216 23212 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.002985 23202 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.003291 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.004670 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.005384 23006 raft_consensus.cc:2393] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:08:19.008725 22896 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.006990 23206 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:08:19.039729 23201 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.076263 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.083729 23170 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.085493 23188 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.086095 23188 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.089304 23185 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.089969 23188 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.089879 23185 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.090757 23188 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.091215 23188 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.037469 23204 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:08:19.067099 23205 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:08:19.087330 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.092963 23203 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:08:19.104707 23004 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:19.106115 23185 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.106405 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:19.074961 23201 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.106981 23004 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.108718 23216 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.110134 23202 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.112118 23188 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.115558 23201 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.109211 23216 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.117923 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:19.119761 22895 leader_election.cc:343] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.120062 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.120288 23216 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.112933 23215 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:19.123024 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:19.127689 22896 leader_election.cc:343] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.128122 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.128873 23201 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.131273 23209 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:19.132045 23209 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.129974 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:19.132942 23078 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.122668 23200 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:08:19.144650 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.145314 23080 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:19.160734 23078 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:19.148022 22895 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:19.157173 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.166162 23122 ts_tablet_manager.cc:1434] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.451s	user 0.078s	sys 0.146s
I20260709 13:08:19.166975 23122 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:19.153462 23212 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.173105 23004 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:19.174151 23168 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.174639 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:19.174683 23168 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.175954 23168 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.178525 23207 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.179015 23207 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:19.179303 23212 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.182224 22972 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.183108 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.190538 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.185731 23188 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.184154 23207 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.196182 23120 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:19.196633 23120 ts_tablet_manager.cc:1403] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.487s	user 0.020s	sys 0.022s
I20260709 13:08:19.196699 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.197041 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:19.198297 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.198443 23077 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.198794 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.199467 23080 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:19.187261 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.205329 22924 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.195405 23188 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.207932 23188 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.202481 23078 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:19.216610 23120 raft_consensus.cc:359] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.217332 23120 raft_consensus.cc:385] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.217597 23120 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.222654 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.225612 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.225600 23120 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.235616 22970 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.246760 23120 ts_tablet_manager.cc:1434] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 13:08:19.247782 23120 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:19.241899 23185 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.239861 23188 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.257907 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.262748 23185 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.263068 23185 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.263365 23185 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.270076 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.273893 23209 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.275633 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.278144 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.278723 22926 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.278298 22828 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.279542 23126 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:19.275486 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:19.298422 23077 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
W20260709 13:08:19.298990 23223 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:08:19.301187 23122 tablet_bootstrap.cc:654] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.291704 22970 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.303475 23126 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.306260 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.304754 23185 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.306670 23006 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.309319 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:19.310359 23001 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.314767 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.309365 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.316799 23188 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:19.319052 22972 leader_election.cc:343] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.319249 23185 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.316005 22931 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.320773 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:08:19.322005 22972 leader_election.cc:343] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.315579 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.330888 23001 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:19.336755 22972 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.312543 22970 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.343462 23120 tablet_bootstrap.cc:654] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.344884 23185 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.345090 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.345795 23002 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:19.347494 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:19.347980 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.348184 23080 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.350492 23209 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.350149 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:19.351016 23209 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:19.351740 23215 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:19.352382 23215 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:19.351899 23209 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.352770 23215 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.346732 23188 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.353129 22931 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:19.358656 22972 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:19.359915 23122 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:19.360404 23122 ts_tablet_manager.cc:1403] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.008s
I20260709 13:08:19.362772 23147 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.363526 23147 raft_consensus.cc:697] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:19.364288 23168 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:19.365965 23121 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:19.366348 23121 ts_tablet_manager.cc:1403] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.656s	user 0.011s	sys 0.008s
I20260709 13:08:19.354378 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:19.364441 23147 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.369131 22930 raft_consensus.cc:2393] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:19.360363 23188 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:19.378857 23188 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } }
I20260709 13:08:19.383826 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:19.384856 23077 raft_consensus.cc:2393] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:19.386129 23121 raft_consensus.cc:359] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.387005 23121 raft_consensus.cc:385] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.387336 23121 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.389249 23121 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.391736 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.392208 23121 ts_tablet_manager.cc:1434] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:08:19.392689 23005 raft_consensus.cc:2393] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:19.393199 23121 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:19.394218 23045 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:19.394487 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.402690 23078 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.417676 23045 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:19.418864 23131 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:19.422065 23080 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:19.422937 23215 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.415642 23209 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.425104 23215 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.426215 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.426558 23168 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.427248 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:19.428023 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:19.431535 22896 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.433017 23168 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.433756 23122 raft_consensus.cc:359] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.434115 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:19.434401 23122 raft_consensus.cc:385] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.434650 23122 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.428597 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:19.435976 23131 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:19.430684 23215 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:08:19.437687 23122 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.437433 23147 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.440088 23147 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:19.440843 23147 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.442128 23122 ts_tablet_manager.cc:1434] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.002s
I20260709 13:08:19.446647 23121 tablet_bootstrap.cc:654] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.448038 23122 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:19.455896 22926 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:19.462730 23120 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:19.463716 23120 ts_tablet_manager.cc:1403] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.216s	user 0.027s	sys 0.024s
I20260709 13:08:19.469707 23078 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:19.470813 23122 tablet_bootstrap.cc:654] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.474395 23120 raft_consensus.cc:359] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.474943 23120 raft_consensus.cc:385] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.475165 23120 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.479038 23120 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.480906 23120 ts_tablet_manager.cc:1434] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:08:19.481787 23120 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:19.481874 23121 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:19.482332 23121 ts_tablet_manager.cc:1403] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.015s
I20260709 13:08:19.489198 23120 tablet_bootstrap.cc:654] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.496582 23121 raft_consensus.cc:359] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.497262 23121 raft_consensus.cc:385] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.497496 23121 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.498097 23121 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.499687 23121 ts_tablet_manager.cc:1434] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:08:19.500514 23121 tablet_bootstrap.cc:492] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:19.505900 23122 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:19.506330 23122 ts_tablet_manager.cc:1403] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.015s
I20260709 13:08:19.509043 23122 raft_consensus.cc:359] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.509529 23122 raft_consensus.cc:385] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.509778 23122 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.510424 23122 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.512426 23122 ts_tablet_manager.cc:1434] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:19.513285 23122 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:19.517125 23120 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:19.517511 23120 ts_tablet_manager.cc:1403] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.016s
I20260709 13:08:19.518378 23121 tablet_bootstrap.cc:654] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.518452 22829 catalog_manager.cc:5697] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.519594 23120 raft_consensus.cc:359] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.520243 23120 raft_consensus.cc:385] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.520509 23120 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.521277 23120 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.521513 22829 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.523643 23120 ts_tablet_manager.cc:1434] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:19.524542 23120 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:19.529300 23122 tablet_bootstrap.cc:654] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.530385 23120 tablet_bootstrap.cc:654] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.535142 23121 tablet_bootstrap.cc:492] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:19.535538 23121 ts_tablet_manager.cc:1403] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.012s
I20260709 13:08:19.538053 23121 raft_consensus.cc:359] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.538702 23121 raft_consensus.cc:385] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.538969 23121 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.539865 23122 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:19.539757 23121 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.540557 23122 ts_tablet_manager.cc:1403] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.007s
I20260709 13:08:19.542460 23121 ts_tablet_manager.cc:1434] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:08:19.543325 23121 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:19.542604 22826 catalog_manager.cc:5697] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.544337 23122 raft_consensus.cc:359] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.545277 23122 raft_consensus.cc:385] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.545693 23122 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.546698 23122 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.548586 23122 ts_tablet_manager.cc:1434] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:08:19.548959 23120 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:19.549404 23120 ts_tablet_manager.cc:1403] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.017s
I20260709 13:08:19.550622 23121 tablet_bootstrap.cc:654] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.549410 23122 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:19.552080 23120 raft_consensus.cc:359] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.552752 23120 raft_consensus.cc:385] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.553051 23120 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.554068 23120 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.556353 23120 ts_tablet_manager.cc:1434] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:08:19.557186 23120 tablet_bootstrap.cc:492] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:19.558046 23122 tablet_bootstrap.cc:654] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.563697 23120 tablet_bootstrap.cc:654] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.563022 22828 catalog_manager.cc:5697] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.567847 23121 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:19.568132 23121 ts_tablet_manager.cc:1403] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.011s
I20260709 13:08:19.572027 23121 raft_consensus.cc:359] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.572600 23121 raft_consensus.cc:385] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.572855 23121 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.576136 23121 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.578284 23121 ts_tablet_manager.cc:1434] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:08:19.579070 23121 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:19.584951 23121 tablet_bootstrap.cc:654] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.604290 23122 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:19.604861 23122 ts_tablet_manager.cc:1403] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.026s
I20260709 13:08:19.608387 23122 raft_consensus.cc:359] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.609227 23122 raft_consensus.cc:385] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.609551 23122 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.609679 22829 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.610517 23122 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.615979 23122 ts_tablet_manager.cc:1434] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:08:19.616828 23122 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:19.628777 23121 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:19.629230 23121 ts_tablet_manager.cc:1403] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.023s
I20260709 13:08:19.630491 23122 tablet_bootstrap.cc:654] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.633427 23121 raft_consensus.cc:359] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.634145 23121 raft_consensus.cc:385] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.634372 23121 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.634929 23121 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.635047 23120 tablet_bootstrap.cc:492] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:19.635874 23147 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.635995 23120 ts_tablet_manager.cc:1403] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.022s
I20260709 13:08:19.636307 23147 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.636997 23121 ts_tablet_manager.cc:1434] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:08:19.638151 23121 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:19.638278 23147 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.638482 23120 raft_consensus.cc:359] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.639132 23120 raft_consensus.cc:385] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.639395 23120 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.639801 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.640395 23078 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:19.640108 23120 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.641759 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.643095 23120 ts_tablet_manager.cc:1434] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:19.643111 23147 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.643787 23147 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.644186 23147 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.644973 23121 tablet_bootstrap.cc:654] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.644976 23122 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:19.645577 23122 ts_tablet_manager.cc:1403] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.005s
I20260709 13:08:19.645485 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.646174 22930 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:19.648340 23122 raft_consensus.cc:359] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.648989 23122 raft_consensus.cc:385] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.649271 23122 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.649996 23122 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.651376 23121 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:19.651887 23121 ts_tablet_manager.cc:1403] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:08:19.651916 23122 ts_tablet_manager.cc:1434] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:19.653035 23122 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:19.654275 23147 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.654709 23121 raft_consensus.cc:359] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.655439 23121 raft_consensus.cc:385] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.655774 23120 tablet_bootstrap.cc:492] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:19.655788 23121 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.656811 23215 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.657234 23215 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.658552 23122 tablet_bootstrap.cc:654] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.659325 23215 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.660921 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.661641 23120 tablet_bootstrap.cc:654] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.661492 23002 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:19.663087 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.663962 23215 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.664227 23126 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.664462 23215 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.664675 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.664722 23126 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.665064 23215 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.665400 22930 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:19.667227 23126 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.669454 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:19.670713 22970 leader_election.cc:343] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.671434 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:19.675285 22972 leader_election.cc:343] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.671352 23121 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.675885 22972 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.677228 23126 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.678622 23121 ts_tablet_manager.cc:1434] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:08:19.679754 23121 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:19.675585 23215 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.681727 23120 tablet_bootstrap.cc:492] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:19.682135 23120 ts_tablet_manager.cc:1403] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 13:08:19.684204 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:19.684744 23002 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.685925 23120 raft_consensus.cc:359] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.686569 23120 raft_consensus.cc:385] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.686827 23120 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.687542 23120 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.688004 23168 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:19.689977 23120 ts_tablet_manager.cc:1434] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:19.690858 23120 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:19.695094 23002 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:19.703016 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.704214 23184 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.704826 23184 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:19.705900 23184 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.684751 23215 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.696477 23120 tablet_bootstrap.cc:654] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.696383 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.712352 22930 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.701709 23121 tablet_bootstrap.cc:654] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.721573 23203 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:19.722335 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001eea80 after lost signal to thread 21778
W20260709 13:08:19.738499 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001abc80 after lost signal to thread 22863
W20260709 13:08:19.739919 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7860 after lost signal to thread 22955
W20260709 13:08:19.744381 23101 debug-util.cc:398] Leaking SignalData structure 0x7b0800204fa0 after lost signal to thread 23030
I20260709 13:08:19.745350 22930 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:19.748862 23147 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.748925 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.750279 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:08:19.750847 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001bfdc0 after lost signal to thread 23104
I20260709 13:08:19.756300 23078 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.748472 23121 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:19.760151 23121 ts_tablet_manager.cc:1403] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.000s
I20260709 13:08:19.762938 23078 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:19.763794 22930 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.764969 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.766973 23147 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.768201 23147 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:19.770130 22930 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:19.779599 23121 raft_consensus.cc:359] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.782401 23121 raft_consensus.cc:385] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.782956 23121 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.781011 23147 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.785665 23121 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.791359 23215 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:19.805042 23126 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.805579 23126 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.806777 23131 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:19.807785 23126 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.809442 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.809894 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.810101 22930 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:19.810515 23080 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:19.813721 22972 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:19.814743 23188 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.815112 23188 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.815430 23188 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.816572 23120 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:19.816994 23120 ts_tablet_manager.cc:1403] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.126s	user 0.031s	sys 0.044s
I20260709 13:08:19.819551 23122 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:19.819993 23122 ts_tablet_manager.cc:1403] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.167s	user 0.053s	sys 0.066s
I20260709 13:08:19.822486 23122 raft_consensus.cc:359] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.822853 23121 ts_tablet_manager.cc:1434] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.003s
I20260709 13:08:19.823009 23122 raft_consensus.cc:385] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.823340 23122 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.824102 23121 tablet_bootstrap.cc:492] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:19.824050 23122 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.826947 23122 ts_tablet_manager.cc:1434] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:19.821295 22828 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.832005 23147 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:19.833132 23188 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.836131 23202 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.836575 23202 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.838537 23202 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.840191 23122 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:19.848114 23131 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.848739 23131 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.854560 23120 raft_consensus.cc:359] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.855751 23120 raft_consensus.cc:385] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.856204 23120 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.863021 23120 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.853874 23131 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:19.870977 23120 ts_tablet_manager.cc:1434] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:08:19.880656 23120 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:19.872543 23203 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.873291 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.879571 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:19.885848 22896 leader_election.cc:343] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.873308 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.883985 23203 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.886857 23080 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:19.888226 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:19.889321 23046 leader_election.cc:343] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:19.890007 23045 leader_election.cc:343] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.890430 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:08:19.891453 22895 leader_election.cc:343] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.892230 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:19.888365 23203 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.894263 23131 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.896706 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.897348 22930 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.905478 23126 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:19.909078 22930 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:19.909417 23126 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:19.910569 22972 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:19.911688 23126 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.912631 23126 raft_consensus.cc:697] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:19.913498 23126 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.918678 23185 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.919193 23185 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.919909 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:19.920465 23077 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.921187 22895 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.921324 23185 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.929450 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.930207 23202 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.930536 23073 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:19.929728 22829 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.936547 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:19.937354 23073 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:19.939090 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:19.939548 22970 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:19.939857 22895 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.940652 23147 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.940594 23202 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:19.941076 23147 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.941425 23147 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.941493 23202 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:19.945725 22972 leader_election.cc:343] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.945875 23203 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.946280 23203 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:19.933102 23188 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.947078 23188 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.947605 23188 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.948335 23147 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.950353 23188 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.947093 23203 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:19.954457 23147 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:19.955440 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:19.955874 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:19.956760 22972 leader_election.cc:343] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.957214 23077 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:19.958467 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:19.959216 23075 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.961815 23121 tablet_bootstrap.cc:654] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:19.963207 22972 leader_election.cc:343] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.966913 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:19.968779 22970 leader_election.cc:343] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.970151 22970 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:19.970861 23147 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.972710 23202 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.980412 23122 tablet_bootstrap.cc:654] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.979542 23120 tablet_bootstrap.cc:654] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.989637 23203 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.993324 23188 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.001376 23168 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.001811 23168 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.030263 23168 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.032611 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:20.035429 22896 leader_election.cc:343] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.039232 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.040077 23080 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:20.064459 22828 catalog_manager.cc:5697] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.067309 23121 tablet_bootstrap.cc:492] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:20.069751 23075 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:20.072072 23121 ts_tablet_manager.cc:1403] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.248s	user 0.015s	sys 0.003s
I20260709 13:08:20.074786 23122 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:20.074740 23121 raft_consensus.cc:359] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.075284 23122 ts_tablet_manager.cc:1403] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.235s	user 0.028s	sys 0.056s
I20260709 13:08:20.077735 22895 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:20.077803 23188 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.077270 23147 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.079550 23122 raft_consensus.cc:359] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.080819 23122 raft_consensus.cc:385] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.081075 23122 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.082013 23202 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.081689 23122 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.082468 23202 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.084977 23273 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.085157 23122 ts_tablet_manager.cc:1434] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:20.085429 23273 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.086282 23122 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:20.086934 22970 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:20.088150 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:20.090718 23273 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.084955 23202 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.091224 23188 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.091747 23188 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:20.092558 23188 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.095512 23002 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.110276 23131 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.110437 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.112542 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:20.075515 23121 raft_consensus.cc:385] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.119969 23121 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.120618 23121 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.122656 23121 ts_tablet_manager.cc:1434] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:08:20.125233 23121 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:20.128679 23120 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:20.127810 22827 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.129149 23120 ts_tablet_manager.cc:1403] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.249s	user 0.007s	sys 0.004s
I20260709 13:08:20.131136 23120 raft_consensus.cc:359] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.131863 23122 tablet_bootstrap.cc:654] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.131599 23120 raft_consensus.cc:385] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.134546 23120 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.135308 23120 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.136555 23121 tablet_bootstrap.cc:654] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.137213 23120 ts_tablet_manager.cc:1434] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:20.138048 23120 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:20.139159 23202 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.145110 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:20.146421 22896 leader_election.cc:343] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.148761 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:20.149003 23121 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:20.149313 23075 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.149447 23121 ts_tablet_manager.cc:1403] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.002s
I20260709 13:08:20.152273 23122 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:20.152711 23122 ts_tablet_manager.cc:1403] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.001s
I20260709 13:08:20.152410 23121 raft_consensus.cc:359] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.153398 23121 raft_consensus.cc:385] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.153685 23121 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.154469 23121 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.156658 23121 ts_tablet_manager.cc:1434] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:20.156988 23075 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:20.157892 23202 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.159128 22895 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:20.160691 23202 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.161513 23202 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:20.163638 23202 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.164635 23122 raft_consensus.cc:359] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.168809 23122 raft_consensus.cc:385] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.168708 23209 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.169176 23122 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.170009 23122 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.172195 23122 ts_tablet_manager.cc:1434] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:08:20.173065 23122 tablet_bootstrap.cc:492] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:20.176416 23147 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.179224 23120 tablet_bootstrap.cc:654] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.183766 23121 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:20.186589 23147 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.188860 23122 tablet_bootstrap.cc:654] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.212462 23209 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.213012 23209 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.217756 23203 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.218389 23203 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.218801 23209 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:20.222262 23120 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:20.223510 23120 ts_tablet_manager.cc:1403] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.009s
I20260709 13:08:20.223941 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:20.224766 22931 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:20.226141 23120 raft_consensus.cc:359] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.226845 23120 raft_consensus.cc:385] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.226696 23046 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:20.226423 22829 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.227245 23120 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.241209 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.241853 23002 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:20.241206 23120 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.234777 23202 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.244697 23120 ts_tablet_manager.cc:1434] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:08:20.244493 23215 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.245038 23202 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.245193 23215 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.245679 23215 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.246630 23202 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.247500 22896 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:20.235670 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.232048 23203 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.249379 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.249603 23203 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.249933 23203 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:20.250989 23045 leader_election.cc:343] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:20.251302 22896 leader_election.cc:343] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.250533 23203 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.264248 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:20.278582 22895 leader_election.cc:343] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.279623 22895 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:20.281775 23272 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.303421 23120 tablet_bootstrap.cc:492] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
W20260709 13:08:20.349207 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 70688.3us
I20260709 13:08:20.351615 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.358234 23121 tablet_bootstrap.cc:654] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.369354 23188 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.372324 23122 tablet_bootstrap.cc:492] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:20.372762 23122 ts_tablet_manager.cc:1403] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.200s	user 0.023s	sys 0.028s
W20260709 13:08:20.368111 23284 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:08:20.378073 23203 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.380250 23188 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.380283 23122 raft_consensus.cc:359] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.383910 23122 raft_consensus.cc:385] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.384342 23122 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.385247 23122 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.388098 23122 ts_tablet_manager.cc:1434] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:08:20.400413 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:20.401033 23002 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.400550 23203 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.406890 23122 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:20.413841 23002 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:20.421540 23188 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.422094 23188 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.424134 23188 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.425561 22896 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:08:20.427487 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:20.427639 23203 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.427809 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.428217 23203 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:20.428650 23080 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:20.412489 23215 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.429342 23203 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.432137 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:20.432685 22926 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.436444 23121 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:20.436873 23121 ts_tablet_manager.cc:1403] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.253s	user 0.019s	sys 0.016s
I20260709 13:08:20.439517 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:20.438824 23188 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.445972 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:20.447146 22926 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
W20260709 13:08:20.447371 23045 leader_election.cc:343] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.448385 23121 raft_consensus.cc:359] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.448645 23046 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:20.449497 23121 raft_consensus.cc:385] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.449736 23121 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
W20260709 13:08:20.439258 22895 leader_election.cc:343] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.452503 23209 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.440613 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:20.452991 23209 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:20.453742 23209 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.444130 23215 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:20.455835 23131 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.456844 23131 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.458895 23120 tablet_bootstrap.cc:654] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.459291 23131 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:20.458983 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:20.450244 23121 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.464056 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.465294 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:20.466188 23002 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:20.466341 22931 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
W20260709 13:08:20.456223 22895 leader_election.cc:343] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.468326 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:20.472404 23121 ts_tablet_manager.cc:1434] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:08:20.473549 23121 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:20.474948 23122 tablet_bootstrap.cc:654] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.467531 23188 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.477536 23131 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.482692 23131 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.483009 23131 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.490767 23168 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.505582 22829 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.491364 23168 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.513399 23168 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.515432 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.516310 23121 tablet_bootstrap.cc:654] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.537443 23188 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.533576 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.538802 23075 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:20.540017 22895 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:20.541088 23203 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.542227 23120 tablet_bootstrap.cc:492] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:20.542658 23120 ts_tablet_manager.cc:1403] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.239s	user 0.014s	sys 0.023s
I20260709 13:08:20.549574 23203 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.549682 23131 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.551946 23131 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:20.589807 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:20.593227 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:20.594524 22924 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.596380 23121 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:20.597661 23121 ts_tablet_manager.cc:1403] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.002s
I20260709 13:08:20.596235 23002 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.601621 22827 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.604542 23122 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:20.605324 23122 ts_tablet_manager.cc:1403] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.199s	user 0.028s	sys 0.014s
I20260709 13:08:20.607609 23121 raft_consensus.cc:359] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.608917 23121 raft_consensus.cc:385] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.610072 23121 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.617754 23122 raft_consensus.cc:359] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.618628 23122 raft_consensus.cc:385] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.618491 22924 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:20.618958 23122 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.619796 23122 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.620307 23188 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.624532 23122 ts_tablet_manager.cc:1434] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:08:20.624497 23046 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:20.626505 23122 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:20.627447 23131 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.628134 23131 raft_consensus.cc:697] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:20.627942 23121 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.630111 23131 consensus_queue.cc:237] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.637100 23209 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.637589 23209 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.641220 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:20.641881 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:20.643185 23046 leader_election.cc:343] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.644011 23209 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:08:20.644222 23045 leader_election.cc:343] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.644886 23045 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:20.645830 23121 ts_tablet_manager.cc:1434] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.002s
I20260709 13:08:20.646345 23209 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.647588 23120 raft_consensus.cc:359] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.649132 23122 tablet_bootstrap.cc:654] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.649091 23120 raft_consensus.cc:385] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.649823 23120 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.651015 23121 tablet_bootstrap.cc:492] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:20.661589 23121 tablet_bootstrap.cc:654] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.667035 22827 catalog_manager.cc:5697] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.676648 23002 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:20.685803 23185 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.695007 23203 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.717865 23120 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.749017 23122 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:20.749532 23122 ts_tablet_manager.cc:1403] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.028s
I20260709 13:08:20.750116 23121 tablet_bootstrap.cc:492] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:20.744055 23120 ts_tablet_manager.cc:1434] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.201s	user 0.007s	sys 0.004s
I20260709 13:08:20.750612 23121 ts_tablet_manager.cc:1403] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.013s
I20260709 13:08:20.754207 23122 raft_consensus.cc:359] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.755429 23122 raft_consensus.cc:385] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.755748 23122 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.756614 23122 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.757664 23272 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.760515 23120 tablet_bootstrap.cc:492] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:20.765574 23121 raft_consensus.cc:359] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.766296 23121 raft_consensus.cc:385] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.766610 23121 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.767453 23121 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.770335 23121 ts_tablet_manager.cc:1434] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:08:20.771478 23121 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:20.778013 23121 tablet_bootstrap.cc:654] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.783027 23122 ts_tablet_manager.cc:1434] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 13:08:20.786796 23122 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:20.797144 23122 tablet_bootstrap.cc:654] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.799506 23120 tablet_bootstrap.cc:654] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.801723 23121 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:20.802241 23121 ts_tablet_manager.cc:1403] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 13:08:20.805022 23121 raft_consensus.cc:359] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.807461 23121 raft_consensus.cc:385] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.807575 23202 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.808100 23121 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.808276 23202 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.808887 23121 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.811172 23121 ts_tablet_manager.cc:1434] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:20.812831 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.813508 23006 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:20.812826 23121 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:20.817307 22896 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:20.818750 23168 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.819279 23168 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.819785 23168 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.824579 23121 tablet_bootstrap.cc:654] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.826506 23122 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:20.827098 23122 ts_tablet_manager.cc:1403] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.001s
I20260709 13:08:20.829771 23122 raft_consensus.cc:359] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.830463 23122 raft_consensus.cc:385] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.830719 23122 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.831322 23122 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.832023 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.833846 23122 ts_tablet_manager.cc:1434] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 13:08:20.836822 22895 leader_election.cc:343] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.838438 23122 tablet_bootstrap.cc:492] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:20.842602 23202 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.849027 23122 tablet_bootstrap.cc:654] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.849251 23168 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.852350 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:20.852959 23006 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.853048 23188 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:20.853855 23188 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.857272 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:20.858007 22924 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:20.859730 22972 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:20.860746 23185 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:20.861157 23185 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:20.861583 23185 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.866747 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:08:20.868698 22895 leader_election.cc:343] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.869236 23188 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.870170 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.871281 23080 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 2: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:20.876507 23209 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.876574 23185 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.877370 23209 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.878911 23131 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.880012 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:20.884145 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.885138 23002 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:20.879642 23131 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.888365 23131 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:20.889302 22924 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:20.890959 22972 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:20.890910 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:20.892225 23188 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:20.892725 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:20.893085 23188 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:20.894426 23188 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.895888 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:20.905308 23184 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.905424 23185 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.912215 23184 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.912806 23184 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.916486 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:20.917676 23078 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 2: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:08:20.919430 23045 leader_election.cc:343] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:20.920715 23046 leader_election.cc:343] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.927217 23203 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.927942 23203 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.931738 23203 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:20.934185 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:20.942937 22896 leader_election.cc:343] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:20.949683 23045 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.935781 23209 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:08:20.965926 22895 consensus_peers.cc:597] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.968259 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:20.969277 23080 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:20.977870 22895 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:20.980070 23203 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.980620 23203 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.981106 23203 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.995965 23209 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.000815 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:21.004055 23046 leader_election.cc:343] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.004777 23046 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.006597 23209 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.011534 23202 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.020970 23122 tablet_bootstrap.cc:492] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.021481 23122 ts_tablet_manager.cc:1403] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.183s	user 0.035s	sys 0.045s
I20260709 13:08:21.024492 23122 raft_consensus.cc:359] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.028406 23122 raft_consensus.cc:385] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.029044 23122 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.030369 23122 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.029611 22827 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.037078 23122 ts_tablet_manager.cc:1434] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:21.038574 23122 tablet_bootstrap.cc:492] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:21.046471 23168 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.050158 23122 tablet_bootstrap.cc:654] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.062604 23006 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:21.064538 22896 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:21.066186 23122 tablet_bootstrap.cc:492] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.066524 23168 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.067309 23168 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:08:21.068233 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 64231us
I20260709 13:08:21.068353 23168 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:20.991245 23184 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.073549 23121 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.073843 23184 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:21.074090 23121 ts_tablet_manager.cc:1403] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.262s	user 0.048s	sys 0.060s
I20260709 13:08:21.075922 23122 ts_tablet_manager.cc:1403] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.003s
I20260709 13:08:21.081101 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:21.081804 22931 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.083305 23122 raft_consensus.cc:359] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.084434 23122 raft_consensus.cc:385] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.084750 23122 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.085421 23122 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.087819 23122 ts_tablet_manager.cc:1434] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:21.077836 23121 raft_consensus.cc:359] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.087685 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:21.089933 23121 raft_consensus.cc:385] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.090049 23006 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.090297 23121 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.090996 22931 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:21.091054 23121 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.093501 23121 ts_tablet_manager.cc:1434] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:08:21.094733 23121 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.095837 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:21.097180 23209 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.097738 23209 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:21.098654 23209 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.100396 23122 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:21.108451 23120 tablet_bootstrap.cc:492] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.108945 23120 ts_tablet_manager.cc:1403] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.349s	user 0.060s	sys 0.142s
I20260709 13:08:21.103786 23203 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.110489 23184 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.112694 23184 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.115459 23006 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:21.116890 23121 tablet_bootstrap.cc:654] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.116293 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.119234 23209 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.124394 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.125072 22931 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:21.117686 23184 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:21.134884 23203 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.139040 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:21.139806 23120 raft_consensus.cc:359] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.140511 23120 raft_consensus.cc:385] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.140712 23120 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.127804 23209 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:21.142449 22896 leader_election.cc:343] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.143960 23209 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:21.145625 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.145341 23120 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.146500 23002 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:21.147773 23120 ts_tablet_manager.cc:1434] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:08:21.149394 23120 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.151346 22827 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.156096 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:21.156944 23075 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.158030 23046 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.161962 23122 tablet_bootstrap.cc:654] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.162541 23120 tablet_bootstrap.cc:654] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.166652 23121 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.167093 23121 ts_tablet_manager.cc:1403] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.005s
I20260709 13:08:21.167906 23317 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:21.168330 23317 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.168678 23317 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.169413 23121 raft_consensus.cc:359] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.170064 23121 raft_consensus.cc:385] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.170318 23121 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.170357 22826 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.166924 23075 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:21.172282 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.172456 23121 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.178161 22895 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.180968 23168 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.184137 23168 raft_consensus.cc:697] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:21.185173 23168 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.185645 23184 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.195808 23121 ts_tablet_manager.cc:1434] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.004s
I20260709 13:08:21.204087 23121 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.203783 23317 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.206836 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:21.207460 23317 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:21.219003 23122 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.218935 23120 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.207708 23046 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.219488 23122 ts_tablet_manager.cc:1403] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.009s
I20260709 13:08:21.211757 23168 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.221197 23120 ts_tablet_manager.cc:1403] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.015s
I20260709 13:08:21.227864 23121 tablet_bootstrap.cc:654] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.228150 23120 raft_consensus.cc:359] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.228854 23120 raft_consensus.cc:385] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.229118 23120 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.229493 23122 raft_consensus.cc:359] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.230158 23122 raft_consensus.cc:385] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.229822 23120 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.230428 23122 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.223857 23317 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.231950 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:21.232527 22931 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.233773 23120 ts_tablet_manager.cc:1434] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:08:21.239056 23122 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.224071 23168 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.243113 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.243856 23120 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.243853 23075 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:21.245090 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.247015 23122 ts_tablet_manager.cc:1434] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
W20260709 13:08:21.246920 22896 leader_election.cc:343] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.251909 22895 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.253206 23203 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.253696 23203 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.254156 23203 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.248620 23168 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.259047 22827 catalog_manager.cc:5697] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.261296 23202 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.261722 23202 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.264846 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.265389 23002 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:21.268567 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:21.270190 23272 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.270375 23184 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.270723 23272 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.271241 23272 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.282859 23122 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:21.288403 23202 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.289759 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.292765 22931 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:08:21.290575 23075 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:21.302702 23122 tablet_bootstrap.cc:654] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.309922 23046 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.310792 23184 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:21.311587 23184 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:21.312520 23184 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.312963 23272 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.315842 23203 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.316469 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:21.317034 23006 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.317790 23203 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.316937 23272 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.318476 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:21.320847 22896 leader_election.cc:343] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.322353 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:21.322917 23078 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.323035 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:21.323735 23075 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.323372 23120 tablet_bootstrap.cc:654] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.332998 23078 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:21.333957 23006 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:21.334182 22895 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.335203 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:21.335934 23317 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.336089 23272 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.339164 23272 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:21.340935 23121 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.340010 23272 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.341413 23121 ts_tablet_manager.cc:1403] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.031s
I20260709 13:08:21.336038 23203 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.342773 23203 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:21.343854 23203 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.348433 23121 raft_consensus.cc:359] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.349308 23121 raft_consensus.cc:385] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.349642 23121 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.351964 23188 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.354432 23121 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.352458 23188 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.356734 23188 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.357795 23075 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:21.361145 23122 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.360975 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.361577 23122 ts_tablet_manager.cc:1403] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.008s
I20260709 13:08:21.361646 22931 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:21.363819 22972 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:21.364835 23188 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.365171 23188 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.365527 23188 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.366223 23121 ts_tablet_manager.cc:1434] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:08:21.367877 23121 tablet_bootstrap.cc:492] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.382719 23121 tablet_bootstrap.cc:654] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.383940 23120 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.384392 23120 ts_tablet_manager.cc:1403] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.150s	user 0.006s	sys 0.008s
I20260709 13:08:21.387036 23122 raft_consensus.cc:359] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.387784 23122 raft_consensus.cc:385] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.388051 23122 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.387043 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.388751 23188 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.389178 23075 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:21.391754 23122 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.393792 23122 ts_tablet_manager.cc:1434] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:08:21.394740 23122 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:21.397607 22931 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:21.398571 23188 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.399858 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:21.400421 23075 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.400831 23122 tablet_bootstrap.cc:654] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.401628 22826 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.409215 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:21.408666 22826 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.409857 22931 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.417364 23120 raft_consensus.cc:359] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.418347 23120 raft_consensus.cc:385] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.418880 23120 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.418257 23188 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:21.420115 23273 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:21.420548 23273 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:21.420979 23120 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.421530 23273 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.423077 23273 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.427958 23120 ts_tablet_manager.cc:1434] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:08:21.435344 23075 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:21.436806 22970 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:21.438408 22931 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:21.446099 23273 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.447136 23273 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:21.449426 23120 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.449486 22828 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 3, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.449422 23273 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.457661 23121 tablet_bootstrap.cc:492] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.458073 23121 ts_tablet_manager.cc:1403] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.017s
I20260709 13:08:21.464490 23120 tablet_bootstrap.cc:654] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.467581 23121 raft_consensus.cc:359] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.468389 23121 raft_consensus.cc:385] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.468649 23121 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.469280 23121 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.471328 23121 ts_tablet_manager.cc:1434] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
W20260709 13:08:21.472102 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:21.472383 23121 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.485555 23121 tablet_bootstrap.cc:654] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.486413 23126 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.489481 23126 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.490875 23122 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.491331 23122 ts_tablet_manager.cc:1403] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.031s
I20260709 13:08:21.491482 23126 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.492986 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.494082 23075 raft_consensus.cc:2393] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:21.493889 23122 raft_consensus.cc:359] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.494521 23122 raft_consensus.cc:385] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.494839 23122 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.492138 22828 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.498934 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.502079 23120 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.502535 23120 ts_tablet_manager.cc:1403] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.001s
I20260709 13:08:21.503715 22972 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:21.505069 23120 raft_consensus.cc:359] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.505601 23126 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.505750 23120 raft_consensus.cc:385] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.506170 23120 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.506806 23120 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.508852 23120 ts_tablet_manager.cc:1434] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:21.509004 23121 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.509410 23121 ts_tablet_manager.cc:1403] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.005s
I20260709 13:08:21.509905 23120 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.511832 23121 raft_consensus.cc:359] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.512565 23121 raft_consensus.cc:385] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.512821 23121 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.513456 23121 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.515628 23121 ts_tablet_manager.cc:1434] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:08:21.516574 23120 tablet_bootstrap.cc:654] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.495414 23122 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.518141 23121 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.523526 23122 ts_tablet_manager.cc:1434] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:08:21.525004 23126 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.529737 23203 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.531061 23121 tablet_bootstrap.cc:654] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.535233 23122 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:21.545231 23122 tablet_bootstrap.cc:654] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.554720 23120 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.555106 23120 ts_tablet_manager.cc:1403] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.008s
I20260709 13:08:21.556967 23122 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.557437 23122 ts_tablet_manager.cc:1403] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:08:21.557361 23120 raft_consensus.cc:359] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.558292 23120 raft_consensus.cc:385] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.558588 23120 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.559204 23120 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.561175 23121 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.561928 23121 ts_tablet_manager.cc:1403] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.004s
I20260709 13:08:21.561398 23122 raft_consensus.cc:359] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.561261 23120 ts_tablet_manager.cc:1434] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:21.562520 23122 raft_consensus.cc:385] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.563783 23122 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.564898 23120 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.564862 23122 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.566860 23122 ts_tablet_manager.cc:1434] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:08:21.566710 23121 raft_consensus.cc:359] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.567435 23121 raft_consensus.cc:385] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.567724 23121 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.568564 23121 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.575071 23203 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.575817 23203 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.576171 23122 tablet_bootstrap.cc:492] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:21.583050 23120 tablet_bootstrap.cc:654] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.583213 23202 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.583627 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.586215 23121 ts_tablet_manager.cc:1434] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:08:21.587427 23203 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:21.587536 22896 leader_election.cc:343] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.588680 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:21.591045 22895 leader_election.cc:343] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.591467 22895 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:21.592635 23324 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.594024 23121 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.608963 23122 tablet_bootstrap.cc:654] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.613111 23121 tablet_bootstrap.cc:654] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.618652 23184 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.619233 23184 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.623005 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.624082 23184 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:21.625878 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:21.627841 23045 leader_election.cc:343] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:21.628708 23046 leader_election.cc:343] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.629182 23046 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.630333 23317 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.634577 23317 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.644840 23120 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.646421 23120 ts_tablet_manager.cc:1403] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.006s
I20260709 13:08:21.649003 23120 raft_consensus.cc:359] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.649739 23120 raft_consensus.cc:385] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.650007 23120 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.650754 23120 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.654448 23120 ts_tablet_manager.cc:1434] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:21.655306 23120 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.676627 23203 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.679250 23120 tablet_bootstrap.cc:654] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.680640 23203 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.681105 23203 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.682230 23317 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.683588 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:21.684911 22896 leader_election.cc:343] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.685824 23203 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.687273 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:21.689420 22895 leader_election.cc:343] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.689992 22895 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:21.691345 23203 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.695914 23120 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.696331 23120 ts_tablet_manager.cc:1403] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.002s
I20260709 13:08:21.698918 23120 raft_consensus.cc:359] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.699525 23120 raft_consensus.cc:385] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.704541 23120 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.705853 23120 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.709311 23120 ts_tablet_manager.cc:1434] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:08:21.710311 23120 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.718920 23120 tablet_bootstrap.cc:654] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.721629 23203 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.722116 23203 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.733963 23202 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.761224 23126 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.761835 23126 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.768607 23202 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.769979 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.770783 22924 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:21.772173 22972 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:21.773128 23273 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.773571 23273 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.773949 23273 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.789731 23126 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.791919 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.792721 23078 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:21.786433 23273 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.797170 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.798184 23001 raft_consensus.cc:2393] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:21.803972 23120 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.804368 23120 ts_tablet_manager.cc:1403] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.028s
I20260709 13:08:21.806375 23126 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.812278 23291 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.806938 23126 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.812723 23291 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.814961 23291 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:21.815413 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.816705 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.817581 23203 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.817601 23188 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.818336 23188 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.820446 23188 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:21.821650 23046 leader_election.cc:343] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.823123 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:21.823693 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.825096 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.825423 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.824554 23078 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
W20260709 13:08:21.826785 23045 leader_election.cc:343] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.823694 22931 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:21.827226 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.827980 23291 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.810359 23120 raft_consensus.cc:359] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.829692 23120 raft_consensus.cc:385] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.830001 23120 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.830556 22895 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:21.831569 23120 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.832006 23272 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.833724 23272 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.834177 23272 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.834547 23120 ts_tablet_manager.cc:1434] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:08:21.834585 23272 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.836757 22931 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:21.838043 23120 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.838946 23312 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.839423 23312 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.841532 23312 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.843075 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:21.844508 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:21.844626 22896 leader_election.cc:343] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.846257 23291 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:21.848857 22895 leader_election.cc:343] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.849426 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:21.850785 23312 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.836731 23273 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.855052 23120 tablet_bootstrap.cc:654] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.856015 23324 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.856885 22972 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:21.860679 23006 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.867194 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:21.867983 23273 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.868359 23273 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.868695 23273 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.849401 23126 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.880322 23121 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.880945 23121 ts_tablet_manager.cc:1403] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.294s	user 0.046s	sys 0.054s
I20260709 13:08:21.883494 23121 raft_consensus.cc:359] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.884140 23121 raft_consensus.cc:385] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.884395 23121 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.887105 23122 tablet_bootstrap.cc:492] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.887106 23121 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.889605 23121 ts_tablet_manager.cc:1434] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:21.890658 23121 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.887921 23122 ts_tablet_manager.cc:1403] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.312s	user 0.121s	sys 0.138s
I20260709 13:08:21.896385 23122 raft_consensus.cc:359] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.897051 23122 raft_consensus.cc:385] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.898265 23122 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.898936 23122 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.902541 23122 ts_tablet_manager.cc:1434] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:21.901293 23121 tablet_bootstrap.cc:654] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.903235 23120 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:21.904060 23120 ts_tablet_manager.cc:1403] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.018s
I20260709 13:08:21.905707 23122 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
W20260709 13:08:21.911434 22970 leader_election.cc:343] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.910145 23312 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:21.912104 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:21.912740 23006 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:21.913290 23006 pending_rounds.cc:85] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 1
I20260709 13:08:21.913290 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:21.913658 23006 pending_rounds.cc:107] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:21.914028 23006 raft_consensus.cc:2889] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.914244 23272 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.912770 23073 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.918116 22930 raft_consensus.cc:2393] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:21.919217 23120 raft_consensus.cc:359] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.919905 23120 raft_consensus.cc:385] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.920154 23120 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.920899 23120 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.922034 22970 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:21.922107 23291 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:21.925534 23073 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:21.926118 23120 ts_tablet_manager.cc:1434] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:08:21.902946 23273 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.928763 23120 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:21.928670 23185 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.930111 22970 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:21.931223 23291 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.931418 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:21.931813 23291 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.934508 22930 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.935814 23291 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:21.936285 23273 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.936740 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:21.938184 23046 leader_election.cc:343] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.942490 23121 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:21.943075 23121 ts_tablet_manager.cc:1403] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.006s
I20260709 13:08:21.944455 22930 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:21.945547 23185 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.946033 23185 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:21.946060 23121 raft_consensus.cc:359] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.947793 23121 raft_consensus.cc:385] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.946461 22972 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:21.948243 23121 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.948679 23185 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.948956 23121 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.951259 23121 ts_tablet_manager.cc:1434] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:08:21.951746 23188 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.952623 23272 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:21.953032 23121 tablet_bootstrap.cc:492] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:21.956274 23122 tablet_bootstrap.cc:654] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.956728 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:21.961768 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:21.962549 23073 raft_consensus.cc:2393] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:21.966624 22895 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:21.967864 23324 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.970026 23122 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:21.970431 23122 ts_tablet_manager.cc:1403] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.001s
I20260709 13:08:21.972865 23122 raft_consensus.cc:359] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.973488 23122 raft_consensus.cc:385] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.973735 23122 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.974429 23122 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:21.980098 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:21.980998 23073 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.982585 23122 ts_tablet_manager.cc:1434] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:08:21.983548 23122 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:21.984114 23120 tablet_bootstrap.cc:654] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.988526 23188 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:22.001540 23073 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:21.989746 23188 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.012387 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.014007 23121 tablet_bootstrap.cc:654] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.018170 23000 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.027117 23185 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:22.040526 23291 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.041569 23291 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.044396 23122 tablet_bootstrap.cc:654] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.049803 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.050372 23073 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.043514 23291 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:22.059226 23126 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.060168 23126 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.062052 23126 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.064312 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.064916 22924 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:22.066077 22972 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:22.067251 23185 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.067620 23185 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.068019 23185 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.084821 23324 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.085500 23324 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.088826 23120 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:22.088750 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.089287 23120 ts_tablet_manager.cc:1403] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.015s
I20260709 13:08:22.093847 23185 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.096696 23324 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:22.095366 22896 leader_election.cc:343] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.097811 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.105623 23324 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.104509 23120 raft_consensus.cc:359] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.106807 23120 raft_consensus.cc:385] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.107182 23120 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.109093 23120 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.106125 23324 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:22.111495 22895 leader_election.cc:343] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.123771 23120 ts_tablet_manager.cc:1434] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.002s
I20260709 13:08:22.113260 23357 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:08:22.127734 22895 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:22.128626 23312 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:22.115222 23045 leader_election.cc:343] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.132866 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:22.134371 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.135150 23184 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.137804 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.138612 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:22.139276 22924 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.139806 23324 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.141075 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:22.143761 23121 tablet_bootstrap.cc:492] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:22.144158 23121 ts_tablet_manager.cc:1403] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.191s	user 0.008s	sys 0.012s
I20260709 13:08:22.144726 23357 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.152197 23120 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:22.154408 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.154613 23357 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.155041 23080 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
W20260709 13:08:22.149194 22970 leader_election.cc:343] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.158874 22924 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:22.160080 22972 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:22.160203 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:22.161260 23273 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.161671 23203 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.161755 23273 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:22.162132 23203 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.162550 23203 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:22.163100 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 70421.8us
I20260709 13:08:22.162667 23273 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.167697 23120 tablet_bootstrap.cc:654] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.167531 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.173276 23357 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.173336 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:08:22.175339 22970 leader_election.cc:343] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.175805 23122 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:22.176239 23122 ts_tablet_manager.cc:1403] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.193s	user 0.034s	sys 0.052s
I20260709 13:08:22.176873 23121 raft_consensus.cc:359] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.177572 23121 raft_consensus.cc:385] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.177798 23121 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.179175 23121 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.176448 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.182372 23075 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:22.178476 23291 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.179133 22826 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.184020 23122 raft_consensus.cc:359] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.187904 23122 raft_consensus.cc:385] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.185443 22826 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.188228 23122 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.190094 23122 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.185918 22970 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:22.192389 23122 ts_tablet_manager.cc:1434] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
W20260709 13:08:22.186097 22896 leader_election.cc:343] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.193434 23122 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:22.171617 23185 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.206267 23121 ts_tablet_manager.cc:1434] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:08:22.208597 23121 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:22.197358 23357 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.216997 23367 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.217464 23367 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:22.234124 23366 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:22.225517 23357 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.254354 23357 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.198136 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.256441 22924 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:22.270288 23122 tablet_bootstrap.cc:654] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.273342 23121 tablet_bootstrap.cc:654] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.273469 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.277930 23367 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.282325 23203 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.282354 23209 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.283854 23209 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.285143 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:22.285926 23209 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:08:22.286296 22896 leader_election.cc:343] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.287520 23203 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.288970 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:22.289181 23120 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:22.282742 23357 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.289438 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.289705 23120 ts_tablet_manager.cc:1403] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.000s
I20260709 13:08:22.291105 23357 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.292474 23120 raft_consensus.cc:359] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.293126 23120 raft_consensus.cc:385] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.293416 23120 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.294077 23120 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.296317 23120 ts_tablet_manager.cc:1434] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:22.297211 23120 tablet_bootstrap.cc:492] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
W20260709 13:08:22.298954 23046 leader_election.cc:343] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.289568 23073 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.304674 23120 tablet_bootstrap.cc:654] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.306619 23121 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:22.307091 23121 ts_tablet_manager.cc:1403] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.027s
I20260709 13:08:22.308768 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:22.309268 23077 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.309823 23120 tablet_bootstrap.cc:492] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:22.310263 23120 ts_tablet_manager.cc:1403] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:08:22.309484 23121 raft_consensus.cc:359] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.310694 23121 raft_consensus.cc:385] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.311026 23121 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.311715 23121 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.314782 23121 ts_tablet_manager.cc:1434] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:08:22.314739 22970 leader_election.cc:343] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.315814 23121 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:22.316587 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:22.317137 22930 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.320490 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.320452 23077 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:22.318673 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.322319 23073 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:22.324486 23120 raft_consensus.cc:359] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.325204 23120 raft_consensus.cc:385] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.325268 22970 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:22.325592 23120 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.326042 23367 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.326478 23367 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:22.323277 22924 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:22.326395 23120 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:22.326994 23045 leader_election.cc:343] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.327310 23367 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.336230 23045 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:22.339236 23317 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.331907 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:22.333880 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:22.348907 23273 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.349139 22930 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:22.349388 23273 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.349501 23324 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.346491 23357 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.346541 22827 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.349826 23273 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.352337 23121 tablet_bootstrap.cc:654] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.352161 23357 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.350453 23324 raft_consensus.cc:697] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:22.356635 23357 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.356983 23324 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.361284 23120 ts_tablet_manager.cc:1434] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:08:22.362545 23120 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:22.366789 23122 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:22.372269 23122 ts_tablet_manager.cc:1403] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.006s
I20260709 13:08:22.377519 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.378707 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.382547 23122 raft_consensus.cc:359] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.383172 23122 raft_consensus.cc:385] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.383421 23122 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.384168 23273 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:22.380266 22970 leader_election.cc:343] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.385780 22972 leader_election.cc:343] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.388135 22972 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:22.386739 23122 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.391455 23209 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.391710 23367 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.392443 23122 ts_tablet_manager.cc:1434] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:08:22.392141 23209 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.393546 23122 tablet_bootstrap.cc:492] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:22.395257 23273 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.395417 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:22.396041 22930 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.387099 23120 tablet_bootstrap.cc:654] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.401535 23203 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.401700 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.402009 23203 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.403812 23367 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.402309 22924 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:22.419035 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.420553 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:22.421187 23073 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:22.421250 22896 leader_election.cc:343] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.423420 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.399492 22828 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:22.427172 22895 leader_election.cc:343] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.426786 23203 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.427918 22895 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:22.429808 23357 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.430624 23203 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.431067 23209 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:22.431463 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:22.437819 23121 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:22.438208 23121 ts_tablet_manager.cc:1403] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.011s
I20260709 13:08:22.439703 23131 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.440048 23073 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:22.440423 23131 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.440857 23131 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.441222 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.441790 23003 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:22.443352 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:22.447734 23122 tablet_bootstrap.cc:654] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.448388 22828 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.450908 22930 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:22.453315 23367 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.454051 23367 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:22.456190 23367 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.460350 23131 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.463970 23120 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:22.464548 23120 ts_tablet_manager.cc:1403] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.020s
I20260709 13:08:22.468241 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:22.467796 23131 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:22.468933 22930 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.469772 23120 raft_consensus.cc:359] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.470417 23120 raft_consensus.cc:385] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.470686 23120 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.471459 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:22.472143 23003 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.472030 23120 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.475868 23120 ts_tablet_manager.cc:1434] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:22.476805 23120 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:22.482704 23121 raft_consensus.cc:359] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.483366 23121 raft_consensus.cc:385] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.483633 23121 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.484365 23121 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.486339 23121 ts_tablet_manager.cc:1434] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.005s
I20260709 13:08:22.487282 23121 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:22.488962 23003 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:22.492008 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:22.492879 23209 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.492978 22930 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:22.493355 23209 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:22.493850 23188 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.494375 23120 tablet_bootstrap.cc:654] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.494195 23209 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.495635 23122 tablet_bootstrap.cc:492] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:22.496151 23122 ts_tablet_manager.cc:1403] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.010s
I20260709 13:08:22.513751 23122 raft_consensus.cc:359] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.514405 23122 raft_consensus.cc:385] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.514652 23122 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.515298 23122 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.517234 23122 ts_tablet_manager.cc:1434] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:08:22.518061 23122 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:22.522351 22827 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.525820 23272 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.532974 23272 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.536448 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.537061 23075 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:22.542090 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:22.547595 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.549417 23324 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.549906 23324 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.550328 23324 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:22.552376 22896 leader_election.cc:343] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.542160 23272 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.570399 23324 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.574062 23121 tablet_bootstrap.cc:654] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.584249 23367 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.584736 23367 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.586719 23367 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.603893 23122 tablet_bootstrap.cc:654] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.657718 23120 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:22.658354 23120 ts_tablet_manager.cc:1403] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.182s	user 0.026s	sys 0.039s
I20260709 13:08:22.661875 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.663915 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:22.673003 22896 leader_election.cc:343] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.683344 22970 leader_election.cc:343] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.683887 23073 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.690186 23273 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.701988 23273 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.627614 23324 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.734464 23120 raft_consensus.cc:359] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:22.732044 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 75629.2us
I20260709 13:08:22.735216 23120 raft_consensus.cc:385] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.739889 23120 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.743837 23120 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.753067 23120 ts_tablet_manager.cc:1434] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 13:08:22.752919 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:22.763995 23073 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:22.772315 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:22.773284 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.773955 22930 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:22.777983 23120 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:22.785774 23122 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:22.786213 23122 ts_tablet_manager.cc:1403] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.268s	user 0.005s	sys 0.029s
I20260709 13:08:22.794634 22972 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:22.795835 23367 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.796185 23367 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.796523 23367 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.799549 22828 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.815573 23122 raft_consensus.cc:359] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.817073 23122 raft_consensus.cc:385] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.817358 23122 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.817826 23122 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.822769 23121 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:22.823200 23121 ts_tablet_manager.cc:1403] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.336s	user 0.023s	sys 0.027s
I20260709 13:08:22.825493 23122 ts_tablet_manager.cc:1434] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 13:08:22.826501 23121 raft_consensus.cc:359] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.827284 23121 raft_consensus.cc:385] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.827495 23121 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.828855 23185 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.831063 23121 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.836483 23121 ts_tablet_manager.cc:1434] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:22.837498 23121 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:22.844660 23185 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.847260 23073 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:22.850960 23120 tablet_bootstrap.cc:654] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.852643 23367 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.854727 23367 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.861498 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:22.862094 22931 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.863075 23121 tablet_bootstrap.cc:654] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.864248 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:08:22.865576 22970 leader_election.cc:343] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.867707 23122 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:22.871534 23367 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.878937 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:22.879958 23389 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.880427 23389 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:22.880843 22931 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:22.881225 23389 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.884438 22972 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:22.885231 23185 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.885718 23185 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:22.886574 23185 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.911684 23357 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.887285 23367 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.915129 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:22.919991 23367 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:22.920871 23077 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:22.921994 23392 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.923902 23392 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:22.943728 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:22.946444 23392 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:22.947902 23389 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.950209 22827 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.952637 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:22.953356 22972 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:22.961165 23120 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:22.961825 23120 ts_tablet_manager.cc:1403] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.021s
W20260709 13:08:22.966069 23045 leader_election.cc:343] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.979691 23398 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:22.983994 23357 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.999764 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:23.001021 23046 leader_election.cc:343] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.001478 23046 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:23.002483 23392 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.008035 23122 tablet_bootstrap.cc:654] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.009652 23392 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.012037 23185 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.016672 23121 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:23.017194 23121 ts_tablet_manager.cc:1403] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.180s	user 0.028s	sys 0.035s
I20260709 13:08:23.024116 23120 raft_consensus.cc:359] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.024801 23120 raft_consensus.cc:385] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.026046 23131 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.025064 23120 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.029174 23120 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.068142 23120 ts_tablet_manager.cc:1434] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.001s
I20260709 13:08:23.068261 23121 raft_consensus.cc:359] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.069052 23120 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.069132 23357 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.069099 23121 raft_consensus.cc:385] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.074313 23121 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.075309 23121 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.082392 23389 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.083958 23389 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.084501 23389 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.084815 23357 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.086685 23389 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.088783 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.089345 23121 ts_tablet_manager.cc:1434] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.000s
I20260709 13:08:23.090366 23121 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
W20260709 13:08:23.094237 22895 leader_election.cc:343] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.109881 23401 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.110462 23401 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.115691 22827 catalog_manager.cc:5697] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.149693 23121 tablet_bootstrap.cc:654] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.201000 23120 tablet_bootstrap.cc:654] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:23.196034 23032 tablet.cc:2406] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:23.208846 23122 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:23.209296 23122 ts_tablet_manager.cc:1403] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.346s	user 0.013s	sys 0.022s
I20260709 13:08:23.198732 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.216297 23006 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:23.218426 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:23.219607 23390 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.219986 23390 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.220319 23390 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.228076 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:23.233712 22972 leader_election.cc:343] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.237712 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:23.240903 22970 leader_election.cc:343] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.241425 22970 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:23.243077 23401 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.243688 23367 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.244414 23122 raft_consensus.cc:359] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.245105 23122 raft_consensus.cc:385] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.245457 23122 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.246260 23122 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.248799 23122 ts_tablet_manager.cc:1434] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.003s
I20260709 13:08:23.249778 23122 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:23.257649 23390 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.264739 23122 tablet_bootstrap.cc:654] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.265192 23390 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.266639 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:23.262248 23121 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:23.260664 23120 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:23.267215 23000 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.267593 23120 ts_tablet_manager.cc:1403] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.012s
I20260709 13:08:23.270090 23120 raft_consensus.cc:359] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.270744 23120 raft_consensus.cc:385] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.271060 23120 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.266335 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:23.272826 23121 ts_tablet_manager.cc:1403] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.183s	user 0.013s	sys 0.031s
W20260709 13:08:23.273312 22895 leader_election.cc:343] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.271806 23120 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.274622 23120 ts_tablet_manager.cc:1434] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:23.278111 23120 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.279063 23000 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:23.276888 23121 raft_consensus.cc:359] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.279620 23121 raft_consensus.cc:385] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.280040 23121 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.280292 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:23.282683 23388 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.283242 23388 raft_consensus.cc:697] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:23.282635 23121 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.284158 23388 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.287063 23121 ts_tablet_manager.cc:1434] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:08:23.291245 23122 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:23.293571 23122 ts_tablet_manager.cc:1403] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.007s
I20260709 13:08:23.296497 23122 raft_consensus.cc:359] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.297361 23122 raft_consensus.cc:385] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.300665 23122 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.301563 23122 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.303910 23122 ts_tablet_manager.cc:1434] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:08:23.300415 23121 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:23.310873 23121 tablet_bootstrap.cc:654] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.312599 22829 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.300813 23120 tablet_bootstrap.cc:654] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.312125 23122 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:23.320775 23367 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.321430 23122 tablet_bootstrap.cc:654] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.321321 23367 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.325592 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:23.326373 22930 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:23.329315 23073 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.332727 22972 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:23.333557 23357 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.333863 23121 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:23.333987 23122 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:23.334322 23121 ts_tablet_manager.cc:1403] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.005s
I20260709 13:08:23.334455 23122 ts_tablet_manager.cc:1403] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:08:23.333892 23357 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.335608 23357 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.337724 23122 raft_consensus.cc:359] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.338423 23122 raft_consensus.cc:385] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.338763 23122 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.339138 23367 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.339605 23120 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:23.340139 23120 ts_tablet_manager.cc:1403] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.007s
I20260709 13:08:23.338445 23121 raft_consensus.cc:359] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.340637 23121 raft_consensus.cc:385] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.340968 23121 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.341665 23121 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.339542 23122 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.343425 23120 raft_consensus.cc:359] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.345348 23122 ts_tablet_manager.cc:1434] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:23.345285 23120 raft_consensus.cc:385] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.345832 23120 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.346585 23120 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.347397 23121 ts_tablet_manager.cc:1434] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:08:23.348129 23120 ts_tablet_manager.cc:1434] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:23.348985 23120 tablet_bootstrap.cc:492] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.346586 23122 tablet_bootstrap.cc:492] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
W20260709 13:08:23.353896 22896 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:23.354569 23120 tablet_bootstrap.cc:654] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.361022 23122 tablet_bootstrap.cc:654] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.368675 23389 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.372954 23367 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.376791 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.404088 23077 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:23.352051 23357 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.408684 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:23.409433 22930 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.409754 23357 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.410517 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:23.411075 23077 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.412636 23121 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:23.416999 22930 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:23.418202 22972 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:23.419623 23121 tablet_bootstrap.cc:654] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.420804 23131 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.421396 23131 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.422227 23401 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.422807 23401 raft_consensus.cc:697] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:23.423779 23401 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.424923 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:23.425719 22927 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:23.427206 23046 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:23.433817 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.430490 23392 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.430227 23131 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:23.437243 23392 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.439847 23392 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:23.438992 23045 leader_election.cc:343] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.450887 23389 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.451521 23389 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.452662 23120 tablet_bootstrap.cc:492] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:23.453114 23120 ts_tablet_manager.cc:1403] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.012s
I20260709 13:08:23.454432 23389 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.456804 23120 raft_consensus.cc:359] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.457017 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.457453 23120 raft_consensus.cc:385] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.457749 23120 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
W20260709 13:08:23.459342 22896 leader_election.cc:343] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.463778 23120 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.463373 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.469264 23073 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:23.471158 23392 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.472160 22895 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:23.473865 23389 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.474326 23389 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.474727 23389 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.506731 23121 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:23.507207 23121 ts_tablet_manager.cc:1403] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.008s
I20260709 13:08:23.510385 23122 tablet_bootstrap.cc:492] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:23.510838 23122 ts_tablet_manager.cc:1403] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.164s	user 0.036s	sys 0.035s
I20260709 13:08:23.511116 23401 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.511741 23120 ts_tablet_manager.cc:1434] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.058s	user 0.016s	sys 0.024s
I20260709 13:08:23.512072 23209 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.512737 23120 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.512535 23209 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.514501 23392 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:23.514501 23209 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:23.515761 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.516999 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:23.519434 23045 leader_election.cc:343] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.519704 23121 raft_consensus.cc:359] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:23.520121 23045 leader_election.cc:343] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.520416 23121 raft_consensus.cc:385] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.520788 23121 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.521446 23121 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.516901 23122 raft_consensus.cc:359] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.525401 23122 raft_consensus.cc:385] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.525779 23122 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.526666 23122 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.525651 23077 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:23.520062 23389 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.530066 23120 tablet_bootstrap.cc:654] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.531322 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:23.532641 22896 leader_election.cc:343] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.534332 23122 ts_tablet_manager.cc:1434] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:08:23.535331 23122 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:23.539937 23388 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.540232 23121 ts_tablet_manager.cc:1434] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:08:23.540402 23388 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.541157 23121 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:23.542703 23388 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.542972 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.543399 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:23.544246 22896 leader_election.cc:343] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:23.545456 23046 leader_election.cc:343] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.545843 23046 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:23.546890 23392 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.548617 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.550032 23389 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.550462 23120 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
W20260709 13:08:23.550874 22895 leader_election.cc:343] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.551316 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:23.550890 23120 ts_tablet_manager.cc:1403] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.008s
I20260709 13:08:23.552237 23389 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.553594 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:23.554143 23077 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.554492 23120 raft_consensus.cc:359] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.554414 22829 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.557116 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:23.557689 22926 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.555146 23120 raft_consensus.cc:385] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.559849 23120 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.560693 23077 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:23.560582 23120 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.563112 23120 ts_tablet_manager.cc:1434] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:08:23.563899 23121 tablet_bootstrap.cc:654] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.564031 23120 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.566038 22895 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:23.566886 23122 tablet_bootstrap.cc:654] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.567090 23401 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.567175 23389 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.567749 23389 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:23.567605 23401 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.568684 23389 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.569799 23401 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.572067 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.573241 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:23.574702 22972 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:23.575508 23120 tablet_bootstrap.cc:654] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.575893 23401 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.603875 23120 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:23.604866 23120 ts_tablet_manager.cc:1403] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.003s
I20260709 13:08:23.608073 23122 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:23.608510 23122 ts_tablet_manager.cc:1403] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.073s	user 0.006s	sys 0.018s
I20260709 13:08:23.608942 23121 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:23.608421 23120 raft_consensus.cc:359] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.609331 23121 ts_tablet_manager.cc:1403] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.007s
I20260709 13:08:23.609557 23120 raft_consensus.cc:385] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.609937 23120 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.614275 23121 raft_consensus.cc:359] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.614913 23121 raft_consensus.cc:385] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.615357 23121 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.615077 23122 raft_consensus.cc:359] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.615970 23122 raft_consensus.cc:385] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.616304 23122 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.616073 23121 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.617167 23122 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.619685 23120 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.620065 22926 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:23.623051 23046 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:23.623427 23120 ts_tablet_manager.cc:1434] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:08:23.623992 23392 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.624454 23392 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:23.625236 23392 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.628842 23120 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.628896 23122 ts_tablet_manager.cc:1434] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:08:23.630014 23122 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:23.632665 23121 ts_tablet_manager.cc:1434] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:08:23.633548 23121 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:23.635952 23120 tablet_bootstrap.cc:654] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.645232 23121 tablet_bootstrap.cc:654] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.645617 23122 tablet_bootstrap.cc:654] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.652347 23122 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:23.652866 23122 ts_tablet_manager.cc:1403] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:08:23.657648 22827 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.660905 23122 raft_consensus.cc:359] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.661478 23122 raft_consensus.cc:385] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.661697 23122 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.662534 23122 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.664351 23122 ts_tablet_manager.cc:1434] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:08:23.665282 23122 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:23.664358 23120 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:23.668818 23120 ts_tablet_manager.cc:1403] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.001s
I20260709 13:08:23.675146 23120 raft_consensus.cc:359] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.675824 23120 raft_consensus.cc:385] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.676086 23120 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.680837 23120 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.683213 23077 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.690917 23120 ts_tablet_manager.cc:1434] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:08:23.692266 23120 tablet_bootstrap.cc:492] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.696465 23388 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.698201 23122 tablet_bootstrap.cc:654] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.714720 23121 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:23.715199 23121 ts_tablet_manager.cc:1403] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.013s
I20260709 13:08:23.715339 23273 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.716041 23273 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.718096 23121 raft_consensus.cc:359] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.718823 23121 raft_consensus.cc:385] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.719103 23121 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.719808 23121 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.720978 23273 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.722275 23120 tablet_bootstrap.cc:654] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.723209 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:23.725533 23121 ts_tablet_manager.cc:1434] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:23.726511 23121 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
W20260709 13:08:23.726325 22972 leader_election.cc:343] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.729017 23122 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:23.729058 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.729970 23079 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:23.731729 22970 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:23.729513 23122 ts_tablet_manager.cc:1403] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.003s
I20260709 13:08:23.735075 23273 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.735085 23121 tablet_bootstrap.cc:654] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.735558 23273 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.741755 23273 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.735795 22827 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.742612 23122 raft_consensus.cc:359] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.744896 23122 raft_consensus.cc:385] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.745198 23122 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.745893 23122 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.748490 23122 ts_tablet_manager.cc:1434] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:08:23.750824 23120 tablet_bootstrap.cc:492] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:23.751472 23120 ts_tablet_manager.cc:1403] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.002s
I20260709 13:08:23.755705 23388 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.756203 23388 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.757695 23120 raft_consensus.cc:359] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.758684 23120 raft_consensus.cc:385] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.759059 23120 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.760295 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.760344 23120 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.760913 23273 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.762029 23000 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:23.762840 23120 ts_tablet_manager.cc:1434] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:23.766355 23122 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:23.771472 23006 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.771138 23120 tablet_bootstrap.cc:492] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:23.779695 23388 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.786902 23273 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.788753 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:23.794986 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.799964 22895 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:23.789625 23079 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.799415 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:23.802520 23390 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.805701 23272 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.822413 23122 tablet_bootstrap.cc:654] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.823937 23079 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:23.847877 23272 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.879892 23272 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.886929 23388 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.887463 23388 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.897265 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:23.898310 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:23.900127 22895 leader_election.cc:343] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:23.939895 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 75603.1us
I20260709 13:08:23.940655 23390 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:23.971766 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 71675.6us
W20260709 13:08:23.972489 22895 leader_election.cc:343] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.978811 22970 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:23.981925 23120 tablet_bootstrap.cc:654] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.975965 23272 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.988955 23185 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.989843 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.992506 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:23.978591 23357 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.993360 23357 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:23.994298 22926 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:23.996675 23357 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:23.976683 23388 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.005141 23121 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:24.006491 23121 ts_tablet_manager.cc:1403] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.280s	user 0.018s	sys 0.023s
W20260709 13:08:24.010748 22896 leader_election.cc:343] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.012285 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:08:24.014554 22896 leader_election.cc:343] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.014923 22896 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.009660 23185 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:24.022675 23185 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.023216 23272 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.024681 23273 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.024731 23357 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.025192 23273 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.025259 23357 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.027400 23121 raft_consensus.cc:359] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.033294 23121 raft_consensus.cc:385] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.033643 23121 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.034425 23121 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.021323 23441 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.041805 23401 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.063524 23357 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.068207 23121 ts_tablet_manager.cc:1434] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.006s
I20260709 13:08:24.069257 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:08:24.070150 23440 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:24.062091 23401 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.081899 23401 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.061955 23273 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:24.083607 22972 leader_election.cc:343] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.091768 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.084816 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.109795 23121 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:24.106099 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.088505 23388 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:08:24.105396 23444 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:08:24.123241 23120 tablet_bootstrap.cc:492] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:24.123723 23120 ts_tablet_manager.cc:1403] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.353s	user 0.011s	sys 0.005s
W20260709 13:08:24.119076 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 71245.7us
W20260709 13:08:24.127113 22972 leader_election.cc:343] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.126227 23120 raft_consensus.cc:359] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:24.128099 22972 leader_election.cc:343] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.128111 23120 raft_consensus.cc:385] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.128664 23120 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.129657 23120 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.129637 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.132959 23120 ts_tablet_manager.cc:1434] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:08:24.133867 23120 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:24.143422 23121 tablet_bootstrap.cc:654] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:24.147396 23045 consensus_peers.cc:597] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.155915 23209 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:24.161765 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:24.164687 22826 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.174767 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.175940 23122 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.177848 23002 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.178809 23122 ts_tablet_manager.cc:1403] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.420s	user 0.040s	sys 0.056s
I20260709 13:08:24.182440 23122 raft_consensus.cc:359] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.184163 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.202956 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.210922 23209 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.211438 23209 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.214165 23209 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:24.217190 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:24.220276 22970 leader_election.cc:343] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.222903 22970 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.220696 23444 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.224665 23444 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.222940 23000 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:24.221850 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.226199 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:24.227079 23209 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.227527 23209 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.227941 23209 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.226689 23447 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.240638 23209 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:24.241165 22970 leader_election.cc:343] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.243559 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.183399 23122 raft_consensus.cc:385] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.246246 23444 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:24.249588 22970 leader_election.cc:343] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.260299 22970 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.260986 23444 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.264206 23120 tablet_bootstrap.cc:654] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.264173 22970 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.264981 23444 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.266656 23122 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.269435 23122 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.277776 22927 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
W20260709 13:08:24.282272 23457 log.cc:927] Time spent T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.056s	user 0.004s	sys 0.000s
I20260709 13:08:24.284608 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:24.285169 22927 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.286283 23209 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:24.289410 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:24.290432 23003 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.294500 22927 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:24.297221 23003 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:24.299165 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:24.300721 23122 ts_tablet_manager.cc:1434] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.002s
I20260709 13:08:24.338896 23122 tablet_bootstrap.cc:492] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:24.315865 23209 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.356377 23121 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:24.356820 23121 ts_tablet_manager.cc:1403] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.251s	user 0.034s	sys 0.050s
I20260709 13:08:24.368666 23120 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:24.353957 23209 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:24.369719 23120 ts_tablet_manager.cc:1403] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.236s	user 0.028s	sys 0.020s
I20260709 13:08:24.381626 23122 tablet_bootstrap.cc:654] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.383150 23209 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.389708 23121 raft_consensus.cc:359] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.390339 23121 raft_consensus.cc:385] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.390569 23121 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.391134 23121 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.393206 23122 tablet_bootstrap.cc:492] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.393715 23122 ts_tablet_manager.cc:1403] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.005s
I20260709 13:08:24.395970 23121 ts_tablet_manager.cc:1434] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.010s
I20260709 13:08:24.397979 23122 raft_consensus.cc:359] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.398684 23122 raft_consensus.cc:385] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.398949 23122 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.397979 23121 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:24.399672 23122 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.400545 23120 raft_consensus.cc:359] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.401397 23120 raft_consensus.cc:385] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.401646 23120 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.401830 23122 ts_tablet_manager.cc:1434] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:24.402235 23120 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.402797 23122 tablet_bootstrap.cc:492] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:24.404345 23120 ts_tablet_manager.cc:1434] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.001s
I20260709 13:08:24.407399 23449 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.405211 23120 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:24.407841 23449 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.409797 23449 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:24.411878 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.412493 22927 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:24.413473 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:24.414837 23045 leader_election.cc:343] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.417203 23122 tablet_bootstrap.cc:654] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.416213 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:24.420037 23449 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.420358 23449 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.420651 23449 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.434643 23449 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.435061 23121 tablet_bootstrap.cc:654] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.435505 23120 tablet_bootstrap.cc:654] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.436714 22826 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.441062 23185 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.441978 23449 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:24.441857 23185 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.444362 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:24.444643 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:24.448848 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.449486 22926 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
W20260709 13:08:24.450520 23045 leader_election.cc:343] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.450691 22972 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:24.451609 23444 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.452046 23444 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.452436 23444 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.444572 23185 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.451889 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.444914 22927 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.459595 23122 tablet_bootstrap.cc:492] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.460115 23122 ts_tablet_manager.cc:1403] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.001s
I20260709 13:08:24.460211 23120 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:24.460775 23120 ts_tablet_manager.cc:1403] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.007s
W20260709 13:08:24.463828 22970 leader_election.cc:343] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.464542 23120 raft_consensus.cc:359] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.465322 23120 raft_consensus.cc:385] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.465618 23120 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.466296 23120 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.463409 23122 raft_consensus.cc:359] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.468564 23122 raft_consensus.cc:385] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.468834 23122 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.469525 23122 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.472653 23122 ts_tablet_manager.cc:1434] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:24.473685 23120 ts_tablet_manager.cc:1434] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:24.474720 23120 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:24.478648 23185 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.479187 23185 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.480712 23120 tablet_bootstrap.cc:654] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.484264 23122 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:24.486105 23185 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.488225 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.488881 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.489171 23079 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:24.490485 22972 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.491118 23122 tablet_bootstrap.cc:654] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.491490 23273 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.504139 22927 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:24.508983 23444 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.509811 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:24.516120 23449 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.516613 23449 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:24.517477 23449 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.536103 23401 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.540773 23273 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.546990 23390 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.547487 23390 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.549516 23390 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.551695 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:24.560125 22895 leader_election.cc:343] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.561185 23122 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.561646 23122 ts_tablet_manager.cc:1403] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.016s
I20260709 13:08:24.561086 23448 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.562992 23448 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.564416 23122 raft_consensus.cc:359] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.565169 23122 raft_consensus.cc:385] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.565446 23122 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.569485 23448 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.569600 23122 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.570408 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:24.571864 23122 ts_tablet_manager.cc:1434] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
W20260709 13:08:24.572465 22896 leader_election.cc:343] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.572595 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.572902 23122 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
W20260709 13:08:24.573988 22895 leader_election.cc:343] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.574406 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.575420 23448 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.566092 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:24.577909 23000 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:24.578938 22896 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.579227 23444 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.579648 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:24.579945 23448 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.580245 22924 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.580430 23448 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.581175 23448 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.583393 23120 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:24.583999 23120 ts_tablet_manager.cc:1403] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.109s	user 0.034s	sys 0.012s
I20260709 13:08:24.584921 23122 tablet_bootstrap.cc:654] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.584797 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:08:24.586324 22970 leader_election.cc:343] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.589790 22924 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:24.589875 23120 raft_consensus.cc:359] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.590703 23120 raft_consensus.cc:385] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.590967 22972 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.591769 23444 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.591005 23120 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.593997 23120 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.595674 23120 ts_tablet_manager.cc:1434] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:08:24.596792 23120 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:24.598426 23000 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.603679 23448 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.611294 23122 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.611809 23122 ts_tablet_manager.cc:1403] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.002s
I20260709 13:08:24.612394 23120 tablet_bootstrap.cc:654] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.614127 23121 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:24.615537 23121 ts_tablet_manager.cc:1403] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.218s	user 0.009s	sys 0.004s
I20260709 13:08:24.615844 23444 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:24.614645 23122 raft_consensus.cc:359] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.627345 23122 raft_consensus.cc:385] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.629701 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:24.630581 23002 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.631604 23401 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.627703 23122 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.633865 23122 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.636615 23448 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.630609 23444 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.636103 23122 ts_tablet_manager.cc:1434] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:08:24.640086 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:08:24.641597 22895 leader_election.cc:343] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.641004 23122 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:24.629171 23121 raft_consensus.cc:359] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.645388 23121 raft_consensus.cc:385] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.645864 23121 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.656693 22829 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.646935 23121 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.661303 23367 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.661803 23367 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.668228 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:24.669041 22927 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:24.670469 22972 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:24.671336 23367 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.671442 23401 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.672010 23401 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.672447 23401 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.658890 23002 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:24.674039 22896 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.674819 23390 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.675525 23390 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:24.676447 23390 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.677151 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.678015 23075 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:24.679790 23388 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.680536 23388 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.682652 23388 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.688242 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:24.688576 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.689043 23002 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:24.689209 23073 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:24.696779 23121 ts_tablet_manager.cc:1434] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 13:08:24.699752 23121 tablet_bootstrap.cc:492] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:24.698593 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:24.709749 22827 catalog_manager.cc:5697] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.710403 23448 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.715979 23448 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.716567 23448 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.715526 23401 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.757789 23401 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:24.759889 23481 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.055s	user 0.007s	sys 0.013s
I20260709 13:08:24.760473 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:24.761134 22926 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.761348 23120 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:24.761921 23120 ts_tablet_manager.cc:1403] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.035s
I20260709 13:08:24.773293 22926 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:24.773782 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:24.774397 23073 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.774487 22972 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:24.776187 23122 tablet_bootstrap.cc:654] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.777568 23448 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.781574 23121 tablet_bootstrap.cc:654] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.789381 23448 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.785117 22829 catalog_manager.cc:5697] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.781469 23073 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:24.793195 23120 raft_consensus.cc:359] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.793838 23120 raft_consensus.cc:385] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.794103 23120 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.794657 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:24.795182 23079 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.800661 23401 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.801834 23120 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.812438 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:24.813036 23002 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.815588 23441 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.816183 23441 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.816772 23079 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:24.817842 22895 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:24.818987 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:24.820472 22896 leader_election.cc:343] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.821115 23390 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.821688 23390 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:24.822633 23390 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.821875 23002 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
W20260709 13:08:24.826905 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 52506.9us
I20260709 13:08:24.828907 23122 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.829324 23122 ts_tablet_manager.cc:1403] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.189s	user 0.011s	sys 0.005s
I20260709 13:08:24.832469 23441 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.833590 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:24.835109 22895 leader_election.cc:343] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.835513 22895 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:24.836190 23388 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.848567 23121 tablet_bootstrap.cc:492] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:24.849032 23121 ts_tablet_manager.cc:1403] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.149s	user 0.018s	sys 0.000s
I20260709 13:08:24.855710 23121 raft_consensus.cc:359] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.856673 23121 raft_consensus.cc:385] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.856956 23121 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.857067 23449 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.857786 23121 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.860733 23121 ts_tablet_manager.cc:1434] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:24.861794 23121 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:24.859205 22827 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.869830 23121 tablet_bootstrap.cc:654] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.884459 23122 raft_consensus.cc:359] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.885160 23122 raft_consensus.cc:385] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.885450 23122 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.886051 23122 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.887792 23122 ts_tablet_manager.cc:1434] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.004s
I20260709 13:08:24.888552 23122 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:24.892331 23401 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:24.896284 23489 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.896775 23489 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.899770 23489 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.899984 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:24.900602 23075 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:24.901695 22895 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:24.902429 23448 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.902788 23448 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.903115 23448 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.906925 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:24.908775 23003 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:24.899338 23401 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.912380 23122 tablet_bootstrap.cc:654] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.916298 23120 ts_tablet_manager.cc:1434] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.154s	user 0.008s	sys 0.011s
I20260709 13:08:24.916019 23448 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.917447 23120 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:24.918519 23448 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:24.919448 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:24.919976 23075 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.924682 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:24.925256 23003 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.933504 23122 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.933931 23122 ts_tablet_manager.cc:1403] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 13:08:24.934399 23075 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:24.935446 22895 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:24.936216 23441 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.936654 23441 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:24.936473 23122 raft_consensus.cc:359] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.937103 23122 raft_consensus.cc:385] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.937440 23441 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.937860 23122 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.940251 23122 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.942770 23122 ts_tablet_manager.cc:1434] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:08:24.942914 23003 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:24.944336 23121 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:24.944738 23121 ts_tablet_manager.cc:1403] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.011s
I20260709 13:08:24.944936 23122 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:24.956663 22827 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.973867 23122 tablet_bootstrap.cc:654] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.980615 23449 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.981268 22829 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.982576 23449 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.984356 23121 raft_consensus.cc:359] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.985155 23121 raft_consensus.cc:385] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.985414 23121 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.992363 23122 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:24.992771 23122 ts_tablet_manager.cc:1403] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.004s
I20260709 13:08:24.995115 23122 raft_consensus.cc:359] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:24.995893 23122 raft_consensus.cc:385] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.996153 23122 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.995220 23120 tablet_bootstrap.cc:654] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.996816 23122 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.006300 23122 ts_tablet_manager.cc:1434] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:24.986079 23121 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.007197 23122 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:25.009917 23121 ts_tablet_manager.cc:1434] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.003s
I20260709 13:08:25.013622 23122 tablet_bootstrap.cc:654] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.033685 23122 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:25.034106 23122 ts_tablet_manager.cc:1403] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 13:08:25.034742 23449 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.036602 23121 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:25.045794 23121 tablet_bootstrap.cc:654] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.036610 23122 raft_consensus.cc:359] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.047914 23122 raft_consensus.cc:385] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.048172 23122 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.048890 23122 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.051105 23122 ts_tablet_manager.cc:1434] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:08:25.052183 23122 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:25.059718 23122 tablet_bootstrap.cc:654] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.061041 23121 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:25.061488 23121 ts_tablet_manager.cc:1403] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:08:25.064471 23121 raft_consensus.cc:359] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.065114 23121 raft_consensus.cc:385] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.065354 23121 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.065974 23121 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.068878 23121 ts_tablet_manager.cc:1434] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:25.073954 23122 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:25.074366 23122 ts_tablet_manager.cc:1403] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:08:25.076975 23122 raft_consensus.cc:359] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.077574 23122 raft_consensus.cc:385] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.077824 23122 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.078536 23122 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:25.088647 22895 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.094142 23122 ts_tablet_manager.cc:1434] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:08:25.096167 23121 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:25.096546 23122 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:25.102808 23121 tablet_bootstrap.cc:654] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.113766 23121 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:25.114177 23121 ts_tablet_manager.cc:1403] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.012s
I20260709 13:08:25.116926 23121 raft_consensus.cc:359] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.117588 23121 raft_consensus.cc:385] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.118134 23121 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.118860 23121 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.113637 23122 tablet_bootstrap.cc:654] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.127933 23121 ts_tablet_manager.cc:1434] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:08:25.128995 23121 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:25.130736 23120 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:25.131171 23120 ts_tablet_manager.cc:1403] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.214s	user 0.025s	sys 0.044s
I20260709 13:08:25.133642 23120 raft_consensus.cc:359] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.134256 23120 raft_consensus.cc:385] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.134521 23120 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.135082 23120 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.137215 23120 ts_tablet_manager.cc:1434] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:08:25.138441 23120 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:25.142611 23122 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:25.143050 23122 ts_tablet_manager.cc:1403] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.047s	user 0.002s	sys 0.010s
I20260709 13:08:25.143642 23120 tablet_bootstrap.cc:654] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.145628 23122 raft_consensus.cc:359] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.146270 23122 raft_consensus.cc:385] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.146512 23122 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.139528 23121 tablet_bootstrap.cc:654] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.147110 23122 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.157653 23122 ts_tablet_manager.cc:1434] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:08:25.159096 23122 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:25.160171 23486 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.172679 23453 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.173135 23453 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.175645 23453 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:25.180619 23122 tablet_bootstrap.cc:654] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.180631 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:25.181335 22924 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:25.182569 23046 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:25.183259 23453 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.185753 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.183581 23453 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.188396 23453 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:25.188580 23045 leader_election.cc:343] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.196115 23453 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.200845 23441 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.201036 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:25.201628 22926 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.201396 23441 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.201864 23453 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:25.203402 23441 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.204986 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.205579 23003 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:25.206151 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:25.206672 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:08:25.207464 23045 leader_election.cc:343] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.208071 23441 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.208426 23441 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.208753 23441 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.207543 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:25.209960 23449 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.210263 23075 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:25.210603 23449 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.217109 23441 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.219792 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:25.220049 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:25.220530 23002 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.224320 23449 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:25.225843 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.227116 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:25.228770 23002 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:25.229797 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:25.230672 23448 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.231413 23448 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:25.231601 23441 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.232401 23448 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.237519 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:25.237391 23449 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.238016 23075 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.240672 22926 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:25.242462 23046 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:25.243468 23455 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.244082 23455 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:25.247469 23075 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:08:25.245172 23455 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.254246 23122 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:25.256203 23122 ts_tablet_manager.cc:1403] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
W20260709 13:08:25.267022 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:25.272262 23075 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.271382 23390 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:08:25.284771 23121 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:25.287693 23121 ts_tablet_manager.cc:1403] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.159s	user 0.048s	sys 0.054s
I20260709 13:08:25.290634 23185 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.293108 23120 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:25.293547 23120 ts_tablet_manager.cc:1403] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.155s	user 0.025s	sys 0.021s
I20260709 13:08:25.296702 23120 raft_consensus.cc:359] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.297509 23120 raft_consensus.cc:385] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.301215 23120 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.302333 23120 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.313220 23122 raft_consensus.cc:359] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.313876 23122 raft_consensus.cc:385] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.314126 23122 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.314718 23122 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.304989 23120 ts_tablet_manager.cc:1434] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:08:25.319880 23122 ts_tablet_manager.cc:1434] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:08:25.328029 23121 raft_consensus.cc:359] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.329977 23121 raft_consensus.cc:385] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.330324 23121 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.335060 22829 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.339143 23120 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:25.343116 23122 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:25.343844 23121 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.359954 23388 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:08:25.375171 23121 ts_tablet_manager.cc:1434] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:08:25.374167 23448 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.386241 23121 tablet_bootstrap.cc:492] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:25.385648 23448 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.436230 23453 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.437955 23489 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.443944 23489 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.448333 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.446041 22826 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:25.449640 22896 leader_election.cc:343] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.446012 23489 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.452915 23453 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.463622 23518 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.471324 23122 tablet_bootstrap.cc:654] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.462833 23453 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:25.475449 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.484505 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:08:25.485634 22896 leader_election.cc:343] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.489557 23121 tablet_bootstrap.cc:654] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.489701 23120 tablet_bootstrap.cc:654] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.491812 23448 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.478231 23514 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.503314 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:25.487417 23045 leader_election.cc:343] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.475085 23518 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.509739 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:25.515211 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:25.503924 23079 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:25.510504 23514 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.530251 22926 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:25.540493 23046 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:25.541325 23519 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.541656 23519 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.541986 23519 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.542107 23489 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.536221 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:25.533210 23486 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:08:25.546801 22895 leader_election.cc:343] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.547125 23518 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:25.548635 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.548714 22895 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:25.557339 23401 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.558121 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:25.562336 22926 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:25.549149 23448 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.561003 23002 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:25.563855 23520 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.563071 23448 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.564462 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:25.571593 23448 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.592741 23522 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.593175 23522 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.593557 23522 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.602542 23122 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:25.588550 23519 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.617131 23448 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.652969 23122 ts_tablet_manager.cc:1403] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.311s	user 0.027s	sys 0.002s
I20260709 13:08:25.658291 23120 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:25.658443 23388 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.658819 23120 ts_tablet_manager.cc:1403] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.322s	user 0.015s	sys 0.027s
I20260709 13:08:25.658870 23388 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.676957 23514 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.681497 23448 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.688090 23521 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.092s
I20260709 13:08:25.701490 23121 tablet_bootstrap.cc:492] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:25.702096 23121 ts_tablet_manager.cc:1403] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.316s	user 0.020s	sys 0.005s
I20260709 13:08:25.710309 23122 raft_consensus.cc:359] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.713944 23122 raft_consensus.cc:385] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.714274 23122 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.692854 23390 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:08:25.714912 23122 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.809255 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:25.840583 23448 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.870599 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.883457 23122 ts_tablet_manager.cc:1434] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.230s	user 0.026s	sys 0.049s
I20260709 13:08:25.871876 23519 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:25.900998 23533 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.872475 23448 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.878980 23522 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.884567 23003 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 0.
I20260709 13:08:25.920102 23121 raft_consensus.cc:359] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.920748 23121 raft_consensus.cc:385] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.922360 23121 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.922931 23121 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.901526 23533 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.930542 23121 ts_tablet_manager.cc:1434] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.228s	user 0.005s	sys 0.000s
I20260709 13:08:25.933089 23448 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.936077 23122 tablet_bootstrap.cc:492] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:25.908540 23120 raft_consensus.cc:359] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.937233 23120 raft_consensus.cc:385] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.937505 23120 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.939599 23533 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.940572 23079 raft_consensus.cc:2393] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:25.935549 23388 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:25.943502 23121 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:25.951351 23120 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:25.954021 23120 ts_tablet_manager.cc:1434] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.295s	user 0.013s	sys 0.008s
I20260709 13:08:25.979475 23120 tablet_bootstrap.cc:492] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:25.979278 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:25.984541 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:25.985312 23002 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.990293 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:25.999760 23540 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.995376 23076 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:26.007817 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.022444 23002 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:26.000339 23540 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.031309 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:26.032181 22929 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 1: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:08:26.046556 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.048514 23001 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.057415 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:26.058732 23000 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:26.067255 23121 tablet_bootstrap.cc:654] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.067150 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.067762 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.070009 22925 raft_consensus.cc:2393] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:26.070696 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.074386 23540 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.080338 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:26.084076 22929 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.080077 23522 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.091503 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.117813 23122 tablet_bootstrap.cc:654] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.122179 23120 tablet_bootstrap.cc:654] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.125857 23521 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.130232 23521 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.132351 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:26.133626 22895 leader_election.cc:343] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:26.134215 22895 leader_election.cc:343] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.132948 23000 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.140659 22895 leader_election.cc:343] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.144080 23531 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:08:26.145437 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.141088 23522 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:08:26.148033 22895 leader_election.cc:343] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.141333 23521 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.152998 22972 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.154115 22929 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:26.158298 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.157490 23000 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
W20260709 13:08:26.170476 22896 leader_election.cc:343] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.170879 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.181450 23046 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:26.169334 23533 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.171471 23521 raft_consensus.cc:2764] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:08:26.185753 22896 leader_election.cc:343] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.149363 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:26.188585 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.189015 23448 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:08:26.180644 23514 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:26.200572 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51297.7us
I20260709 13:08:26.186188 23209 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.202200 22896 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.202858 23078 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.203603 23453 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.212939 23453 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:26.213902 23209 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:26.213763 23453 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.214728 23209 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.202114 23448 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.217886 23122 tablet_bootstrap.cc:492] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:26.218240 23122 ts_tablet_manager.cc:1403] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.319s	user 0.013s	sys 0.000s
I20260709 13:08:26.222046 23449 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.234017 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.235441 23121 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:26.236828 23121 ts_tablet_manager.cc:1403] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.293s	user 0.012s	sys 0.011s
I20260709 13:08:26.239980 23120 tablet_bootstrap.cc:492] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:26.240643 23120 ts_tablet_manager.cc:1403] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.264s	user 0.021s	sys 0.002s
I20260709 13:08:26.239292 23121 raft_consensus.cc:359] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.242844 23121 raft_consensus.cc:385] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.243103 23121 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.243743 23121 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.243947 23120 raft_consensus.cc:359] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.244825 23120 raft_consensus.cc:385] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.245146 23120 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.251741 23120 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.234009 23489 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.258154 23121 ts_tablet_manager.cc:1434] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
W20260709 13:08:26.261164 22896 leader_election.cc:343] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.261726 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.275121 23548 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.285881 23122 raft_consensus.cc:359] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.286572 23122 raft_consensus.cc:385] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.286842 23122 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.288394 23122 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.301991 23120 ts_tablet_manager.cc:1434] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:08:26.306290 23122 ts_tablet_manager.cc:1434] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.003s
I20260709 13:08:26.309312 23120 tablet_bootstrap.cc:492] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
W20260709 13:08:26.329504 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:26.339735 23122 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: Bootstrap starting.
I20260709 13:08:26.360632 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.362775 23120 tablet_bootstrap.cc:654] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.374660 23122 tablet_bootstrap.cc:654] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.376019 23121 tablet_bootstrap.cc:492] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
W20260709 13:08:26.384474 22896 leader_election.cc:343] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.390597 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.392279 23521 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.419827 23122 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: No bootstrap required, opened a new log
I20260709 13:08:26.420578 23122 ts_tablet_manager.cc:1403] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.001s
I20260709 13:08:26.430316 23121 tablet_bootstrap.cc:654] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.432055 23120 tablet_bootstrap.cc:492] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:26.432953 23120 ts_tablet_manager.cc:1403] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.003s
I20260709 13:08:26.437822 23120 raft_consensus.cc:359] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.438714 23120 raft_consensus.cc:385] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.442812 23120 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.443495 23120 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.445099 23120 ts_tablet_manager.cc:1434] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:08:26.445971 23120 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:26.442104 23122 raft_consensus.cc:359] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.447800 23122 raft_consensus.cc:385] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.448071 23122 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.448704 23122 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.451274 23122 ts_tablet_manager.cc:1434] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:08:26.456398 23120 tablet_bootstrap.cc:654] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.460482 23121 tablet_bootstrap.cc:492] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:26.460889 23121 ts_tablet_manager.cc:1403] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.001s
I20260709 13:08:26.468472 23120 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:26.468961 23120 ts_tablet_manager.cc:1403] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:08:26.471174 23121 raft_consensus.cc:359] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.471333 23120 raft_consensus.cc:359] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.472189 23120 raft_consensus.cc:385] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.472514 23120 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.473677 23120 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.475749 23120 ts_tablet_manager.cc:1434] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:26.471827 23121 raft_consensus.cc:385] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.477073 23120 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:26.477272 23121 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.477985 23121 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.479880 23121 ts_tablet_manager.cc:1434] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:08:26.482754 23121 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:26.489105 23120 tablet_bootstrap.cc:654] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.494946 22826 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.504618 23120 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:26.505273 23120 ts_tablet_manager.cc:1403] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:08:26.505484 22826 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.503150 23520 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.506744 23520 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.501024 23121 tablet_bootstrap.cc:654] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.508944 23520 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.509449 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.510583 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:26.510831 22896 leader_election.cc:343] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:26.512346 22895 leader_election.cc:343] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.512297 23120 raft_consensus.cc:359] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.512858 22895 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.513111 23120 raft_consensus.cc:385] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.513382 23120 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.514084 23120 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.515028 23520 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.523636 23120 ts_tablet_manager.cc:1434] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:08:26.524724 23120 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:26.553293 23121 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:26.553731 23121 ts_tablet_manager.cc:1403] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.011s
I20260709 13:08:26.554658 23120 tablet_bootstrap.cc:654] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.556922 23401 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.557418 23401 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.557919 23121 raft_consensus.cc:359] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.558596 23121 raft_consensus.cc:385] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.558846 23121 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.559509 23121 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.560053 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.560660 22925 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:26.561765 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:26.562235 23121 ts_tablet_manager.cc:1434] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:26.562621 23546 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.563011 23546 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.563364 23546 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.563429 23121 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:26.570686 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.573156 23121 tablet_bootstrap.cc:654] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:26.573550 22970 leader_election.cc:343] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.577762 23401 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.580606 23546 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.582867 23546 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.583972 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:26.584535 22925 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.584837 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:26.585546 23209 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.585994 23209 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:26.586375 22970 leader_election.cc:343] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.587872 23209 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.588934 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.589239 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.589725 22929 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
W20260709 13:08:26.590409 23045 leader_election.cc:343] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.590936 22925 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:26.591244 23046 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:26.591974 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.592741 23209 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.593225 23209 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.593935 23542 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.594393 23542 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:26.595202 23542 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.593600 23209 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.641717 23532 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.642343 23532 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.645453 23532 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.647125 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.648331 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.649499 22923 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
W20260709 13:08:26.651921 22970 leader_election.cc:343] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.653308 22972 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.655361 23542 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.655923 23542 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.656387 23542 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.658675 23120 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:26.659214 23120 ts_tablet_manager.cc:1403] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.000s
I20260709 13:08:26.659996 23209 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.662195 23120 raft_consensus.cc:359] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.662880 23120 raft_consensus.cc:385] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.663203 23120 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.664070 23120 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.667680 23120 ts_tablet_manager.cc:1434] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:26.667768 23121 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:26.668290 23121 ts_tablet_manager.cc:1403] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.105s	user 0.047s	sys 0.036s
I20260709 13:08:26.668777 23120 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:26.671201 23121 raft_consensus.cc:359] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.671904 23121 raft_consensus.cc:385] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.672222 23121 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.672988 23209 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.672868 23121 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.673491 23209 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.675333 23121 ts_tablet_manager.cc:1434] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:26.674903 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:26.676028 23000 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.676648 23121 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:26.676986 23120 tablet_bootstrap.cc:654] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.684228 23121 tablet_bootstrap.cc:654] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.685844 23542 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.687898 23120 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:26.688318 23120 ts_tablet_manager.cc:1403] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:08:26.688508 23209 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.689129 23209 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.695645 22827 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.705955 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:26.706589 22925 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.695894 23000 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:26.727967 23209 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.732374 23045 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:26.734054 23209 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.735349 23209 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:26.736035 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:26.736052 23209 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:26.737591 22970 leader_election.cc:343] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.730366 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:26.739884 22924 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.740131 23120 raft_consensus.cc:359] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.740854 23120 raft_consensus.cc:385] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.741123 23120 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.742470 23120 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.733134 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.750433 23120 ts_tablet_manager.cc:1434] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:08:26.753636 23120 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:08:26.737535 23542 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.746090 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.761580 22929 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:26.754545 23005 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:26.763798 23453 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.766700 23046 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:26.777961 22925 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:26.778362 23121 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:26.778846 23121 ts_tablet_manager.cc:1403] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.020s
I20260709 13:08:26.779511 23522 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.788729 23522 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.797590 23522 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.802867 23519 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.805783 23121 raft_consensus.cc:359] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.806398 22924 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:26.806442 23121 raft_consensus.cc:385] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.808501 23121 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.809080 23121 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.811426 23121 ts_tablet_manager.cc:1434] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:08:26.812479 23453 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.813023 23121 tablet_bootstrap.cc:492] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:26.812947 23453 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.817252 23120 tablet_bootstrap.cc:654] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.818554 22972 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:08:26.821450 23401 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.821631 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.821995 23401 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:26.817119 23453 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.822950 23401 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.823771 23453 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.817653 23522 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.834684 23522 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.835763 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:26.840003 23000 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.837343 23209 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.840970 23209 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.849519 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.852654 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:26.853214 22923 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.853060 22827 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.854648 23209 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.856127 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.856761 22924 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:26.858111 23046 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:26.859004 23522 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.859369 23522 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.862823 23522 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.860060 23121 tablet_bootstrap.cc:654] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.864423 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.865272 23002 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:26.878014 22923 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:26.880740 23000 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:26.881781 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:26.883266 23519 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.883570 22925 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:26.883845 23519 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:26.884833 23519 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.897105 23121 tablet_bootstrap.cc:492] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:26.884848 23046 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:26.902542 23517 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.898376 23121 ts_tablet_manager.cc:1403] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.086s	user 0.023s	sys 0.003s
I20260709 13:08:26.909562 23121 raft_consensus.cc:359] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.922092 23121 raft_consensus.cc:385] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.922508 23121 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.923336 23121 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.928598 23517 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.936435 23517 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.936926 23517 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.938867 23546 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.939113 23517 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.939339 23546 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.941382 23546 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:26.941253 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:26.942052 23000 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:26.942902 23121 ts_tablet_manager.cc:1434] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:08:26.945189 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.945429 23522 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.945801 22924 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 0.
I20260709 13:08:26.945861 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:26.946465 22925 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:26.947919 23522 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:26.949783 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:26.950371 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:26.950937 22925 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.951376 23532 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.951828 23532 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.952224 23532 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.953050 23120 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: No bootstrap required, opened a new log
I20260709 13:08:26.953465 23120 ts_tablet_manager.cc:1403] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.200s	user 0.010s	sys 0.011s
I20260709 13:08:26.959447 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:26.960182 23522 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.960570 23522 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.960952 23522 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.963415 22826 catalog_manager.cc:5697] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.967351 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:26.971238 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:26.971813 23005 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.973623 23120 raft_consensus.cc:359] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.974992 23120 raft_consensus.cc:385] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.975240 23120 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.985044 23121 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Bootstrap starting.
I20260709 13:08:26.976126 23120 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.992784 23120 ts_tablet_manager.cc:1434] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:08:26.983009 23522 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.993986 23080 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:26.994078 23542 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.976768 22925 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:26.992367 23532 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:26.999938 22829 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.001289 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:27.001868 22924 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.006999 23532 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:27.011580 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:27.012252 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:27.013098 23076 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 1: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:08:27.014125 23121 tablet_bootstrap.cc:654] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.017565 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:27.018182 23046 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:27.020875 22924 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:27.022330 23546 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.024154 23453 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.024673 23453 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:27.025525 23453 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:27.030426 23005 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:08:27.033044 23522 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:27.033514 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:27.045123 23003 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:27.035544 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:27.046847 23522 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.047361 23522 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:27.048231 23522 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:27.064606 23121 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: No bootstrap required, opened a new log
I20260709 13:08:27.065090 23121 ts_tablet_manager.cc:1403] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.001s
I20260709 13:08:27.069010 23121 raft_consensus.cc:359] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:27.069679 23121 raft_consensus.cc:385] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.069952 23121 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.070708 23121 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:27.073537 22829 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.075527 23532 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.078253 23121 ts_tablet_manager.cc:1434] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:08:27.118886 22826 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.158241 23522 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.158759 23522 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:27.160386 23522 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:27.161020 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:27.161635 22924 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 1: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:08:27.161433 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:27.162770 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:27.163343 23522 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.168224 23522 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.218321 23522 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.228441 23517 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.303017 23532 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.323269 23532 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.343868 23401 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.344360 23401 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:27.346017 23401 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:27.347411 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:27.348002 22924 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 0.
I20260709 13:08:27.349131 22972 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:27.349781 23532 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.350178 23532 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.350564 23532 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.358160 23532 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:27.360831 23532 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:27.363445 23517 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.365928 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:27.366472 23080 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.366482 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:27.375375 23080 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:27.376816 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:27.377494 22924 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.387128 22970 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:27.404126 22924 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:27.406450 23542 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.406955 23542 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:27.407730 23542 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:08:27.426772 22877 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:27.428995 23517 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.433941 22827 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.438156 23517 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.476975 23519 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.480090 23517 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.511504 23453 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.797909 23532 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.811053 23401 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.253988 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:29.289307 23610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:29.291182 23611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:29.292972 23613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:29.294111 21775 server_base.cc:1061] running on GCE node
I20260709 13:08:29.295881 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:29.296106 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:29.296327 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602509296308 us; error 0 us; skew 500 ppm
I20260709 13:08:29.296882 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:29.301314 21775 webserver.cc:533] Webserver started at http://127.21.67.196:43165/ using document root <none> and password file <none>
I20260709 13:08:29.302338 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:29.302605 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:29.303051 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:29.304420 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-3-root/instance:
uuid: "01988c2c817947859340a730b7f1247d"
format_stamp: "Formatted at 2026-07-09 13:08:29 on dist-test-slave-zkvt"
I20260709 13:08:29.309896 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:08:29.313867 23618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:29.315069 21775 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:29.315380 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-3-root
uuid: "01988c2c817947859340a730b7f1247d"
format_stamp: "Formatted at 2026-07-09 13:08:29 on dist-test-slave-zkvt"
I20260709 13:08:29.315703 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:29.333235 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:29.334908 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:29.337738 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:29.346892 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:29.347122 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:29.347436 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:29.347698 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:08:29.462324 23681 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.196:35811 every 8 connection(s)
I20260709 13:08:29.467828 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.196:35811
I20260709 13:08:29.514537 21775 auto_leader_rebalancer-test.cc:384] add a tserver: 01988c2c817947859340a730b7f1247d
I20260709 13:08:29.532672 23682 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36129
I20260709 13:08:29.533130 23682 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:29.533864 23682 heartbeater.cc:507] Master 127.21.67.254:36129 requested a full tablet report, sending...
I20260709 13:08:29.535657 22827 ts_manager.cc:194] Registered new tserver with Master: 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:29.537276 22827 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60284
I20260709 13:08:30.553642 23682 heartbeater.cc:499] Master 127.21.67.254:36129 was elected leader, sending a full tablet report...
I20260709 13:08:30.740916 23076 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:30.754865 23005 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:30.756603 23697 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:30.757301 22923 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:30.760310 23697 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:30.783215 23697 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:30.785583 22925 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
W20260709 13:08:30.786034 23045 consensus_peers.cc:597] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6238b133cf6c4b948cf771c94b860716. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.802356 23003 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:30.845341 22827 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:30.892764 22925 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:30.903570 23073 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:30.911594 23005 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:30.914109 23520 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:30.915213 23549 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:30.929916 22896 consensus_peers.cc:597] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da207091d69d47c2a67b181645327e1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.942760 23549 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:30.944729 23076 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:30.961220 23005 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:30.984742 22827 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:30.992666 23000 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.001524 23073 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:31.003459 22924 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:31.003283 23687 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:31.005434 23693 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:31.014444 23687 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
W20260709 13:08:31.018360 22971 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 808909fe49ff4730b32151fb7a7b559e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.021957 23076 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:31.027369 22924 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:31.034778 23000 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.039095 22826 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:31.053880 22923 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:31.054648 22971 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5f4021a98714bc6b65420cc163e3a91. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.056245 23691 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:31.069713 23076 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:31.070362 23608 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:31.071332 23687 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:31.074049 22923 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:31.079150 23076 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:31.095631 22826 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.195487 23720 ts_tablet_manager.cc:933] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:31.199059 23720 tablet_copy_client.cc:323] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:31.212580 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 6238b133cf6c4b948cf771c94b860716 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:31.213168 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 6238b133cf6c4b948cf771c94b860716 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-6238b133cf6c4b948cf771c94b860716
I20260709 13:08:31.219579 23090 tablet_copy_source_session.cc:215] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:31.222939 23720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6238b133cf6c4b948cf771c94b860716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.234721 23720 tablet_copy_client.cc:806] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.235420 23720 tablet_copy_client.cc:670] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.239754 23720 tablet_copy_client.cc:538] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.248962 23720 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:31.267480 23720 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.268513 23720 tablet_bootstrap.cc:492] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:31.269202 23720 ts_tablet_manager.cc:1403] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:08:31.272459 23720 raft_consensus.cc:359] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.273281 23720 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:31.273981 23720 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.277016 23720 ts_tablet_manager.cc:1434] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:31.278617 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-6238b133cf6c4b948cf771c94b860716 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:31.279067 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-6238b133cf6c4b948cf771c94b860716 on tablet 6238b133cf6c4b948cf771c94b860716 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:31.337296 23720 ts_tablet_manager.cc:933] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:31.339535 23720 tablet_copy_client.cc:323] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:31.349450 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet da207091d69d47c2a67b181645327e1c from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:31.349984 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet da207091d69d47c2a67b181645327e1c from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-da207091d69d47c2a67b181645327e1c
I20260709 13:08:31.357916 22941 tablet_copy_source_session.cc:215] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:31.361089 23720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da207091d69d47c2a67b181645327e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.377774 23720 tablet_copy_client.cc:806] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.378373 23720 tablet_copy_client.cc:670] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.381414 23720 tablet_copy_client.cc:538] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.389495 23720 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:31.407476 23720 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.408306 23720 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:31.408849 23720 ts_tablet_manager.cc:1403] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.020s	user 0.020s	sys 0.000s
I20260709 13:08:31.417435 23720 raft_consensus.cc:359] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.418372 23720 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:31.419040 23720 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.421286 23720 ts_tablet_manager.cc:1434] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:08:31.422971 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-da207091d69d47c2a67b181645327e1c received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:31.423379 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-da207091d69d47c2a67b181645327e1c on tablet da207091d69d47c2a67b181645327e1c with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:31.549693 23720 ts_tablet_manager.cc:933] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:31.551443 23720 tablet_copy_client.cc:323] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:31.563623 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet a5f4021a98714bc6b65420cc163e3a91 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:31.564174 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet a5f4021a98714bc6b65420cc163e3a91 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-a5f4021a98714bc6b65420cc163e3a91
I20260709 13:08:31.570350 23729 ts_tablet_manager.cc:933] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:31.572086 23016 tablet_copy_source_session.cc:215] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:31.578289 23729 tablet_copy_client.cc:323] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:31.579996 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 808909fe49ff4730b32151fb7a7b559e from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:31.580487 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 808909fe49ff4730b32151fb7a7b559e from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-808909fe49ff4730b32151fb7a7b559e
I20260709 13:08:31.581166 23720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f4021a98714bc6b65420cc163e3a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.588224 23016 tablet_copy_source_session.cc:215] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:31.592319 23729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808909fe49ff4730b32151fb7a7b559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.594709 23720 tablet_copy_client.cc:806] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.595261 23720 tablet_copy_client.cc:670] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.607043 23720 tablet_copy_client.cc:538] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.611239 23729 tablet_copy_client.cc:806] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:31.611814 23729 tablet_copy_client.cc:670] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:31.612555 23720 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:31.615517 23729 tablet_copy_client.cc:538] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:31.623917 23729 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:31.628448 23720 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.629207 23720 tablet_bootstrap.cc:492] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:31.629753 23720 ts_tablet_manager.cc:1403] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.001s
I20260709 13:08:31.631803 23720 raft_consensus.cc:359] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.632411 23720 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:31.632901 23720 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.634460 23720 ts_tablet_manager.cc:1434] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:31.636154 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-a5f4021a98714bc6b65420cc163e3a91 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:31.636601 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-a5f4021a98714bc6b65420cc163e3a91 on tablet a5f4021a98714bc6b65420cc163e3a91 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:31.653800 23729 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.654856 23729 tablet_bootstrap.cc:492] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:31.655613 23729 ts_tablet_manager.cc:1403] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.008s
I20260709 13:08:31.659165 23729 raft_consensus.cc:359] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.660365 23729 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:31.661126 23729 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:31.663874 23729 ts_tablet_manager.cc:1434] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:31.671520 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-808909fe49ff4730b32151fb7a7b559e received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:31.671979 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-808909fe49ff4730b32151fb7a7b559e on tablet 808909fe49ff4730b32151fb7a7b559e with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:31.755759 23657 raft_consensus.cc:1217] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:31.956082 23657 raft_consensus.cc:1217] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:31.994766 23657 raft_consensus.cc:1217] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:32.133841 23522 raft_consensus.cc:1064] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:32.136610 23522 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:32.139181 23657 raft_consensus.cc:1217] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:32.149197 23657 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:32.150034 23003 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:32.156061 22924 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:32.154354 23736 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:08:32.158354 23702 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:32.159817 23522 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:32.183449 23702 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.186484 22924 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.189891 23657 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.196879 23000 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.204434 22827 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.237432 23073 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:32.242224 23657 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:32.243031 23000 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:32.243687 23702 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:32.246506 23702 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:32.249399 23737 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.276652 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6238b133cf6c4b948cf771c94b860716 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:32.270656 23657 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.282438 22828 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.296168 23000 raft_consensus.cc:2955] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:32.307188 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 6238b133cf6c4b948cf771c94b860716 with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:32.312372 23746 tablet_replica.cc:333] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:32.314589 23746 raft_consensus.cc:2243] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.315788 23746 raft_consensus.cc:2272] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.319160 23746 ts_tablet_manager.cc:1916] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:32.334365 23746 ts_tablet_manager.cc:1929] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:32.334795 23746 log.cc:1199] T 6238b133cf6c4b948cf771c94b860716 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/6238b133cf6c4b948cf771c94b860716
I20260709 13:08:32.336608 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 6238b133cf6c4b948cf771c94b860716 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:33.341594 23734 raft_consensus.cc:1064] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:33.348500 23734 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:33.353109 23736 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:33.353619 23736 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:33.356560 23736 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:33.367452 23752 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:33.367964 23752 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:33.369992 23752 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:08:33.380836 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 100881us
I20260709 13:08:33.381968 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:33.382369 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:33.388348 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:33.394629 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:33.395133 23687 raft_consensus.cc:1064] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:33.403098 23687 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:33.405507 23046 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:33.406400 23757 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.406618 23046 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:33.408288 23757 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.409891 23749 raft_consensus.cc:1064] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:33.412084 23749 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:33.419318 23654 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.420979 23520 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.422428 23079 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.427858 23549 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.430787 23079 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.433115 23076 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.434250 22999 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.434629 23747 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:33.436354 23747 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.438485 23750 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:33.442006 23657 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.443477 23656 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.445130 22924 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.450117 23747 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.450750 23759 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:33.457407 23687 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.469249 22924 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:33.470953 23747 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.484273 23747 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.486092 23079 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.500571 22925 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.502447 23750 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.513630 23654 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.520093 23759 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.511487 22829 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.529983 23656 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.533638 22828 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.548303 23657 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:08:33.551276 23767 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:33.548931 23080 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.557883 22999 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.535495 22923 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.553946 23079 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.593066 22923 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:33.604688 23657 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:33.604363 22827 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.607856 23079 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:33.608690 23750 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:33.610356 23520 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:33.619212 23549 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.622707 23657 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.623713 23080 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.628778 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da207091d69d47c2a67b181645327e1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:33.637480 22827 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.638248 23005 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:33.648283 23656 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:33.651348 22925 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:33.653129 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet da207091d69d47c2a67b181645327e1c with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:33.655825 23761 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:33.658792 23761 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:33.661497 22999 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:33.670576 23656 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:33.672147 23747 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:33.670532 23749 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.672751 22925 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.679877 23608 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.681495 23656 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.693605 22924 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:33.695266 23687 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:33.697069 23654 raft_consensus.cc:2955] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.704574 23779 tablet_replica.cc:333] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:33.698916 22924 raft_consensus.cc:2955] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.709331 23779 raft_consensus.cc:2243] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.710085 23779 raft_consensus.cc:2272] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.711432 22826 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.721628 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5f4021a98714bc6b65420cc163e3a91 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:33.723965 23779 ts_tablet_manager.cc:1916] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:33.728397 22829 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:33.731179 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 808909fe49ff4730b32151fb7a7b559e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:33.733423 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 808909fe49ff4730b32151fb7a7b559e with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:33.754879 23779 ts_tablet_manager.cc:1929] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:33.755340 23779 log.cc:1199] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/da207091d69d47c2a67b181645327e1c
I20260709 13:08:33.757102 23780 tablet_replica.cc:333] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:33.758242 23780 raft_consensus.cc:2243] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.758817 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet da207091d69d47c2a67b181645327e1c (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:33.758958 23780 raft_consensus.cc:2272] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.762151 23780 ts_tablet_manager.cc:1916] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:33.764652 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet a5f4021a98714bc6b65420cc163e3a91 with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:33.779433 23780 ts_tablet_manager.cc:1929] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:33.779873 23780 log.cc:1199] T 808909fe49ff4730b32151fb7a7b559e P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/808909fe49ff4730b32151fb7a7b559e
I20260709 13:08:33.781116 23780 tablet_replica.cc:333] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:33.781076 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 808909fe49ff4730b32151fb7a7b559e (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:33.782080 23780 raft_consensus.cc:2243] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.782549 23780 raft_consensus.cc:2272] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.785341 23780 ts_tablet_manager.cc:1916] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:33.798146 23780 ts_tablet_manager.cc:1929] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:33.798532 23780 log.cc:1199] T a5f4021a98714bc6b65420cc163e3a91 P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/a5f4021a98714bc6b65420cc163e3a91
I20260709 13:08:33.799875 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet a5f4021a98714bc6b65420cc163e3a91 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
W20260709 13:08:33.989979 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8aa0 after lost signal to thread 21778
W20260709 13:08:33.990764 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5b20 after lost signal to thread 22863
W20260709 13:08:33.991539 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001dfbe0 after lost signal to thread 22955
W20260709 13:08:33.992272 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf220 after lost signal to thread 23030
W20260709 13:08:33.992957 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08002cbd60 after lost signal to thread 23104
W20260709 13:08:33.993749 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc220 after lost signal to thread 23681
I20260709 13:08:34.830032 22924 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:34.835214 23080 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:34.835567 22896 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52e9d1a1bba44536a9f74a4b0a1ae1ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:34.836382 23734 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.837168 23005 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:34.838328 23734 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.849138 23786 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.852237 22999 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.853900 23080 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.865808 22827 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.869240 22999 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:34.882504 23080 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:34.882706 22924 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:34.882650 22971 consensus_peers.cc:597] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bf6397d6bc54a22915e0146962b443d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:34.884116 23747 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.884984 23781 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.894109 23781 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.896024 22924 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.909129 23080 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.915815 22828 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.922506 22999 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:34.931981 22971 consensus_peers.cc:597] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0633fbe8ee1c4284a67d72b00a0285a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:34.933109 22924 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:34.934329 23080 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:34.935168 23608 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.935959 23795 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.950809 23747 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.952190 23080 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.952510 22925 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.965000 22924 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:34.965046 22827 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
W20260709 13:08:34.975162 22896 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7518f17f1ae4b619ddf2d5e1eeb0c3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:34.977244 23080 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:34.978053 22999 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:34.978732 23786 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.979573 23748 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.987941 23748 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.989660 22999 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:34.991473 23079 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:35.008378 22827 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.420854 23803 ts_tablet_manager.cc:933] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:35.422449 23803 tablet_copy_client.cc:323] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:35.424229 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:35.424674 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-52e9d1a1bba44536a9f74a4b0a1ae1ff
I20260709 13:08:35.429715 22941 tablet_copy_source_session.cc:215] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:35.432523 23803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.445314 23803 tablet_copy_client.cc:806] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:35.445995 23803 tablet_copy_client.cc:670] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:35.449343 23803 tablet_copy_client.cc:538] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:35.455168 23803 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:35.471709 23803 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:35.472947 23803 tablet_bootstrap.cc:492] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:35.473543 23806 ts_tablet_manager.cc:933] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:35.473558 23803 ts_tablet_manager.cc:1403] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 13:08:35.475767 23806 tablet_copy_client.cc:323] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:35.477512 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 0633fbe8ee1c4284a67d72b00a0285a0 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:35.477298 23803 raft_consensus.cc:359] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.478296 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 0633fbe8ee1c4284a67d72b00a0285a0 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-0633fbe8ee1c4284a67d72b00a0285a0
I20260709 13:08:35.478358 23803 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:35.479302 23803 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.493629 23803 ts_tablet_manager.cc:1434] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:08:35.494117 23016 tablet_copy_source_session.cc:215] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:35.495752 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-52e9d1a1bba44536a9f74a4b0a1ae1ff received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:35.496168 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-52e9d1a1bba44536a9f74a4b0a1ae1ff on tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:35.498816 23806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0633fbe8ee1c4284a67d72b00a0285a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.504539 23803 ts_tablet_manager.cc:933] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:35.506316 23803 tablet_copy_client.cc:323] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:35.507915 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 5bf6397d6bc54a22915e0146962b443d from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:35.508435 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 5bf6397d6bc54a22915e0146962b443d from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-5bf6397d6bc54a22915e0146962b443d
I20260709 13:08:35.515951 23016 tablet_copy_source_session.cc:215] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:35.518572 23806 tablet_copy_client.cc:806] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:35.519244 23806 tablet_copy_client.cc:670] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:35.523948 23806 tablet_copy_client.cc:538] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:35.525170 23803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf6397d6bc54a22915e0146962b443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.538375 23806 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:35.548455 23803 tablet_copy_client.cc:806] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:35.549104 23803 tablet_copy_client.cc:670] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:35.553915 23803 tablet_copy_client.cc:538] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:35.562292 23803 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:35.564024 23806 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:35.564949 23806 tablet_bootstrap.cc:492] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:35.565589 23806 ts_tablet_manager.cc:1403] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.004s
I20260709 13:08:35.568538 23806 raft_consensus.cc:359] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.569375 23806 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:35.570022 23806 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.572333 23806 ts_tablet_manager.cc:1434] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:08:35.573884 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-0633fbe8ee1c4284a67d72b00a0285a0 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:35.574276 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-0633fbe8ee1c4284a67d72b00a0285a0 on tablet 0633fbe8ee1c4284a67d72b00a0285a0 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:35.589905 23803 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:35.590812 23803 tablet_bootstrap.cc:492] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:35.591455 23803 ts_tablet_manager.cc:1403] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.000s
I20260709 13:08:35.594292 23803 raft_consensus.cc:359] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.595160 23803 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:35.595402 23806 ts_tablet_manager.cc:933] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:35.596057 23803 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.600322 23803 ts_tablet_manager.cc:1434] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:35.601831 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-5bf6397d6bc54a22915e0146962b443d received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:35.602099 23806 tablet_copy_client.cc:323] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:35.602236 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-5bf6397d6bc54a22915e0146962b443d on tablet 5bf6397d6bc54a22915e0146962b443d with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:35.603760 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:35.604313 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-f7518f17f1ae4b619ddf2d5e1eeb0c3d
I20260709 13:08:35.610951 22941 tablet_copy_source_session.cc:215] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:35.617784 23806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.636278 23806 tablet_copy_client.cc:806] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:35.636902 23806 tablet_copy_client.cc:670] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:35.640643 23806 tablet_copy_client.cc:538] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:35.652487 23806 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:35.678995 23806 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:35.679884 23806 tablet_bootstrap.cc:492] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:35.680747 23806 ts_tablet_manager.cc:1403] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.008s
I20260709 13:08:35.683524 23806 raft_consensus.cc:359] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.684567 23806 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:35.685164 23806 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:35.687722 23806 ts_tablet_manager.cc:1434] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:35.689940 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-f7518f17f1ae4b619ddf2d5e1eeb0c3d received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:35.690337 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-f7518f17f1ae4b619ddf2d5e1eeb0c3d on tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:35.809983 23656 raft_consensus.cc:1217] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.013039 23656 raft_consensus.cc:1217] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.020324 23656 raft_consensus.cc:1217] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.098927 23656 raft_consensus.cc:1217] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.336688 23785 raft_consensus.cc:1064] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:36.339165 23785 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:36.349031 23080 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.349239 23656 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.350656 23786 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.353181 23005 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.356714 23748 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.358465 23748 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.364007 23785 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.369913 22999 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.386474 22828 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.388090 23080 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.407116 23608 raft_consensus.cc:1064] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:36.409366 23608 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:36.423138 23815 raft_consensus.cc:1064] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:36.425647 23815 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:08:36.435599 23820 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:08:36.441795 23816 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:08:36.450022 23656 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.475574 23654 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.477499 23079 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.477746 23817 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.485210 23786 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.508467 23000 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.514050 23785 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.542308 23828 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.545923 23657 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.546001 23656 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.554562 23822 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.554591 22925 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.557175 23823 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.561527 23079 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.565196 23080 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.572633 23608 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.605580 22997 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.620553 23822 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.622778 23076 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.636652 22925 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.639398 23655 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.658752 22828 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.665838 22828 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.680800 22999 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:36.685848 23655 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:36.687315 23831 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:36.693694 23076 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:36.695013 22923 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:36.695441 23831 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:36.697384 23822 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.698956 22925 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:36.704460 23656 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.706125 22999 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:36.707266 23785 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:36.707890 23654 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:36.711462 23655 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:36.713549 23823 raft_consensus.cc:1064] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:36.714951 23079 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:36.716715 23823 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:36.717528 23828 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:36.715308 23785 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.720571 23005 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.721859 23076 raft_consensus.cc:2955] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.719272 23828 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:36.724514 23815 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:36.737094 23815 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.737654 23655 raft_consensus.cc:2955] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.741981 23079 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.748621 22829 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.749307 23657 raft_consensus.cc:2955] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.755499 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0633fbe8ee1c4284a67d72b00a0285a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:36.764423 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:36.765677 23655 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.766919 23073 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.787177 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:36.789316 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 0633fbe8ee1c4284a67d72b00a0285a0 with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:36.797448 22829 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.798961 22829 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.813920 23831 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.815297 23747 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.823745 23841 tablet_replica.cc:333] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:36.825556 23841 raft_consensus.cc:2243] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.827756 23841 raft_consensus.cc:2272] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.833175 23841 ts_tablet_manager.cc:1916] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:36.850775 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:36.851096 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:36.849215 22925 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.859388 23823 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.864588 23841 ts_tablet_manager.cc:1929] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:36.866901 23841 log.cc:1199] T 0633fbe8ee1c4284a67d72b00a0285a0 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/0633fbe8ee1c4284a67d72b00a0285a0
I20260709 13:08:36.870482 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 0633fbe8ee1c4284a67d72b00a0285a0 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:36.911044 23845 tablet_replica.cc:333] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:36.915557 23845 raft_consensus.cc:2243] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.918251 23747 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.922894 23657 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.945179 23845 raft_consensus.cc:2272] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.954903 23844 tablet_replica.cc:333] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:36.956960 23844 raft_consensus.cc:2243] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.961731 23073 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.965471 23844 raft_consensus.cc:2272] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.948544 22925 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.961184 23845 ts_tablet_manager.cc:1916] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:36.968415 22826 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:36.981799 23844 ts_tablet_manager.cc:1916] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:37.007525 23845 ts_tablet_manager.cc:1929] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:37.008112 23845 log.cc:1199] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/f7518f17f1ae4b619ddf2d5e1eeb0c3d
I20260709 13:08:37.010430 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet f7518f17f1ae4b619ddf2d5e1eeb0c3d (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:37.011793 23005 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:37.018517 23657 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.020146 23823 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.010427 23844 ts_tablet_manager.cc:1929] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:37.022091 23844 log.cc:1199] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/52e9d1a1bba44536a9f74a4b0a1ae1ff
I20260709 13:08:37.024780 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 52e9d1a1bba44536a9f74a4b0a1ae1ff (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:37.029937 23831 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:37.032290 23657 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:37.038355 23076 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.051258 23822 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.051198 22829 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:37.056455 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5bf6397d6bc54a22915e0146962b443d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:37.056438 23076 raft_consensus.cc:2955] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:37.064747 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bf6397d6bc54a22915e0146962b443d with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:37.065653 23841 tablet_replica.cc:333] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:37.076578 23841 raft_consensus.cc:2243] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.077302 23841 raft_consensus.cc:2272] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.080776 23841 ts_tablet_manager.cc:1916] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:37.091929 23841 ts_tablet_manager.cc:1929] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:37.092351 23841 log.cc:1199] T 5bf6397d6bc54a22915e0146962b443d P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/5bf6397d6bc54a22915e0146962b443d
I20260709 13:08:37.093976 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 5bf6397d6bc54a22915e0146962b443d (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:38.134586 23080 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:38.140898 23045 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2534f3909dce4851918d5cc9a252f085. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.142320 22997 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.144043 22923 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.144052 23849 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:38.145380 23736 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.153080 23849 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.155102 22925 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.155470 22997 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.170408 22829 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.173555 23080 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:38.183557 23045 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 387a947805334b78b3ac130dee5e4d40. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.183773 22925 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.183938 22997 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.185246 23849 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:38.186316 23813 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.203647 23849 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.211170 22923 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.212641 22997 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.216641 22925 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:38.232826 23076 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.234148 23827 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.235919 23005 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:38.236071 22896 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eccda721d3ee4ac79479134d323b9640. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.237222 23827 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.232980 22826 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.243328 23848 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.263984 23080 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.264647 23076 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:38.272535 22827 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.275779 22997 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.289588 22923 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.291839 23813 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.292586 22999 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.293727 23736 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:38.296941 23045 consensus_peers.cc:597] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9d4f6ae66214bcb808947c251df9862. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.316424 23813 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.318238 22999 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.318831 22923 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:38.333686 22826 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.561890 23867 ts_tablet_manager.cc:933] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:38.564066 23867 tablet_copy_client.cc:323] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:38.566167 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 2534f3909dce4851918d5cc9a252f085 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:38.566677 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 2534f3909dce4851918d5cc9a252f085 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-2534f3909dce4851918d5cc9a252f085
I20260709 13:08:38.572849 23090 tablet_copy_source_session.cc:215] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:38.576462 23867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2534f3909dce4851918d5cc9a252f085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:38.586874 23867 tablet_copy_client.cc:806] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:38.587620 23867 tablet_copy_client.cc:670] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:38.590974 23867 tablet_copy_client.cc:538] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:38.596891 23867 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:38.614096 23867 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:38.614902 23867 tablet_bootstrap.cc:492] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:38.618652 23867 ts_tablet_manager.cc:1403] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:08:38.621400 23867 raft_consensus.cc:359] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:38.622169 23867 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:38.622771 23867 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:38.625974 23867 ts_tablet_manager.cc:1434] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:38.630039 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-2534f3909dce4851918d5cc9a252f085 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:38.630426 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-2534f3909dce4851918d5cc9a252f085 on tablet 2534f3909dce4851918d5cc9a252f085 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:38.656014 23867 ts_tablet_manager.cc:933] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:38.662786 23867 tablet_copy_client.cc:323] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:38.665899 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 387a947805334b78b3ac130dee5e4d40 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:38.666432 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 387a947805334b78b3ac130dee5e4d40 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-387a947805334b78b3ac130dee5e4d40
I20260709 13:08:38.749143 23090 tablet_copy_source_session.cc:215] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:38.752645 23872 ts_tablet_manager.cc:933] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:38.768288 23872 tablet_copy_client.cc:323] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
W20260709 13:08:39.588438 23044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.000s	sys 0.008s
W20260709 13:08:39.588953 23044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.000s	sys 0.008s
W20260709 13:08:39.663561 23046 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.006s	sys 0.005s
W20260709 13:08:39.664179 23046 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.006s	sys 0.005s
W20260709 13:08:39.665467 22894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.006s	sys 0.005s
W20260709 13:08:39.665932 22894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.006s	sys 0.005s
I20260709 13:08:39.722708 23870 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:39.723374 23870 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:39.729295 23870 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:39.731621 23870 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:39.732131 23870 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:39.733932 23870 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:39.735751 23736 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:39.736276 23874 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:39.736378 23736 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.736889 23874 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.738278 23736 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:39.738878 23867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387a947805334b78b3ac130dee5e4d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:39.740025 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:39.741823 23874 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:39.768970 22896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.001s	sys 0.012s
W20260709 13:08:39.769341 22896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.001s	sys 0.012s
I20260709 13:08:39.774802 23888 ts_tablet_manager.cc:933] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:39.780239 23736 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:39.780699 23736 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.784451 23736 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:08:39.784927 22952 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7f80 after lost signal to thread 21778
W20260709 13:08:39.795879 22952 debug-util.cc:398] Leaking SignalData structure 0x7b080019a140 after lost signal to thread 22863
I20260709 13:08:39.797497 23849 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:39.798003 23849 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.801626 23654 raft_consensus.cc:1217] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:39.801801 23867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47784 (request call id 26) took 1155 ms. Trace:
I20260709 13:08:39.783028 23882 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:08:39.815330 22952 debug-util.cc:398] Leaking SignalData structure 0x7b08001977a0 after lost signal to thread 22955
I20260709 13:08:39.819581 23881 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:08:39.820595 22952 debug-util.cc:398] Leaking SignalData structure 0x7b0800326420 after lost signal to thread 23030
I20260709 13:08:39.824707 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet f9d4f6ae66214bcb808947c251df9862 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:39.825342 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:39.833575 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:39.841285 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:08:39.842522 22952 debug-util.cc:398] Leaking SignalData structure 0x7b080028e980 after lost signal to thread 23104
I20260709 13:08:39.845782 23870 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.846766 23885 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:39.847349 23885 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.850428 23885 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:39.851748 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:39.852173 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.005s	sys 0.007s
W20260709 13:08:39.852607 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.006s	sys 0.008s
W20260709 13:08:39.853610 22952 debug-util.cc:398] Leaking SignalData structure 0x7b080027bbc0 after lost signal to thread 23681
W20260709 13:08:39.854001 22952 debug-util.cc:398] Leaking SignalData structure 0x7b080031b000 after lost signal to thread 23682
W20260709 13:08:39.854355 22972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.005s	sys 0.010s
I20260709 13:08:39.830842 23849 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:39.922645 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:39.914172 23813 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:39.923748 23813 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.910641 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 778) took 1100 ms. Trace:
I20260709 13:08:39.820151 23881 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:39.927313 23881 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:39.911324 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet f9d4f6ae66214bcb808947c251df9862 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-f9d4f6ae66214bcb808947c251df9862
I20260709 13:08:39.824321 23882 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.913439 22827 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 45) took 1191 ms. Trace:
I20260709 13:08:39.914407 23736 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:08:39.915446 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 71042us
I20260709 13:08:39.802280 23867 rpcz_store.cc:276] 0709 13:08:38.646371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.646512 (+   141us) service_pool.cc:224] Handling call
0709 13:08:38.656373 (+  9861us) ts_tablet_manager.cc:934] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
0709 13:08:39.737747 (+1081374us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:39.793494 (+ 55747us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:39.793605 (+   111us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:39.801139 (+  7534us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:39.801392 (+   253us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:39.801661 (+   269us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:39.801715 (+    54us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":178,"tablet-copy.queue_time_us":9041,"thread_start_us":5661,"threads_started":1}
I20260709 13:08:39.933606 22923 rpcz_store.cc:276] 0709 13:08:38.716694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.816072 (+1099378us) service_pool.cc:224] Handling call
0709 13:08:39.816295 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.816424 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.816449 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.816481 (+    32us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:39.816508 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.816554 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.816649 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:39.937829 23736 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.937522 22827 rpcz_store.cc:276] 0709 13:08:38.640201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.640326 (+   125us) service_pool.cc:224] Handling call
0709 13:08:39.831535 (+1191209us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260709 13:08:39.951092 22897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.013s	sys 0.002s
I20260709 13:08:39.951891 23863 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:39.952577 23863 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:39.955243 23863 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:08:39.951501 22897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.014s	sys 0.003s
I20260709 13:08:39.957263 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:39.961617 23886 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:39.962427 23736 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:39.962172 23886 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:39.966032 23886 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:39.966670 23813 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:39.970067 23882 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:39.970649 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:39.971536 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:08:39.971752 23877 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:39.972294 23877 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:39.974682 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:39.968837 23867 tablet_copy_client.cc:806] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:39.977698 23889 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:39.982962 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:39.983839 22922 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:39.991945 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:39.992018 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:39.997239 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:39.998039 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:39.999508 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.002583 23090 tablet_copy_source_session.cc:215] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:40.008030 23875 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.008562 23875 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.012476 23875 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.016240 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.017086 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:40.018647 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 50607.1us
I20260709 13:08:39.998449 23867 tablet_copy_client.cc:670] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:40.022420 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.019013 23622 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.028308 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.029194 23870 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.040315 23872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d4f6ae66214bcb808947c251df9862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:40.034467 23888 tablet_copy_client.cc:323] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:40.009117 23889 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.043112 23884 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:40.043612 23884 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.045750 23889 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.049885 23867 tablet_copy_client.cc:538] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:40.049808 23880 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.052378 23877 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:40.052924 23880 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.056680 23884 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.057354 23880 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.064919 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:08:40.065322 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 46336.6us
W20260709 13:08:40.067462 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 73995.8us
I20260709 13:08:40.084903 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.085137 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.090433 22972 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:40.097074 23878 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.095413 23874 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.097729 23874 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.098153 23874 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.097786 23878 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.108351 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.094216 23891 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.093622 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet eccda721d3ee4ac79479134d323b9640 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:40.116181 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.116467 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.117189 23867 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:40.119915 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.122459 23892 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.118909 23891 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.119685 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet eccda721d3ee4ac79479134d323b9640 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-eccda721d3ee4ac79479134d323b9640
I20260709 13:08:40.122928 23892 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.125310 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:08:40.115556 23848 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.136732 22970 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:08:40.137966 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 65126.2us
I20260709 13:08:40.138032 23822 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:08:40.142584 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.144981 23822 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.147011 23822 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.134526 23848 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.156505 23848 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.156582 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.157171 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.157691 22924 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:08:40.159003 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.154203 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:40.161327 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.161697 23878 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.162220 23901 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.169664 23892 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.168058 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.173115 23877 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.173524 23896 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.173844 23891 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.194212 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.194790 22972 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:40.199397 23901 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.199826 23901 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:40.200205 23901 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.200073 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.203280 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.207993 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.180317 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.186568 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.178576 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.212282 22972 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.215186 23874 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.215890 23822 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.217322 23874 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.217901 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:40.218444 22931 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.224880 22941 tablet_copy_source_session.cc:215] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:40.226456 22931 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:40.227895 22972 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:40.229986 23874 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.230784 23888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccda721d3ee4ac79479134d323b9640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:40.231237 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.232999 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.236397 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.192950 23896 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.240217 23877 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:08:40.244514 23877 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.245548 23872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47784 (request call id 27) took 1523 ms. Trace:
I20260709 13:08:40.241020 22896 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.231143 23874 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:40.247689 23874 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.251363 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.251906 23827 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.252370 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.253175 23827 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.253539 23877 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:40.254060 23895 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.255280 22896 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.255900 23901 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.256341 23827 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.258198 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.268680 23891 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.266440 22896 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.245985 23872 rpcz_store.cc:276] 0709 13:08:38.722517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.722657 (+   140us) service_pool.cc:224] Handling call
0709 13:08:38.753017 (+ 30360us) ts_tablet_manager.cc:934] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
0709 13:08:40.031219 (+1278202us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:40.091777 (+ 60558us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:40.091884 (+   107us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:40.244919 (+153035us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:40.245174 (+   255us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:40.245440 (+   266us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:40.245495 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":235,"tablet-copy.queue_time_us":28971,"thread_start_us":41811,"threads_started":2}
I20260709 13:08:40.275561 23901 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.277232 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.277853 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.278303 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.275362 23872 tablet_copy_client.cc:806] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:40.276153 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:40.275597 22926 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.308328 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:40.280058 23827 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.282141 23046 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:40.291563 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.292400 23896 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:40.298249 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:40.303227 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:40.313057 23892 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.314639 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.315302 23046 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:40.315898 23872 tablet_copy_client.cc:670] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:40.316128 22896 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.317153 23046 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:40.319763 23827 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.325994 23877 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.328321 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.329654 23887 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.328886 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.325400 23892 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.336591 23863 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.338757 23879 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.341194 23003 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.352016 23888 tablet_copy_client.cc:806] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:40.352649 23879 raft_consensus.cc:1064] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:40.355973 23879 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:40.359339 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:40.360718 23736 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.361896 23046 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:40.362578 23736 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.364269 23046 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:40.366107 23736 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.372536 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:40.379295 23898 consensus_queue.cc:1059] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:08:40.384552 23872 tablet_copy_client.cc:538] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:40.365409 23888 tablet_copy_client.cc:670] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:40.396823 23736 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.397359 23736 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:40.400812 23736 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.401985 23736 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.404762 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:40.406034 22896 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.407096 23891 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.408380 23888 tablet_copy_client.cc:538] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:40.411044 22827 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.428368 23000 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.439049 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:40.440120 23886 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.440698 23886 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.445129 23886 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.445569 23886 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:40.446557 23886 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:40.454805 23872 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:40.459249 23886 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.463876 23657 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.466152 23887 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.492516 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:08:40.498960 23888 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:40.501296 22922 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.500442 23901 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.503219 23736 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.521596 23867 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:40.522323 23867 tablet_bootstrap.cc:492] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:40.522876 23867 ts_tablet_manager.cc:1403] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.406s	user 0.020s	sys 0.010s
I20260709 13:08:40.534978 22999 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.536391 23886 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.531410 23867 raft_consensus.cc:359] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:40.542306 23867 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:40.543282 23867 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:40.564678 23886 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.573143 23867 ts_tablet_manager.cc:1434] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 13:08:40.581039 22922 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.581720 23000 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.620863 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-387a947805334b78b3ac130dee5e4d40 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:40.621349 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-387a947805334b78b3ac130dee5e4d40 on tablet 387a947805334b78b3ac130dee5e4d40 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:40.625079 23657 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.635254 22829 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.647101 23872 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:40.650125 23872 tablet_bootstrap.cc:492] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:40.650902 23872 ts_tablet_manager.cc:1403] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.208s	user 0.014s	sys 0.010s
I20260709 13:08:40.668313 23872 raft_consensus.cc:359] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:40.669250 23872 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:40.669968 23872 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:40.681072 23872 ts_tablet_manager.cc:1434] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:08:40.686535 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-f9d4f6ae66214bcb808947c251df9862 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:40.686954 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-f9d4f6ae66214bcb808947c251df9862 on tablet f9d4f6ae66214bcb808947c251df9862 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:40.704767 23076 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:40.712651 23654 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.716434 23886 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.719316 23076 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:40.720614 23874 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.720845 22922 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.722314 23888 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:40.733775 23886 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.750984 23849 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.761518 23656 raft_consensus.cc:1217] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:40.761133 23654 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.769075 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2534f3909dce4851918d5cc9a252f085 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:40.774477 23888 tablet_bootstrap.cc:492] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:40.784094 23888 ts_tablet_manager.cc:1403] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.285s	user 0.028s	sys 0.011s
I20260709 13:08:40.787410 23888 raft_consensus.cc:359] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:40.788144 22922 raft_consensus.cc:2955] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.791442 23888 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:40.802105 23888 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:40.817198 22829 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:40.823174 23888 ts_tablet_manager.cc:1434] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:08:40.832466 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-eccda721d3ee4ac79479134d323b9640 received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:40.832930 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-eccda721d3ee4ac79479134d323b9640 on tablet eccda721d3ee4ac79479134d323b9640 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:40.834399 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 2534f3909dce4851918d5cc9a252f085 with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:40.864409 22928 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:40.872490 23921 tablet_replica.cc:333] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:40.873520 23921 raft_consensus.cc:2243] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.874228 23921 raft_consensus.cc:2272] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.884778 23822 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.885262 23921 ts_tablet_manager.cc:1916] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:40.917677 23921 ts_tablet_manager.cc:1929] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:40.918072 23921 log.cc:1199] T 2534f3909dce4851918d5cc9a252f085 P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/2534f3909dce4851918d5cc9a252f085
I20260709 13:08:40.951367 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 2534f3909dce4851918d5cc9a252f085 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:40.974053 23654 raft_consensus.cc:1217] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:41.060045 23654 raft_consensus.cc:1217] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:41.363835 23886 raft_consensus.cc:1064] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:41.366830 23886 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:41.388450 23654 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.391731 23886 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.398487 23003 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.400972 22922 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.409070 23879 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:08:41.414359 23877 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:41.425772 23813 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.432814 22928 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.457890 23000 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.466876 23654 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.480676 22829 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.505184 23863 raft_consensus.cc:1064] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:41.507337 23877 raft_consensus.cc:1064] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:41.507735 23863 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:41.510222 23877 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:41.530030 23654 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.533046 23886 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.536302 23000 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.541505 23656 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.543071 23074 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.543179 23882 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:41.544256 23000 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.545482 23878 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:41.547371 23930 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:41.547727 23886 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.556267 22928 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.573626 23886 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.574160 23930 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.581352 23657 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.592437 22999 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.596683 22827 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.599681 23813 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.615581 22922 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:41.616643 23657 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.629681 23076 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:41.634802 23000 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.642546 22826 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.647001 23657 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:41.647902 23000 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:41.648212 23879 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:41.649346 23736 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:41.657552 23657 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:41.661096 23736 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.665907 23930 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:41.674657 22922 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.683300 23000 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.687054 23657 raft_consensus.cc:2955] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.726121 23877 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.726718 23877 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:41.728838 23877 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:41.729806 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9d4f6ae66214bcb808947c251df9862 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:41.731702 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:41.732764 22997 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:41.734210 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:41.734823 23003 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:41.736474 23879 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:41.736866 23879 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.737203 23879 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.742465 23878 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:41.744772 23930 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.749958 23879 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:41.754807 23879 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:41.755245 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:41.755877 23003 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.754565 22999 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.765435 23003 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:08:41.767894 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eccda721d3ee4ac79479134d323b9640 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:41.772267 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:41.772460 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:08:41.772511 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:41.768307 23657 raft_consensus.cc:2955] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.774865 23079 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:41.778577 22826 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.783540 23813 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.787604 23813 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:41.788532 23813 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:41.786302 22828 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.791826 22928 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:41.800333 23877 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:41.786826 23657 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:41.806082 23879 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:41.809267 23886 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.817889 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet f9d4f6ae66214bcb808947c251df9862 with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:41.822404 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 387a947805334b78b3ac130dee5e4d40 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:41.820140 23943 tablet_replica.cc:333] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:41.823453 22928 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.828874 23943 raft_consensus.cc:2243] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.829743 23943 raft_consensus.cc:2272] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.835017 23943 ts_tablet_manager.cc:1916] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:41.836265 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet eccda721d3ee4ac79479134d323b9640 with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:41.843195 22827 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.846001 23657 raft_consensus.cc:2955] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:41.860324 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 387a947805334b78b3ac130dee5e4d40 with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:41.868455 23945 tablet_replica.cc:333] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:41.875123 23943 ts_tablet_manager.cc:1929] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:41.877346 23945 raft_consensus.cc:2243] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.881430 23944 tablet_replica.cc:333] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:41.883867 23931 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:08:41.887883 23931 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:41.888572 23944 raft_consensus.cc:2243] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.889279 23944 pending_rounds.cc:70] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Trying to abort 1 pending ops.
I20260709 13:08:41.890128 23931 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:41.889612 23944 pending_rounds.cc:77] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635928089890816 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "eccda721d3ee4ac79479134d323b9640" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } } }
I20260709 13:08:41.891005 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:08:41.891072 23944 raft_consensus.cc:2917] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:08:41.891786 23944 raft_consensus.cc:2889] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:41.892248 23944 raft_consensus.cc:2272] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.892722 23945 raft_consensus.cc:2272] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.886132 23943 log.cc:1199] T f9d4f6ae66214bcb808947c251df9862 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/f9d4f6ae66214bcb808947c251df9862
I20260709 13:08:41.898732 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:08:41.899392 23000 raft_consensus.cc:2368] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3.
I20260709 13:08:41.900638 22896 leader_election.cc:400] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3.
I20260709 13:08:41.902580 22896 leader_election.cc:403] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.903486 23931 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.904109 23945 ts_tablet_manager.cc:1916] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:41.900219 22826 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.914103 23931 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3.
I20260709 13:08:41.915119 23944 ts_tablet_manager.cc:1916] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:41.916512 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet f9d4f6ae66214bcb808947c251df9862 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:41.935218 23944 ts_tablet_manager.cc:1929] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:41.935349 23945 ts_tablet_manager.cc:1929] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:41.935801 23944 log.cc:1199] T eccda721d3ee4ac79479134d323b9640 P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/eccda721d3ee4ac79479134d323b9640
I20260709 13:08:41.935988 23945 log.cc:1199] T 387a947805334b78b3ac130dee5e4d40 P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/387a947805334b78b3ac130dee5e4d40
I20260709 13:08:41.937574 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 387a947805334b78b3ac130dee5e4d40 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:41.937902 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet eccda721d3ee4ac79479134d323b9640 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:42.275161 22999 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:42.276494 23879 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:42.308279 22928 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:42.323221 23877 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:42.984966 22999 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:42.995460 22971 consensus_peers.cc:597] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f3bed822a364ea9afe4d449542afc6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.998363 22922 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:42.998356 23074 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.001240 23902 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.002209 23822 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.024744 23951 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.028321 22922 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.037797 23074 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.048375 22826 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.054942 22928 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:43.076186 22896 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce98d2857d3f449c8d9052124b418f8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:43.078600 23074 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.082319 23000 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.082296 23878 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.086889 23878 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.092890 23878 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.098558 23000 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.107782 23074 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.122990 22827 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.128820 23079 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:43.160540 23045 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f56c90b2fb06459db835049dbf5a060d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:43.160552 23000 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.160985 22922 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.165359 23736 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.167062 23736 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.186856 23877 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.193249 22999 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.201278 22928 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.214494 22827 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.223731 23079 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:43.234803 23045 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a642095ff8a4146b8e977c3af22c826. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:43.235291 22922 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.236291 22999 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.236680 23952 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.237659 23877 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.249114 23952 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.254240 22928 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.262359 22999 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.268369 22827 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:43.426512 23972 ts_tablet_manager.cc:933] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:43.431768 23972 tablet_copy_client.cc:323] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:43.434186 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 8f3bed822a364ea9afe4d449542afc6b from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:43.434872 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 8f3bed822a364ea9afe4d449542afc6b from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-8f3bed822a364ea9afe4d449542afc6b
I20260709 13:08:43.445729 23016 tablet_copy_source_session.cc:215] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:43.450922 23972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3bed822a364ea9afe4d449542afc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.475055 23972 tablet_copy_client.cc:806] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:43.475934 23972 tablet_copy_client.cc:670] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:43.481146 23972 tablet_copy_client.cc:538] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:43.492129 23972 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:43.526437 23972 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:43.527691 23972 tablet_bootstrap.cc:492] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:43.528409 23972 ts_tablet_manager.cc:1403] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.012s
I20260709 13:08:43.531342 23972 raft_consensus.cc:359] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:43.532209 23972 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:43.532905 23972 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:43.545888 23972 ts_tablet_manager.cc:1434] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.011s
I20260709 13:08:43.565308 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-8f3bed822a364ea9afe4d449542afc6b received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:43.565783 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-8f3bed822a364ea9afe4d449542afc6b on tablet 8f3bed822a364ea9afe4d449542afc6b with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:43.573104 23972 ts_tablet_manager.cc:933] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:43.599642 23972 tablet_copy_client.cc:323] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:43.624106 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet ce98d2857d3f449c8d9052124b418f8c from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:43.624645 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet ce98d2857d3f449c8d9052124b418f8c from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-ce98d2857d3f449c8d9052124b418f8c
I20260709 13:08:43.632356 23975 ts_tablet_manager.cc:933] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:43.633680 22941 tablet_copy_source_session.cc:215] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:43.637176 23972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce98d2857d3f449c8d9052124b418f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.640064 23975 tablet_copy_client.cc:323] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:43.642455 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet f56c90b2fb06459db835049dbf5a060d from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:43.642958 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet f56c90b2fb06459db835049dbf5a060d from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-f56c90b2fb06459db835049dbf5a060d
I20260709 13:08:43.654476 23090 tablet_copy_source_session.cc:215] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:43.659118 23975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56c90b2fb06459db835049dbf5a060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.663409 23972 tablet_copy_client.cc:806] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:43.664317 23972 tablet_copy_client.cc:670] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:43.676129 23972 tablet_copy_client.cc:538] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:43.685787 23972 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:43.711597 23972 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:43.712656 23972 tablet_bootstrap.cc:492] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:43.713395 23972 ts_tablet_manager.cc:1403] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.005s
I20260709 13:08:43.720557 23972 raft_consensus.cc:359] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:43.721429 23972 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:43.722117 23972 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:43.725124 23972 ts_tablet_manager.cc:1434] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:43.726771 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-ce98d2857d3f449c8d9052124b418f8c received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:43.727182 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-ce98d2857d3f449c8d9052124b418f8c on tablet ce98d2857d3f449c8d9052124b418f8c with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:43.728878 23975 tablet_copy_client.cc:806] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:43.729532 23975 tablet_copy_client.cc:670] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:43.738678 23975 tablet_copy_client.cc:538] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:43.753624 23975 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:43.760177 23972 ts_tablet_manager.cc:933] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:43.768347 23972 tablet_copy_client.cc:323] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:43.770025 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 1a642095ff8a4146b8e977c3af22c826 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:43.770525 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 1a642095ff8a4146b8e977c3af22c826 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-1a642095ff8a4146b8e977c3af22c826
I20260709 13:08:43.778120 23090 tablet_copy_source_session.cc:215] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:43.781893 23972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a642095ff8a4146b8e977c3af22c826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.786957 23975 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:43.787914 23975 tablet_bootstrap.cc:492] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:43.788575 23975 ts_tablet_manager.cc:1403] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.003s
I20260709 13:08:43.791467 23975 raft_consensus.cc:359] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:43.792339 23975 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:43.793038 23975 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:43.795732 23975 ts_tablet_manager.cc:1434] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:43.807789 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-f56c90b2fb06459db835049dbf5a060d received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:43.808233 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-f56c90b2fb06459db835049dbf5a060d on tablet f56c90b2fb06459db835049dbf5a060d with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:43.808936 23972 tablet_copy_client.cc:806] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:43.810168 23972 tablet_copy_client.cc:670] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:43.813408 23972 tablet_copy_client.cc:538] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:43.819195 23972 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:43.871351 23972 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:43.872378 23972 tablet_bootstrap.cc:492] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:43.873202 23972 ts_tablet_manager.cc:1403] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.003s
I20260709 13:08:43.922024 23972 raft_consensus.cc:359] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:43.925413 23972 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:43.926156 23972 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:43.924382 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51919.2us
I20260709 13:08:43.937258 23972 ts_tablet_manager.cc:1434] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.001s
I20260709 13:08:43.949697 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-1a642095ff8a4146b8e977c3af22c826 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:43.950163 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-1a642095ff8a4146b8e977c3af22c826 on tablet 1a642095ff8a4146b8e977c3af22c826 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:43.953018 23654 raft_consensus.cc:1217] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:44.080694 23654 raft_consensus.cc:1217] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:44.161144 23657 raft_consensus.cc:1217] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:44.213950 23654 raft_consensus.cc:1217] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:44.414795 23876 raft_consensus.cc:1064] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:44.417331 23876 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:44.431067 23657 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.434698 23979 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.435139 23079 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.437565 22928 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.439292 23979 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.445617 23979 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:44.498409 23876 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.512218 23079 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.533514 22826 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.538571 22928 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.541411 23657 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.619319 23000 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:44.646435 23654 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:44.648725 23074 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:44.651010 23979 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:44.653172 23952 raft_consensus.cc:1064] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:44.654229 23876 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:44.662113 23952 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:44.674474 23930 raft_consensus.cc:1064] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:44.675478 23978 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.677227 23930 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:44.688421 23953 raft_consensus.cc:1064] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:44.692013 23079 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.694564 23953 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:44.704689 23654 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.708245 23000 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.720384 23654 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.722877 23000 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.724570 23953 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.724911 23998 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.726430 23953 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.726660 23998 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.740456 23656 raft_consensus.cc:2955] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.772547 23953 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.774938 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f3bed822a364ea9afe4d449542afc6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:44.780480 23657 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.798620 23998 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.801155 23654 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.802336 23000 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.818425 23003 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.840745 22827 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.856340 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f3bed822a364ea9afe4d449542afc6b with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:44.858898 22924 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.859109 22922 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.870795 23657 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.872325 23954 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:44.876856 24004 tablet_replica.cc:333] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:44.876533 22829 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.878165 24004 raft_consensus.cc:2243] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:44.878911 24004 raft_consensus.cc:2272] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:44.882681 22999 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.884729 23954 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.893853 24004 ts_tablet_manager.cc:1916] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:44.893678 23996 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.881480 22827 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.918568 24004 ts_tablet_manager.cc:1929] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:44.919070 24004 log.cc:1199] T 8f3bed822a364ea9afe4d449542afc6b P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/8f3bed822a364ea9afe4d449542afc6b
I20260709 13:08:44.920742 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 8f3bed822a364ea9afe4d449542afc6b (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:44.927191 23953 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.942005 23985 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.944772 23079 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:44.959615 23000 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:44.963057 23954 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.010131 22922 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.033454 22829 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.015389 22929 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.043337 23079 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.082089 23654 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.108013 22928 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:45.122051 23654 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.121932 23000 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.125814 23985 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.127998 23985 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.144327 23965 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.148627 23654 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.154218 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce98d2857d3f449c8d9052124b418f8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:45.152211 23000 raft_consensus.cc:2955] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.162415 22827 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.183435 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet ce98d2857d3f449c8d9052124b418f8c with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:45.222201 24013 tablet_replica.cc:333] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:45.226367 24013 raft_consensus.cc:2243] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:45.226995 24013 raft_consensus.cc:2272] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:45.229660 24013 ts_tablet_manager.cc:1916] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:45.247247 24013 ts_tablet_manager.cc:1929] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:45.247723 24013 log.cc:1199] T ce98d2857d3f449c8d9052124b418f8c P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/ce98d2857d3f449c8d9052124b418f8c
I20260709 13:08:45.249402 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet ce98d2857d3f449c8d9052124b418f8c (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:45.339104 23079 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:45.344867 23654 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.345561 22928 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.346319 23995 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.349152 23996 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.354251 23953 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.356292 23654 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.365890 22928 raft_consensus.cc:2955] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.371382 22827 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.387494 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f56c90b2fb06459db835049dbf5a060d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:45.400506 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet f56c90b2fb06459db835049dbf5a060d with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:45.459833 24016 tablet_replica.cc:333] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
W20260709 13:08:45.460399 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 69326.2us
I20260709 13:08:45.469841 24016 raft_consensus.cc:2243] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:45.470690 24016 raft_consensus.cc:2272] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:45.478246 24016 ts_tablet_manager.cc:1916] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:45.502717 23076 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:45.508415 23654 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.510015 23995 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.517093 23998 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.526017 24016 ts_tablet_manager.cc:1929] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:45.526538 24016 log.cc:1199] T f56c90b2fb06459db835049dbf5a060d P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/f56c90b2fb06459db835049dbf5a060d
I20260709 13:08:45.528177 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet f56c90b2fb06459db835049dbf5a060d (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:45.532892 22928 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.533480 23654 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.540382 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a642095ff8a4146b8e977c3af22c826 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:45.545701 22826 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.565182 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a642095ff8a4146b8e977c3af22c826 with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:45.566098 24016 tablet_replica.cc:333] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:45.571050 23995 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.577498 22928 raft_consensus.cc:2955] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:45.589172 24016 raft_consensus.cc:2243] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:45.589931 24016 raft_consensus.cc:2272] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:45.601418 24016 ts_tablet_manager.cc:1916] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:45.622663 24016 ts_tablet_manager.cc:1929] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:45.623157 24016 log.cc:1199] T 1a642095ff8a4146b8e977c3af22c826 P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/1a642095ff8a4146b8e977c3af22c826
I20260709 13:08:45.624904 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 1a642095ff8a4146b8e977c3af22c826 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:46.625679 22928 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:46.631744 23079 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:46.632194 23000 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:46.632977 22896 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71491ce9117b44a08c83b84589d0ba9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.633033 24018 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:46.634124 24012 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.641999 24011 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.643914 23076 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.649117 23003 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.657585 23079 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:46.664446 22826 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.682823 22928 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:46.682886 23045 consensus_peers.cc:597] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c18ae3a17d947e8b70820e473626cb8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.683176 22999 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:46.684564 23995 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.685401 24026 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.702265 23996 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.704157 22928 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.708424 22999 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.715123 23003 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:46.719918 22829 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:46.728274 22971 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20adeb7c99154724bd868029eb5ed0df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.728503 23079 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:46.729342 22928 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:46.729892 24017 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.730795 24019 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.743582 24017 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.745525 23079 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.746992 22928 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.758121 23003 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:46.763121 22827 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.783757 23079 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:46.784801 22971 consensus_peers.cc:597] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: defec66b69804f8c85671fbdd904172d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.784914 23979 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.787343 22929 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:46.788893 24017 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.801564 24017 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.803095 23079 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:46.820758 22829 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.825009 22929 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:47.139117 24037 ts_tablet_manager.cc:933] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:47.140990 24037 tablet_copy_client.cc:323] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:47.142550 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet 71491ce9117b44a08c83b84589d0ba9d from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:47.143031 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet 71491ce9117b44a08c83b84589d0ba9d from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-71491ce9117b44a08c83b84589d0ba9d
I20260709 13:08:47.148425 22941 tablet_copy_source_session.cc:215] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:47.151515 24037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71491ce9117b44a08c83b84589d0ba9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.167817 24039 ts_tablet_manager.cc:933] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:47.168454 24037 tablet_copy_client.cc:806] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:47.169124 24037 tablet_copy_client.cc:670] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.170469 24039 tablet_copy_client.cc:323] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:47.176803 24037 tablet_copy_client.cc:538] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:47.179632 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet defec66b69804f8c85671fbdd904172d from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:47.180248 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet defec66b69804f8c85671fbdd904172d from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-defec66b69804f8c85671fbdd904172d
I20260709 13:08:47.185515 24037 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:47.187213 23016 tablet_copy_source_session.cc:215] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:47.190770 24039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defec66b69804f8c85671fbdd904172d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.210430 24039 tablet_copy_client.cc:806] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:47.210956 24039 tablet_copy_client.cc:670] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.212608 24037 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.213438 24037 tablet_bootstrap.cc:492] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:47.214099 24037 ts_tablet_manager.cc:1403] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 13:08:47.214581 24039 tablet_copy_client.cc:538] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:47.217097 24037 raft_consensus.cc:359] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.217923 24037 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:47.218588 24037 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.228766 24039 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:47.237494 24037 ts_tablet_manager.cc:1434] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.023s	user 0.017s	sys 0.008s
I20260709 13:08:47.239622 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-71491ce9117b44a08c83b84589d0ba9d received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:47.243396 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-71491ce9117b44a08c83b84589d0ba9d on tablet 71491ce9117b44a08c83b84589d0ba9d with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:47.253153 24043 ts_tablet_manager.cc:933] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:47.255532 24043 tablet_copy_client.cc:323] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:47.258245 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 6c18ae3a17d947e8b70820e473626cb8 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:47.258741 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 6c18ae3a17d947e8b70820e473626cb8 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-6c18ae3a17d947e8b70820e473626cb8
I20260709 13:08:47.263935 24039 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.264678 24039 tablet_bootstrap.cc:492] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:47.265230 24039 ts_tablet_manager.cc:1403] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.000s
I20260709 13:08:47.266187 23090 tablet_copy_source_session.cc:215] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:47.267532 24039 raft_consensus.cc:359] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.268285 24039 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:47.269222 24043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18ae3a17d947e8b70820e473626cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.268889 24039 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.271445 24039 ts_tablet_manager.cc:1434] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:47.273528 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-defec66b69804f8c85671fbdd904172d received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:47.273924 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-defec66b69804f8c85671fbdd904172d on tablet defec66b69804f8c85671fbdd904172d with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:47.297951 24043 tablet_copy_client.cc:806] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:47.298494 24043 tablet_copy_client.cc:670] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.300406 24039 ts_tablet_manager.cc:933] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:47.302006 24039 tablet_copy_client.cc:323] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:47.302372 24043 tablet_copy_client.cc:538] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:47.303542 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 20adeb7c99154724bd868029eb5ed0df from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:47.304061 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 20adeb7c99154724bd868029eb5ed0df from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-20adeb7c99154724bd868029eb5ed0df
I20260709 13:08:47.309679 23016 tablet_copy_source_session.cc:215] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:47.311051 24043 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:47.312282 24039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20adeb7c99154724bd868029eb5ed0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.352643 24039 tablet_copy_client.cc:806] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:47.353227 24039 tablet_copy_client.cc:670] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.356961 24039 tablet_copy_client.cc:538] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:47.358958 24043 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.359841 24043 tablet_bootstrap.cc:492] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:47.360462 24043 ts_tablet_manager.cc:1403] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.050s	user 0.035s	sys 0.016s
I20260709 13:08:47.363327 24043 raft_consensus.cc:359] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.364125 24043 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:47.364722 24043 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.367458 24039 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:47.373288 24043 ts_tablet_manager.cc:1434] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:47.382543 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-6c18ae3a17d947e8b70820e473626cb8 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:47.383024 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-6c18ae3a17d947e8b70820e473626cb8 on tablet 6c18ae3a17d947e8b70820e473626cb8 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:47.393993 24039 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.394901 24039 tablet_bootstrap.cc:492] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:47.395526 24039 ts_tablet_manager.cc:1403] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 13:08:47.398289 24039 raft_consensus.cc:359] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.399087 24039 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:47.399686 24039 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:47.404171 24039 ts_tablet_manager.cc:1434] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:47.405719 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-20adeb7c99154724bd868029eb5ed0df received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:47.406117 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-20adeb7c99154724bd868029eb5ed0df on tablet 20adeb7c99154724bd868029eb5ed0df with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:47.623843 23657 raft_consensus.cc:1217] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:47.663019 23657 raft_consensus.cc:1217] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:47.724174 23657 raft_consensus.cc:1217] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:47.881886 23657 raft_consensus.cc:1217] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:48.051887 24051 raft_consensus.cc:1064] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:48.054422 24051 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.062129 23657 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.064384 24050 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.066259 23003 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.069041 24026 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.070103 22929 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.072916 23996 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.093561 24026 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.097203 23003 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.097385 23657 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.107429 22929 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.115038 22829 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.146184 23074 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.158725 23003 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.159060 23654 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.160797 24026 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:48.161899 24051 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.171044 23996 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.174335 23003 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.177547 23654 raft_consensus.cc:2955] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.184168 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c18ae3a17d947e8b70820e473626cb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:48.192013 22827 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.193313 24019 raft_consensus.cc:1064] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:48.195756 24019 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.206326 23657 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.208343 23979 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.208685 22929 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.210403 24017 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:48.211022 23074 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.212805 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c18ae3a17d947e8b70820e473626cb8 with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:48.214571 24061 tablet_replica.cc:333] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:48.215425 23979 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.215708 24061 raft_consensus.cc:2243] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:48.218011 24061 raft_consensus.cc:2272] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:48.234123 24061 ts_tablet_manager.cc:1916] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:48.247282 23979 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.251816 23074 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.255402 23657 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.261353 22929 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.280184 22827 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.287554 24049 raft_consensus.cc:1064] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:48.288514 24061 ts_tablet_manager.cc:1929] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:48.288904 24061 log.cc:1199] T 6c18ae3a17d947e8b70820e473626cb8 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/6c18ae3a17d947e8b70820e473626cb8
I20260709 13:08:48.290442 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 6c18ae3a17d947e8b70820e473626cb8 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:48.290091 24049 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.303161 23657 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.303611 23003 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.304337 23074 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.305403 24049 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.306532 24011 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.307368 24012 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.313005 23003 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.339532 23079 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.339751 23654 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.341967 23979 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.343621 24017 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.347226 24049 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.351994 23076 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.361990 23979 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.363368 23079 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.372189 23003 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.373190 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet defec66b69804f8c85671fbdd904172d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:48.374608 22826 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.387136 22827 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.397866 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet defec66b69804f8c85671fbdd904172d with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:48.399072 24061 tablet_replica.cc:333] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:48.400345 24061 raft_consensus.cc:2243] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:48.401278 24061 raft_consensus.cc:2272] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:48.404484 24061 ts_tablet_manager.cc:1916] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:48.413450 24068 log.cc:927] Time spent T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:08:48.414333 24062 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.065s	user 0.016s	sys 0.018s
I20260709 13:08:48.417843 23654 raft_consensus.cc:2955] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.427207 23657 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:08:48.446031 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 49487.8us
I20260709 13:08:48.447701 22929 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.457787 23654 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.459426 22999 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.466118 24011 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.470046 24012 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.472110 24061 ts_tablet_manager.cc:1929] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:48.472597 24061 log.cc:1199] T defec66b69804f8c85671fbdd904172d P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/defec66b69804f8c85671fbdd904172d
I20260709 13:08:48.474143 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet defec66b69804f8c85671fbdd904172d (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:48.478897 24012 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.481631 24019 raft_consensus.cc:1064] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:48.480934 23656 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.484043 24019 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.491849 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71491ce9117b44a08c83b84589d0ba9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:48.499986 23003 raft_consensus.cc:2955] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.506335 22829 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.516860 23657 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.518154 24069 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:48.520565 23079 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.524329 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 71491ce9117b44a08c83b84589d0ba9d with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:48.525112 24069 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.535076 22929 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:48.538631 24019 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.548743 24074 tablet_replica.cc:333] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:48.550213 24074 raft_consensus.cc:2243] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:48.550865 24074 raft_consensus.cc:2272] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:48.550724 24069 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.552378 23076 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.559149 24074 ts_tablet_manager.cc:1916] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:48.566345 22929 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.570351 23656 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.576431 22829 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.596298 24074 ts_tablet_manager.cc:1929] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:48.596738 24074 log.cc:1199] T 71491ce9117b44a08c83b84589d0ba9d P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/71491ce9117b44a08c83b84589d0ba9d
I20260709 13:08:48.598290 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 71491ce9117b44a08c83b84589d0ba9d (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:48.601358 23003 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:48.614988 22929 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.615237 23656 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:48.616953 24017 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.618538 24019 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.624919 24017 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.626322 23656 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.638955 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20adeb7c99154724bd868029eb5ed0df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:48.638715 22929 raft_consensus.cc:2955] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.640362 22827 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:48.655519 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 20adeb7c99154724bd868029eb5ed0df with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:48.656383 24074 tablet_replica.cc:333] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:48.657158 24074 raft_consensus.cc:2243] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:48.657765 24074 raft_consensus.cc:2272] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:48.661103 24074 ts_tablet_manager.cc:1916] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:48.674746 24074 ts_tablet_manager.cc:1929] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:48.675105 24074 log.cc:1199] T 20adeb7c99154724bd868029eb5ed0df P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/20adeb7c99154724bd868029eb5ed0df
I20260709 13:08:48.676818 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 20adeb7c99154724bd868029eb5ed0df (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:49.717357 22922 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:49.725476 23003 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:49.725734 22896 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 492dd607be6348c79999243a8383806d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.726650 23074 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:49.726691 24081 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:49.727712 24011 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.735034 24078 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.736743 23074 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.755456 23000 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:49.757431 23003 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.756361 22829 catalog_manager.cc:5697] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.763969 23076 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:49.766736 23979 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:49.767071 22971 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 682d24a2200c4222a401f9ab803af214. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.767446 22922 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:49.769039 24017 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.787599 24069 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.789358 22929 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.800592 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.800889 23076 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.812866 23076 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:49.819080 23003 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:49.819183 22929 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:49.820055 23045 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a155859ea9d41f4a7ccad8246c9c2ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.820627 24026 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.821391 24050 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.831488 24079 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.834077 23003 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.839468 22929 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.852458 22827 catalog_manager.cc:5697] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.855597 23000 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:49.902176 22929 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:49.901858 22826 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:49.902942 22971 consensus_peers.cc:597] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 952ed8a46c5e4f158f63440eb6fbef0a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.904500 24087 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.917955 23074 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:49.925661 24087 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.938485 23979 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.940328 22922 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.959697 22828 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.960517 23074 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:49.974179 22922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:49.974810 22922 raft_consensus.cc:606] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:08:49.977690 22922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:49.978173 22922 raft_consensus.cc:606] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.017088 23074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:50.017632 23074 raft_consensus.cc:606] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:50.033592 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:50.034197 23003 raft_consensus.cc:606] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:50.036806 22929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:50.037289 22929 raft_consensus.cc:606] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.039597 22929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da207091d69d47c2a67b181645327e1c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:50.040112 22929 raft_consensus.cc:606] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.042405 22929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:50.042873 22929 raft_consensus.cc:606] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.043948 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:08:50.045430 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.056281 24078 raft_consensus.cc:993] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.056727 24084 raft_consensus.cc:1081] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.058145 23657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:08:50.058710 23657 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.058961 23657 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.064198 23657 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.066244 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:50.066499 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:50.066802 22929 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.067252 22929 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:50.068186 22929 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.069075 22929 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.070329 24078 raft_consensus.cc:993] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.070806 24011 raft_consensus.cc:1081] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.072420 23656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da207091d69d47c2a67b181645327e1c"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:08:50.072911 23656 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.073228 23656 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.074293 22929 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.067256 23003 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.075626 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:08:50.077180 23657 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:50.081734 23003 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.082808 23656 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.084537 23656 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:50.085446 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:50.085959 23076 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.090029 24103 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:50.090968 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:50.091481 22929 raft_consensus.cc:3055] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.091766 22929 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:50.092404 22929 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.093168 23076 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.093565 22929 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.094700 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:50.100219 24104 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:50.100775 24104 raft_consensus.cc:697] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:50.102286 22929 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.103607 24104 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.112536 24103 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:50.113543 24103 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.121773 24011 raft_consensus.cc:993] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.122295 24011 raft_consensus.cc:1081] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.127369 23657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:08:50.127879 23657 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.128221 23657 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.131179 24108 ts_tablet_manager.cc:933] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:50.139878 24108 tablet_copy_client.cc:323] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:50.141860 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet 492dd607be6348c79999243a8383806d from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:50.142439 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet 492dd607be6348c79999243a8383806d from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-492dd607be6348c79999243a8383806d
I20260709 13:08:50.144552 23657 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.147918 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:50.148435 22929 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.148694 22929 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:50.149333 22929 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.150285 22929 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.153084 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:50.153726 23003 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.156816 22929 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.157805 23622 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:08:50.159538 22941 tablet_copy_source_session.cc:215] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:50.161279 23657 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:50.160398 24103 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:50.162300 24103 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:50.163266 24103 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.163313 22829 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.169571 24108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492dd607be6348c79999243a8383806d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:50.169175 22829 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.164855 23003 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.189574 24108 tablet_copy_client.cc:806] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:50.190228 24108 tablet_copy_client.cc:670] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:50.194739 24108 tablet_copy_client.cc:538] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:50.194694 22828 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.204326 24108 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:50.219111 24069 raft_consensus.cc:993] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:50.219551 24069 raft_consensus.cc:1081] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:50.223282 24011 raft_consensus.cc:993] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.223685 24011 raft_consensus.cc:1081] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:50.224285 22929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:50.224794 22929 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.225126 22929 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.225179 23657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:08:50.225730 23657 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.226040 23657 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.231933 23657 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.232224 22929 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.234323 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:50.234822 22922 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.235100 22922 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:50.235777 22922 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.236743 22922 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.239418 22929 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:50.239786 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:50.240586 23000 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:50.240914 23000 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:50.241641 23000 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.242202 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:50.242815 23074 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.245038 23000 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.251000 23074 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:08:50.251551 24108 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:50.252274 23000 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:08:50.252512 24108 tablet_bootstrap.cc:492] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:50.253283 24108 ts_tablet_manager.cc:1403] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.017s
I20260709 13:08:50.254137 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:50.255774 24078 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:50.256294 24078 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:50.256896 24108 raft_consensus.cc:359] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.257784 24108 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:50.258472 24108 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.261586 24108 ts_tablet_manager.cc:1434] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:50.265472 22922 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.266498 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:08:50.266724 23657 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:50.267845 24103 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:50.267721 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:50.268406 24103 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:50.268803 23074 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.269510 24103 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:50.257237 24078 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.281080 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-492dd607be6348c79999243a8383806d received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:50.281539 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-492dd607be6348c79999243a8383806d on tablet 492dd607be6348c79999243a8383806d with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.289448 23074 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:50.296294 22828 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.301909 24011 raft_consensus.cc:993] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:50.302372 24011 raft_consensus.cc:1081] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:50.304682 23074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:08:50.305146 23074 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.305471 23074 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.318862 23074 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.321712 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:50.321986 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:50.322258 22922 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.322584 23003 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.322600 22922 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:50.323685 22922 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.324844 22922 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.328827 23003 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:50.334537 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:50.334900 23074 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:50.335536 24026 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:50.336056 24026 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:50.336817 24026 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.351802 24050 raft_consensus.cc:993] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:50.352259 24050 raft_consensus.cc:1081] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:50.351938 22828 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 3, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.357501 24108 ts_tablet_manager.cc:933] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:50.361193 22922 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:50.363448 22928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:08:50.364128 22928 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.364516 22928 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.372125 22928 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.373888 22928 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:50.374621 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:50.375160 23003 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.380367 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:50.381048 23074 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.381125 23003 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:50.381412 23074 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:50.382154 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:50.382692 23074 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.383924 24114 ts_tablet_manager.cc:933] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:50.383502 24078 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:50.387933 24078 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:50.390456 24078 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:50.391821 24108 tablet_copy_client.cc:323] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:50.400470 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 682d24a2200c4222a401f9ab803af214 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:50.402009 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 682d24a2200c4222a401f9ab803af214 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-682d24a2200c4222a401f9ab803af214
I20260709 13:08:50.401237 22828 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.410471 23016 tablet_copy_source_session.cc:215] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:50.413801 24108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682d24a2200c4222a401f9ab803af214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:50.392621 23074 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.421392 23074 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:50.425091 24114 tablet_copy_client.cc:323] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:50.426590 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 8a155859ea9d41f4a7ccad8246c9c2ba from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:50.427091 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 8a155859ea9d41f4a7ccad8246c9c2ba from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-8a155859ea9d41f4a7ccad8246c9c2ba
I20260709 13:08:50.434002 23090 tablet_copy_source_session.cc:215] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:50.437151 24114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a155859ea9d41f4a7ccad8246c9c2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:50.439240 24108 tablet_copy_client.cc:806] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:50.439822 24108 tablet_copy_client.cc:670] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:50.443639 22828 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.447980 24108 tablet_copy_client.cc:538] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:50.462574 24114 tablet_copy_client.cc:806] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:50.463150 24114 tablet_copy_client.cc:670] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:50.467087 24108 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:50.469118 24114 tablet_copy_client.cc:538] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:50.477829 24114 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:50.489619 24119 ts_tablet_manager.cc:933] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:50.492520 24119 tablet_copy_client.cc:323] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:50.496773 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 952ed8a46c5e4f158f63440eb6fbef0a from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:50.497298 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 952ed8a46c5e4f158f63440eb6fbef0a from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-952ed8a46c5e4f158f63440eb6fbef0a
I20260709 13:08:50.504797 23016 tablet_copy_source_session.cc:215] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:50.505700 24114 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:50.506629 24114 tablet_bootstrap.cc:492] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:50.507252 24114 ts_tablet_manager.cc:1403] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.003s
I20260709 13:08:50.509470 24119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ed8a46c5e4f158f63440eb6fbef0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:50.516201 24114 raft_consensus.cc:359] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.517122 24114 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:50.517800 24114 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.524748 24119 tablet_copy_client.cc:806] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:50.525249 24119 tablet_copy_client.cc:670] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:50.526990 24108 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:50.528172 24108 tablet_bootstrap.cc:492] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:50.528803 24108 ts_tablet_manager.cc:1403] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.008s
I20260709 13:08:50.528888 24114 ts_tablet_manager.cc:1434] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:08:50.531426 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-8a155859ea9d41f4a7ccad8246c9c2ba received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:50.531843 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-8a155859ea9d41f4a7ccad8246c9c2ba on tablet 8a155859ea9d41f4a7ccad8246c9c2ba with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.532130 24119 tablet_copy_client.cc:538] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:50.534458 24108 raft_consensus.cc:359] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.535542 24108 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:50.536233 24108 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.542989 23074 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.544090 24119 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:50.544369 24103 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:50.551190 24108 ts_tablet_manager.cc:1434] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:08:50.566036 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-682d24a2200c4222a401f9ab803af214 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:50.566457 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-682d24a2200c4222a401f9ab803af214 on tablet 682d24a2200c4222a401f9ab803af214 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.577270 22922 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.580314 24105 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:50.598084 24119 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:50.599025 24119 tablet_bootstrap.cc:492] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:50.599675 24119 ts_tablet_manager.cc:1403] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.012s
I20260709 13:08:50.613838 24119 raft_consensus.cc:359] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.614639 24119 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:50.615254 24119 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:50.617544 24119 ts_tablet_manager.cc:1434] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:08:50.620851 23000 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.622174 24105 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:50.626477 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-952ed8a46c5e4f158f63440eb6fbef0a received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:50.626921 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-952ed8a46c5e4f158f63440eb6fbef0a on tablet 952ed8a46c5e4f158f63440eb6fbef0a with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:50.629678 23003 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.630854 24105 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:50.641714 22922 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.644469 22922 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.648577 24104 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:50.658789 24104 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:50.725099 23657 raft_consensus.cc:1217] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:50.787326 23074 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:50.788434 24081 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.802057 23000 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:50.804036 24081 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.842094 22928 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:50.845429 24026 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:50.850751 23076 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.853497 24104 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:50.854892 23657 raft_consensus.cc:1217] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:50.859833 22922 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:50.863081 24105 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:50.880887 23003 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:50.887233 24026 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:50.889528 23003 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:50.891885 24011 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:50.918817 23074 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:50.920377 24011 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:50.933243 23657 raft_consensus.cc:1217] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:50.966557 23657 raft_consensus.cc:1217] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:51.047238 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.113502 24081 raft_consensus.cc:1064] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:51.118417 24081 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:51.187276 23074 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.209288 24146 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:51.272985 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 95887.2us
I20260709 13:08:51.278434 23657 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.281572 24078 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:51.301019 22999 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.302975 24146 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.343169 24087 raft_consensus.cc:1064] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:51.344849 24148 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.345784 23657 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.346427 24087 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:51.352896 22999 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.370936 23076 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.371174 23656 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.373881 24087 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.375631 24017 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:51.371760 22929 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.381951 24017 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.402976 23076 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.405048 22826 catalog_manager.cc:5697] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.413753 24017 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.416383 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.416024 22929 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.442101 23657 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.446393 23074 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.465768 24050 raft_consensus.cc:1064] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:51.469595 24050 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:51.491114 23003 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.491317 22928 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.493054 24026 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.494124 23657 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.495880 24026 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.497502 24026 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.518947 24050 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.525087 23656 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.533457 24017 raft_consensus.cc:1064] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:51.533010 22928 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.541960 24017 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:51.557771 22828 catalog_manager.cc:5697] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.562166 22929 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:51.577276 23003 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.591943 23656 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:51.593524 24081 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:51.597364 23076 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:51.602180 24081 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:08:51.559399 22828 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.625813 24148 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.629946 22929 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.632890 23656 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.637010 23076 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:51.633137 23657 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.638477 24087 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:08:51.667327 23076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:51.668092 23076 raft_consensus.cc:606] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:51.703176 24167 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:08:51.705050 23078 raft_consensus.cc:2955] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.748311 23078 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:51.752194 22828 catalog_manager.cc:5697] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.751768 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 492dd607be6348c79999243a8383806d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.751693 24069 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:08:51.778083 23657 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:51.780951 22997 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:51.787320 22929 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:08:51.787700 22816 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 492dd607be6348c79999243a8383806d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:08:51.791898 24145 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:51.793680 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:51.794279 22999 raft_consensus.cc:606] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:51.798553 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:51.799132 22999 raft_consensus.cc:606] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:51.802140 24050 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:51.804594 22928 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:51.807420 24069 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:51.808609 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 103157us
I20260709 13:08:51.807181 24026 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.826476 23656 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:51.819011 22929 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.835891 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:51.836464 22928 raft_consensus.cc:606] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:51.840216 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:51.840761 22928 raft_consensus.cc:606] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:08:51.843526 23656 raft_consensus.cc:2955] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.849987 23000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:51.852043 24017 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:51.853137 24087 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.853500 24166 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.855988 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a155859ea9d41f4a7ccad8246c9c2ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.858673 22922 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.863883 24143 raft_consensus.cc:993] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:51.864374 24143 raft_consensus.cc:1081] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:51.867751 22929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:51.868371 22929 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.868732 22929 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.866564 23657 raft_consensus.cc:2955] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.870173 23654 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.876458 23074 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.879781 22827 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.888839 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 492dd607be6348c79999243a8383806d with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:51.889084 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 682d24a2200c4222a401f9ab803af214 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.883226 23000 raft_consensus.cc:606] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:51.904965 22826 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.906018 22929 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:51.907860 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:51.909452 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:51.911422 22929 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:51.917124 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:51.917865 23000 raft_consensus.cc:3055] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:51.918257 23000 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:51.918995 23000 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:51.920161 23000 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.925609 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:51.926187 23076 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.931892 24017 raft_consensus.cc:993] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:51.932492 24017 raft_consensus.cc:1081] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:51.935302 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:51.935829 22924 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.937141 22924 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.942397 23076 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:51.941378 22931 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:51.944519 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a155859ea9d41f4a7ccad8246c9c2ba with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:51.946879 23000 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:51.952015 22895 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:51.952310 24026 raft_consensus.cc:993] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:51.952814 24026 raft_consensus.cc:1081] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:51.952941 24081 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:51.953692 24081 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:51.954957 23003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52154
I20260709 13:08:51.955497 23003 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.955905 23003 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.962235 23003 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:51.954587 24081 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:51.965396 23003 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:51.965329 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:51.966079 22931 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.966830 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:51.975322 23076 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:51.975630 23076 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:51.976465 23076 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:51.977716 23076 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.978333 24175 tablet_replica.cc:333] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:51.972437 24069 raft_consensus.cc:993] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:51.985781 24069 raft_consensus.cc:1081] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:51.986719 24175 raft_consensus.cc:2243] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.987771 22929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:51.988258 22929 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.988596 22929 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.988711 24175 raft_consensus.cc:2272] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.970381 22924 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:51.991484 22931 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:51.994546 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:51.995105 23074 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.994324 24175 ts_tablet_manager.cc:1916] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:51.995705 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:51.996546 24069 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:51.996960 24069 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:51.997947 24069 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:51.993342 22924 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:51.984952 23076 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:52.006351 22929 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.014909 24175 ts_tablet_manager.cc:1929] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:52.015470 24175 log.cc:1199] T 492dd607be6348c79999243a8383806d P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/492dd607be6348c79999243a8383806d
I20260709 13:08:52.017066 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:52.017560 22999 raft_consensus.cc:3055] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:52.017820 22999 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:52.018520 22999 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.019500 22999 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.025430 24175 tablet_replica.cc:333] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:52.025611 22999 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:52.028384 22929 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:52.006675 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:52.029596 23002 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:52.029899 23002 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:52.030567 23002 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.031469 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:52.031715 23002 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.032022 23076 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.027889 24175 raft_consensus.cc:2243] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.035169 24175 raft_consensus.cc:2272] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.013646 23074 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:52.036950 22895 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:52.038058 24146 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:52.038612 24146 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:52.039788 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 492dd607be6348c79999243a8383806d (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:52.040216 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:52.035571 22826 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.040843 22827 catalog_manager.cc:5697] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:52.041790 23076 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:52.042172 24148 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:52.038022 23002 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:52.042737 24148 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:52.047200 24148 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.040627 24146 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.060988 24175 ts_tablet_manager.cc:1916] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:52.068171 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 682d24a2200c4222a401f9ab803af214 with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:52.082625 22999 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:52.091492 23076 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:52.092247 23656 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:52.091104 22827 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.093963 24069 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:52.095597 22829 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.097393 22829 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.095425 24069 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:08:52.100788 24181 tablet_replica.cc:333] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:52.109337 24171 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:52.110807 24181 raft_consensus.cc:2243] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.110661 23076 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:52.116967 23656 raft_consensus.cc:2955] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:52.121590 24181 raft_consensus.cc:2272] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.121655 24175 ts_tablet_manager.cc:1929] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:52.127367 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 952ed8a46c5e4f158f63440eb6fbef0a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:52.130647 24175 log.cc:1199] T 8a155859ea9d41f4a7ccad8246c9c2ba P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/8a155859ea9d41f4a7ccad8246c9c2ba
I20260709 13:08:52.133807 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 8a155859ea9d41f4a7ccad8246c9c2ba (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:52.135928 22827 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.139810 24181 ts_tablet_manager.cc:1916] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:52.150643 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 952ed8a46c5e4f158f63440eb6fbef0a with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:52.155987 24182 tablet_replica.cc:333] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:52.157226 24182 raft_consensus.cc:2243] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.158236 24182 raft_consensus.cc:2272] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.161597 24182 ts_tablet_manager.cc:1916] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:52.162025 24181 ts_tablet_manager.cc:1929] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:52.162578 24181 log.cc:1199] T 682d24a2200c4222a401f9ab803af214 P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/682d24a2200c4222a401f9ab803af214
I20260709 13:08:52.165522 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 682d24a2200c4222a401f9ab803af214 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:52.176937 24148 raft_consensus.cc:993] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:52.177502 24146 raft_consensus.cc:1081] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:52.177495 24182 ts_tablet_manager.cc:1929] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:52.178823 24182 log.cc:1199] T 952ed8a46c5e4f158f63440eb6fbef0a P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/952ed8a46c5e4f158f63440eb6fbef0a
I20260709 13:08:52.180435 23656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:08:52.180608 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 952ed8a46c5e4f158f63440eb6fbef0a (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:52.180996 23656 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:52.181434 23656 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.185801 23656 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:52.187287 23656 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:52.187860 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:52.188407 22924 raft_consensus.cc:3055] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:52.188302 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:52.188654 22924 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:52.189049 22999 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.189452 22924 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:52.190313 22924 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.193387 22999 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:52.194690 22924 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:52.194574 23621 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:52.195638 24103 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:52.196121 24103 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:52.197098 24149 raft_consensus.cc:993] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:52.196926 24103 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:52.197552 24146 raft_consensus.cc:1081] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:52.199043 23076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:08:52.199534 23076 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:52.199968 23076 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.204471 23076 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.206099 23076 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:52.205509 22829 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.207398 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:52.207932 23002 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.211393 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:52.211987 22924 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:52.213778 23002 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:52.214033 22924 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:52.214968 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:52.215267 22924 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.215749 24026 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:52.216253 24026 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:52.216536 22924 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.216998 24026 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:52.222195 22924 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:52.228027 22829 catalog_manager.cc:5697] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.385589 22924 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.386683 24069 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.398731 23076 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.399966 24069 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.431584 22999 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.432674 23076 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.432828 24146 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.434689 24146 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.452934 23074 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.454849 24081 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.459560 23002 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.461261 24146 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.469836 22999 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.471235 24148 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.479243 23078 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.482090 24081 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.630753 22924 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.631843 24026 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.640534 22999 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:52.641878 24198 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.656296 22999 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:52.657763 24103 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:52.670384 22924 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:52.671555 24103 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:52.910256 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:52.959208 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:52.997660 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:52.998139 22924 raft_consensus.cc:606] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:08:53.000350 22929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "492dd607be6348c79999243a8383806d"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:53.000720 22929 raft_consensus.cc:606] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:53.002770 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:53.003268 22997 raft_consensus.cc:606] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:53.005931 23074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:53.006387 23074 raft_consensus.cc:606] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:53.008831 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:53.009334 22997 raft_consensus.cc:606] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:53.011233 22929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:53.011714 22929 raft_consensus.cc:606] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:53.012709 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:53.013854 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:53.140654 24169 raft_consensus.cc:993] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:53.141067 24069 raft_consensus.cc:1081] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:53.142194 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:53.142616 22924 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.142889 22924 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.146976 22924 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.148521 22924 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:53.149219 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:53.149473 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:53.149778 22999 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.150038 23076 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.150141 22999 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:53.150938 22999 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.151932 22999 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.158293 22999 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:53.159443 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:53.159745 23076 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:53.160276 24146 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.160804 24146 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:53.161602 24146 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.183956 22827 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.229564 24148 raft_consensus.cc:993] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:53.230083 24081 raft_consensus.cc:1081] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:53.231563 23657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:08:53.232086 23657 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.231892 22999 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:53.232470 23657 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.240325 23657 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:53.242882 23657 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:53.244057 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:53.244601 23074 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:53.244750 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:08:53.245260 22971 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94bcbf412cf54b0fa378f2ce70dec99f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.244619 22924 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.245695 22924 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:53.246716 24169 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.247098 22929 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:53.247763 22999 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.248450 24069 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.246461 22924 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:53.251324 22924 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.254087 22999 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:53.255225 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:53.256172 24103 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.256608 24103 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:53.257531 24103 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:53.261446 22924 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:53.263314 24203 raft_consensus.cc:993] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:53.263872 24203 raft_consensus.cc:1081] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:53.265755 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:53.266491 22924 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.267072 22924 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.273707 22827 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.277928 24169 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.280916 22924 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.284641 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:53.284051 23076 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.285149 22997 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.285449 22997 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:53.286180 22997 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.287230 22997 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.298930 22997 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:53.299472 22924 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:53.284103 22931 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.299698 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:53.300258 23074 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.304766 22896 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:53.305568 24081 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.306018 23074 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:53.306034 24081 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:53.309134 22827 catalog_manager.cc:5697] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.310631 24081 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.313686 22931 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:53.322428 22997 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:08:53.322603 22896 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58c95f8b8069443eb62239e90ed53fa1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.323731 24081 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.324254 23074 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:53.325515 24148 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.332249 24148 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.334682 22999 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.335726 23074 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.337278 22827 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.357342 23076 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:53.363442 24081 raft_consensus.cc:993] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:53.363914 24081 raft_consensus.cc:1081] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:53.357549 22829 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.367467 23656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "492dd607be6348c79999243a8383806d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:08:53.369683 23656 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.370020 23656 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.383625 22924 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:53.384960 22997 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:53.387240 24050 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.388490 24148 raft_consensus.cc:993] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
W20260709 13:08:53.388633 23045 consensus_peers.cc:597] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22342f9fc8d5439e9dc7755716c74fdb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.390179 24050 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.392707 24145 raft_consensus.cc:993] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:53.393271 24198 raft_consensus.cc:1081] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:53.399119 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:08:53.399595 22924 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.400063 22924 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.401153 23656 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:53.402508 24148 raft_consensus.cc:1081] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:53.407091 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:53.407644 22929 raft_consensus.cc:3055] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.407984 22929 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:53.410012 22929 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:53.411090 22929 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.411854 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:53.412531 23076 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.412902 23074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:08:53.413441 23074 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.413776 23074 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.418756 22929 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:53.422830 23076 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:53.428073 23622 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:08:53.409566 23656 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:53.422787 23074 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.428984 24103 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.429454 24103 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:53.430317 24103 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:53.431062 23074 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:53.411885 22924 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.433467 22924 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:53.434021 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:53.434324 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:53.434450 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:53.434552 22997 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.434914 23076 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.435003 22931 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.435269 23076 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:53.435309 22931 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:53.436112 22931 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.436623 23076 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.437855 22931 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.437044 24198 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.438654 23076 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.441051 22997 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:53.441812 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:53.442353 22999 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.442021 23002 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.443883 22931 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:53.444136 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:53.444970 24081 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.445452 24081 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:53.446317 24081 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.448371 22999 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:53.449678 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:53.451236 24145 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.452667 24145 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:53.453538 24145 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:53.456355 22924 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.468243 23002 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:53.469558 22827 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.480334 22826 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.472942 22829 catalog_manager.cc:5697] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:53.499892 22971 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dfb822e7cb640e68719af6e16591c4a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.499845 22828 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.472276 23076 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:53.502507 23074 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:53.503988 22924 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:53.504062 24203 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.505965 24203 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.519695 24204 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.529386 23074 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.545266 22924 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.548107 22828 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:53.568223 23002 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:53.569542 24216 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.584367 23074 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:53.585846 24148 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.674690 24230 ts_tablet_manager.cc:933] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:53.677346 24230 tablet_copy_client.cc:323] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:53.684595 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 94bcbf412cf54b0fa378f2ce70dec99f from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:53.685130 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 94bcbf412cf54b0fa378f2ce70dec99f from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-94bcbf412cf54b0fa378f2ce70dec99f
I20260709 13:08:53.689102 23002 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:53.690419 24103 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:53.698123 23016 tablet_copy_source_session.cc:215] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:53.704957 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bcbf412cf54b0fa378f2ce70dec99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.715700 22924 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:53.718406 24103 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:53.743441 24230 tablet_copy_client.cc:806] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:53.744113 24230 tablet_copy_client.cc:670] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:53.753940 24230 tablet_copy_client.cc:538] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:53.764652 24230 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:53.774423 23076 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:53.776883 24148 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:53.788683 24230 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:53.789541 24230 tablet_bootstrap.cc:492] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:53.790246 24230 ts_tablet_manager.cc:1403] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.015s
I20260709 13:08:53.793325 24230 raft_consensus.cc:359] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:53.794163 24230 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:53.794839 24230 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:53.798941 24230 ts_tablet_manager.cc:1434] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:08:53.800563 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-94bcbf412cf54b0fa378f2ce70dec99f received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:53.800994 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-94bcbf412cf54b0fa378f2ce70dec99f on tablet 94bcbf412cf54b0fa378f2ce70dec99f with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:53.803262 23002 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:53.806903 24216 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.819114 23076 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:53.820355 24103 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:53.829900 24230 ts_tablet_manager.cc:933] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:53.852584 24230 tablet_copy_client.cc:323] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:53.854763 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet 58c95f8b8069443eb62239e90ed53fa1 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:53.855306 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet 58c95f8b8069443eb62239e90ed53fa1 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-58c95f8b8069443eb62239e90ed53fa1
I20260709 13:08:53.858630 22999 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:53.860035 24145 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.868353 22924 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:53.900075 22941 tablet_copy_source_session.cc:215] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:53.906350 22924 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:53.908910 24198 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.912828 24243 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:53.941264 23076 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:53.943463 24148 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:53.961192 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c95f8b8069443eb62239e90ed53fa1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:53.962900 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 106439us
I20260709 13:08:53.989337 24230 tablet_copy_client.cc:806] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:53.989970 24230 tablet_copy_client.cc:670] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:53.998219 24230 tablet_copy_client.cc:538] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:54.009038 24230 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:54.017326 22999 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.020457 24081 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.037869 24247 ts_tablet_manager.cc:933] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:54.041831 24248 ts_tablet_manager.cc:933] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:54.014675 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.054347 24247 tablet_copy_client.cc:323] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:54.057591 24248 tablet_copy_client.cc:323] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:54.059669 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 9dfb822e7cb640e68719af6e16591c4a from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:54.060173 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 9dfb822e7cb640e68719af6e16591c4a from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-9dfb822e7cb640e68719af6e16591c4a
I20260709 13:08:54.074447 23654 raft_consensus.cc:1217] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:54.087430 24230 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:08:54.087878 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57245.7us
I20260709 13:08:54.088379 24230 tablet_bootstrap.cc:492] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:54.089105 24230 ts_tablet_manager.cc:1403] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.034s
I20260709 13:08:54.091912 24230 raft_consensus.cc:359] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:54.092756 24230 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:54.093457 24230 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:54.075261 23016 tablet_copy_source_session.cc:215] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:54.098259 24230 ts_tablet_manager.cc:1434] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:08:54.100023 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-58c95f8b8069443eb62239e90ed53fa1 received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:54.100412 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-58c95f8b8069443eb62239e90ed53fa1 on tablet 58c95f8b8069443eb62239e90ed53fa1 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:54.114601 24248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfb822e7cb640e68719af6e16591c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.120290 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 22342f9fc8d5439e9dc7755716c74fdb from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:54.120833 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 22342f9fc8d5439e9dc7755716c74fdb from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-22342f9fc8d5439e9dc7755716c74fdb
I20260709 13:08:54.128347 23090 tablet_copy_source_session.cc:215] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:54.132489 24247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22342f9fc8d5439e9dc7755716c74fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.133351 24248 tablet_copy_client.cc:806] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:54.139767 24248 tablet_copy_client.cc:670] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:54.143468 24248 tablet_copy_client.cc:538] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:54.157541 24247 tablet_copy_client.cc:806] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:54.158241 24247 tablet_copy_client.cc:670] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:54.161723 24248 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:54.163002 24247 tablet_copy_client.cc:538] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:54.172638 24247 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:54.193704 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.196751 24248 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.198488 24248 tablet_bootstrap.cc:492] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:54.199183 24248 ts_tablet_manager.cc:1403] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.008s
I20260709 13:08:54.202679 24248 raft_consensus.cc:359] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:54.205247 24248 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:54.205935 24248 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:54.215373 24248 ts_tablet_manager.cc:1434] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:08:54.217648 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-9dfb822e7cb640e68719af6e16591c4a received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:54.218065 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-9dfb822e7cb640e68719af6e16591c4a on tablet 9dfb822e7cb640e68719af6e16591c4a with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:54.213327 24247 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.225188 24247 tablet_bootstrap.cc:492] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:54.225942 24247 ts_tablet_manager.cc:1403] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.002s
I20260709 13:08:54.232435 24247 raft_consensus.cc:359] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:54.233315 24247 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:54.233923 24247 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:54.236070 24247 ts_tablet_manager.cc:1434] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:54.240705 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-22342f9fc8d5439e9dc7755716c74fdb received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:54.241217 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-22342f9fc8d5439e9dc7755716c74fdb on tablet 22342f9fc8d5439e9dc7755716c74fdb with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:54.261049 23076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:54.261602 23076 raft_consensus.cc:606] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:54.264617 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:54.265149 22999 raft_consensus.cc:606] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:54.268240 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:54.268783 22924 raft_consensus.cc:606] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:08:54.271404 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:54.271957 22924 raft_consensus.cc:606] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:54.275490 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:54.276062 22999 raft_consensus.cc:606] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:54.277143 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:54.278313 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:54.284281 24146 raft_consensus.cc:993] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:54.284709 24081 raft_consensus.cc:1081] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:54.286079 22999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52166
I20260709 13:08:54.286615 22999 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.286962 22999 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.294799 22999 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:54.296624 22999 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:54.297176 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:54.297724 22924 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.297673 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:54.298197 22924 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:54.298344 23076 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.299296 22924 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:54.300477 22924 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.304975 23076 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:54.306221 22970 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:54.307799 24069 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.308236 24069 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:54.309088 22924 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:54.308986 24069 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:54.314219 23654 raft_consensus.cc:1217] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:08:54.330648 22826 catalog_manager.cc:5697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.370635 24069 raft_consensus.cc:993] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:54.371124 24255 raft_consensus.cc:1081] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:54.372642 23654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47800
I20260709 13:08:54.373138 23654 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.373469 23654 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.375330 23656 raft_consensus.cc:1217] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:08:54.387647 23654 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.390230 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:54.390244 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:54.390851 22924 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.391073 22999 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.391499 22999 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:54.392416 22999 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.393518 22999 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.397442 22924 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:54.398610 23622 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:08:54.399408 24241 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.399894 24241 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:54.400076 22999 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:54.400749 24241 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.403798 23654 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:54.415997 22826 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.420933 24146 raft_consensus.cc:993] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:54.421401 24146 raft_consensus.cc:1081] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:54.424378 23076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:08:54.424863 23076 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.425211 23076 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.427183 23654 raft_consensus.cc:1217] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:54.432140 23076 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:54.434921 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:54.435423 22922 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.435607 22922 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:54.435946 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:54.436406 22999 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.436297 22922 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:54.437340 22922 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.437788 23076 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:54.443128 22999 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:54.443691 22922 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:54.444562 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:54.445264 24050 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.445688 24050 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:54.446452 24050 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:54.461917 22826 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.620800 24255 raft_consensus.cc:993] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:54.621248 24204 raft_consensus.cc:1081] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:54.622553 23654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47800
I20260709 13:08:54.623104 23654 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.623548 23654 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.628650 24069 raft_consensus.cc:1064] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:54.630764 24069 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.631075 23654 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.632732 23654 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:54.633404 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:54.633945 23003 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.634204 23003 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:54.634843 23003 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.635869 23003 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.639516 23654 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:54.642252 23076 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:54.643790 23003 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:54.644169 24204 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:54.645155 24265 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:54.642184 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:54.646682 23073 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.645951 23621 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:54.649425 24240 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.649854 24240 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:54.650645 24240 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.663995 22929 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:54.669920 24069 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:54.671435 23073 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:54.676255 24050 raft_consensus.cc:993] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:54.676680 24050 raft_consensus.cc:1081] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:54.678957 22922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:08:54.679772 22922 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.686543 22922 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.714936 22826 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:54.728070 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 81372.3us
W20260709 13:08:54.729429 24269 log.cc:927] Time spent T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:08:54.732837 24268 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.055s	user 0.002s	sys 0.020s
I20260709 13:08:54.742416 24146 raft_consensus.cc:1064] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:54.743144 24265 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.764484 24146 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.768573 24252 raft_consensus.cc:1064] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:54.765903 22922 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.772976 23073 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.789126 22922 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:54.787022 24252 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.793072 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:08:54.793617 23655 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.781951 23656 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.804428 22929 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.806154 24255 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.808979 22929 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.814586 22826 catalog_manager.cc:5697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.829485 22999 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.830466 23655 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:54.831951 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:08:54.833029 24216 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.833582 24216 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:54.834607 24216 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:08:54.861701 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 59708.1us
I20260709 13:08:54.864610 23654 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:54.866451 24251 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.868839 23654 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:54.871969 22999 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:54.875473 24216 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.880131 22924 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:54.881352 22999 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:54.883628 24081 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:54.886590 24266 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.905256 24216 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.918974 22999 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.925940 23073 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.929124 24204 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:54.931823 24272 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:08:54.932164 24276 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.929402 24255 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:08:54.952934 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 184627us
I20260709 13:08:54.957422 24284 raft_consensus.cc:1064] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:54.979955 24284 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:54.957875 22931 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.974023 23657 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.986675 22924 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:54.987756 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94bcbf412cf54b0fa378f2ce70dec99f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:54.991966 23655 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:54.992141 24252 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:54.994225 24204 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.998162 22924 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.000434 24241 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.999889 23002 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.004652 22999 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.005897 24103 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.010221 23657 raft_consensus.cc:2955] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.018087 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:55.028435 23076 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.028755 23076 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:55.029460 23076 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:55.030699 23076 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.048026 23002 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.049276 23078 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:55.049630 24276 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.050212 23656 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:55.051163 24284 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:55.052320 24204 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:55.020682 23073 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:55.022320 24050 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:55.022756 22829 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.024993 22922 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.076243 24081 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:55.092528 22928 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:55.108915 23656 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.108844 23076 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:55.122118 24069 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:08:55.131121 22827 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.133628 22827 catalog_manager.cc:5697] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:08:55.166314 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45107.5us
W20260709 13:08:55.167208 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 90279.9us
I20260709 13:08:55.169471 22999 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.171240 24296 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:55.205744 24255 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.211920 24276 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.212277 22928 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.282243 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 94bcbf412cf54b0fa378f2ce70dec99f with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:55.282433 23080 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.286021 23655 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.288453 23076 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.306191 23073 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.226711 22827 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.308176 24241 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.307971 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:55.339085 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 55508.9us
I20260709 13:08:55.352584 23655 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.355547 24146 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:55.352677 24303 tablet_replica.cc:333] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:55.370170 23076 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:55.441464 24303 raft_consensus.cc:2243] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:55.445976 24272 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:55.451977 22922 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:08:55.456332 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 77930.7us
I20260709 13:08:55.390039 22826 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.457948 24303 raft_consensus.cc:2272] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.462594 22999 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:55.468482 24276 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.473845 24303 ts_tablet_manager.cc:1916] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:55.487522 23655 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:55.499007 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.489540 24276 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.512439 24050 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:08:55.508208 24307 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:55.518276 23003 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.536697 24303 ts_tablet_manager.cc:1929] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:55.537253 24303 log.cc:1199] T 94bcbf412cf54b0fa378f2ce70dec99f P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/94bcbf412cf54b0fa378f2ce70dec99f
I20260709 13:08:55.556195 23655 raft_consensus.cc:2955] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.543870 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 94bcbf412cf54b0fa378f2ce70dec99f (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:55.585018 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22342f9fc8d5439e9dc7755716c74fdb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:55.595865 23003 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:55.604076 22826 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.608984 22922 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:55.610452 24265 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:55.583932 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 224043us
I20260709 13:08:55.613133 23076 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.613713 23656 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:55.622300 24308 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:55.630887 24266 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.638088 22924 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.639590 23655 raft_consensus.cc:2955] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:08:55.641993 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51276.1us
I20260709 13:08:55.658176 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.668289 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dfb822e7cb640e68719af6e16591c4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:55.686118 22829 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.697906 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dfb822e7cb640e68719af6e16591c4a with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:55.700187 24303 tablet_replica.cc:333] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:55.701364 24303 raft_consensus.cc:2243] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.702119 24303 raft_consensus.cc:2272] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.706697 24303 ts_tablet_manager.cc:1916] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:55.720857 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 22342f9fc8d5439e9dc7755716c74fdb with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:55.734189 22929 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:55.739576 24304 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:55.739897 23655 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.745636 24304 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.756582 24216 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.761696 23655 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.777702 22826 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.789255 24312 tablet_replica.cc:333] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:55.795931 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c95f8b8069443eb62239e90ed53fa1 with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:55.801839 23076 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.809979 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58c95f8b8069443eb62239e90ed53fa1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:55.821748 23080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:55.822314 23080 raft_consensus.cc:606] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:55.829296 22929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:55.829532 24313 tablet_replica.cc:333] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:55.829869 22929 raft_consensus.cc:606] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:55.830791 24313 raft_consensus.cc:2243] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.832367 24313 raft_consensus.cc:2272] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.832719 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:55.833356 23003 raft_consensus.cc:606] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:55.836683 24313 ts_tablet_manager.cc:1916] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:55.839143 24312 raft_consensus.cc:2243] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.839952 24312 raft_consensus.cc:2272] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.837162 23080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:55.842774 23080 raft_consensus.cc:606] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:55.837476 24303 ts_tablet_manager.cc:1929] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:55.843917 24312 ts_tablet_manager.cc:1916] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:55.844293 24303 log.cc:1199] T 9dfb822e7cb640e68719af6e16591c4a P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/9dfb822e7cb640e68719af6e16591c4a
I20260709 13:08:55.846563 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:55.847625 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 9dfb822e7cb640e68719af6e16591c4a (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:55.848342 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:55.848380 24304 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:55.863036 23073 raft_consensus.cc:2955] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:55.886996 24313 ts_tablet_manager.cc:1929] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:55.887503 24313 log.cc:1199] T 58c95f8b8069443eb62239e90ed53fa1 P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/58c95f8b8069443eb62239e90ed53fa1
I20260709 13:08:55.889402 24312 ts_tablet_manager.cc:1929] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:08:55.889973 24312 log.cc:1199] T 22342f9fc8d5439e9dc7755716c74fdb P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/22342f9fc8d5439e9dc7755716c74fdb
I20260709 13:08:55.891608 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 22342f9fc8d5439e9dc7755716c74fdb (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:55.892979 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 58c95f8b8069443eb62239e90ed53fa1 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:55.932317 24276 raft_consensus.cc:993] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:55.932778 24276 raft_consensus.cc:1081] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:55.935189 23003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52154
I20260709 13:08:55.935807 23003 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.936231 23003 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.943822 23003 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:55.946466 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:55.946981 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:08:55.947554 23003 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:55.947646 23655 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.946985 23080 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.948932 23080 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:55.949771 23080 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:55.951957 23080 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.955886 23655 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:08:55.957228 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:55.957835 23080 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:08:55.958074 24265 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:55.958566 24265 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:55.959417 24265 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:55.969125 22826 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 3 to 4, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 4 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.026978 24216 raft_consensus.cc:993] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:56.027489 24304 raft_consensus.cc:1081] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:56.028795 23003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52166
I20260709 13:08:56.029292 23003 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.029670 23003 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.034083 23003 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:56.035593 23003 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:56.036166 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:56.036734 22924 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:56.036484 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:56.037103 22924 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:56.037583 23080 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.038067 22924 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:56.039170 22924 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.045768 23080 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:08:56.046824 22970 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:56.047062 22924 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:08:56.047602 24265 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:56.048100 24265 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:56.048834 24265 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:56.057575 22826 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 3, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.229053 24271 raft_consensus.cc:993] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:56.229497 24276 raft_consensus.cc:1081] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:56.230814 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:08:56.231334 22924 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.231699 22924 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.236366 22924 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:56.238330 22924 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:56.238514 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:56.239071 22999 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.238883 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:56.239740 23080 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:56.239976 23080 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:56.240593 23080 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:56.241421 23080 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.243608 22999 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:56.244699 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:56.245342 24216 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:56.245746 24216 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:56.245813 23080 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:56.246609 24216 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:56.255483 22826 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.288564 24265 raft_consensus.cc:993] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:56.289063 24308 raft_consensus.cc:1081] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:08:56.290985 23657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47800
I20260709 13:08:56.291505 23657 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.291870 23657 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.296535 23657 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:56.298354 23657 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:56.298933 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:56.299248 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:56.299487 23080 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.299821 22999 raft_consensus.cc:3055] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:56.300087 22999 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:56.300747 22999 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:56.301644 22999 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.304457 23080 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:56.306497 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:56.307237 24241 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:56.307394 22999 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:08:56.308298 24241 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:08:56.309151 24241 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:56.316092 22826 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.401670 23657 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:56.402810 24308 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:56.416162 23080 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:56.417900 24308 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:56.628711 23080 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.629694 23073 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.629907 24320 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.630932 24304 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.639149 22924 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.647984 24320 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.663370 23003 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.664992 24310 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.747071 22999 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:56.748294 24317 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:56.757905 23073 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:56.760253 24331 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:56.849442 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.860615 23080 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:56.867776 23045 consensus_peers.cc:597] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37e2e961b20a4588ba99edcaeaaf578c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.867887 22929 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:56.870002 23003 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:56.871169 24329 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.873095 24329 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.895618 24271 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:56.897017 22929 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:56.909409 22999 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:56.919603 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.918841 22826 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:56.933578 22924 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:56.953795 22896 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c7d0f07529640fcbd96e1a627491d86. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.954790 23080 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:56.957214 24216 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.962733 22999 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:56.966396 24310 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.996290 24304 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.005059 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:57.005635 22999 raft_consensus.cc:606] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:57.007189 23073 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.008297 22999 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.015041 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:57.015565 23002 raft_consensus.cc:606] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:08:57.019599 23003 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.023517 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:57.030650 22924 raft_consensus.cc:606] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:08:57.030195 22828 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.032217 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:57.035743 23073 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:57.036060 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:57.037328 24266 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:57.038362 22971 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65ec39fe8fb84cf39e1a859ea7b735d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.038980 22924 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:57.040295 24266 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:57.049324 24266 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.053016 22929 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.054498 23080 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.074132 23076 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.076542 24320 raft_consensus.cc:993] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:57.077176 24265 raft_consensus.cc:1081] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:57.078176 22829 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.082274 22929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:57.083793 22929 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.084239 22929 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.097771 22929 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:57.100759 22929 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:57.101591 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:57.101643 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:08:57.108428 22999 raft_consensus.cc:3055] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:57.108486 23657 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.108829 22999 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:57.109244 23003 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:57.109521 22999 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:57.110661 22999 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.111920 22924 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:57.117201 22999 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:57.117516 23657 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
W20260709 13:08:57.107996 23045 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0cccb8c9157c4c8f9c0a83fbb86bfdc3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.118294 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:57.118556 24329 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:57.119119 24304 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:57.119580 24304 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:57.119812 24271 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:57.120427 24304 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:57.136201 24343 raft_consensus.cc:993] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:57.138254 24343 raft_consensus.cc:1081] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:57.135602 22826 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.143853 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:08:57.144400 23080 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.144774 23080 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.146629 24276 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.152878 22924 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.154803 23080 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:57.160234 23080 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:57.160437 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:08:57.161053 23657 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.163647 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:57.164201 23002 raft_consensus.cc:3055] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:57.164500 23002 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:57.165218 23002 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:57.166373 23002 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.168988 23657 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:57.170303 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:57.172832 24329 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:57.173486 24329 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:57.174249 23002 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:57.174593 24329 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:57.160868 22999 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:08:57.188896 22828 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.208122 22829 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.369521 24351 ts_tablet_manager.cc:933] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:57.371129 24351 tablet_copy_client.cc:323] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:57.372478 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 37e2e961b20a4588ba99edcaeaaf578c from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:57.372933 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 37e2e961b20a4588ba99edcaeaaf578c from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-37e2e961b20a4588ba99edcaeaaf578c
I20260709 13:08:57.381182 23090 tablet_copy_source_session.cc:215] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:57.383646 24351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e2e961b20a4588ba99edcaeaaf578c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:57.397902 24351 tablet_copy_client.cc:806] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:57.398432 24351 tablet_copy_client.cc:670] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:57.410207 24351 tablet_copy_client.cc:538] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:57.418511 24351 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:57.438504 24351 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:57.439299 24351 tablet_bootstrap.cc:492] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:57.439877 24351 ts_tablet_manager.cc:1403] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.005s
I20260709 13:08:57.442456 24351 raft_consensus.cc:359] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.443015 24351 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:57.443524 24351 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.445341 24351 ts_tablet_manager.cc:1434] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:57.448041 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-37e2e961b20a4588ba99edcaeaaf578c received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:57.448427 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-37e2e961b20a4588ba99edcaeaaf578c on tablet 37e2e961b20a4588ba99edcaeaaf578c with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:57.528323 24216 raft_consensus.cc:993] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:57.528828 24216 raft_consensus.cc:1081] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:57.530915 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:08:57.531353 23080 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.531697 23080 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.532541 24351 ts_tablet_manager.cc:933] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:57.534134 24351 tablet_copy_client.cc:323] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:08:57.535534 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 65ec39fe8fb84cf39e1a859ea7b735d1 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:08:57.536072 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 65ec39fe8fb84cf39e1a859ea7b735d1 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-65ec39fe8fb84cf39e1a859ea7b735d1
I20260709 13:08:57.538551 23080 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:57.541374 23080 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:57.541503 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:57.542023 23003 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.542999 23016 tablet_copy_source_session.cc:215] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:57.543128 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:57.543725 22924 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:57.544032 22924 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:57.544724 22924 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:57.545790 22924 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.546428 24351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec39fe8fb84cf39e1a859ea7b735d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:57.551263 23003 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:57.552296 23045 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:57.553061 24329 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:57.555605 24329 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:57.555333 22924 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:57.557950 24329 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:57.566912 24351 tablet_copy_client.cc:806] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:57.567508 24351 tablet_copy_client.cc:670] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:57.571054 24351 tablet_copy_client.cc:538] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:57.569380 22829 catalog_manager.cc:5697] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.573854 23657 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.575064 24356 ts_tablet_manager.cc:933] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:08:57.585937 24351 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:57.590337 24304 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:57.607775 24356 tablet_copy_client.cc:323] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:08:57.609715 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet 8c7d0f07529640fcbd96e1a627491d86 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:08:57.610282 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet 8c7d0f07529640fcbd96e1a627491d86 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-8c7d0f07529640fcbd96e1a627491d86
I20260709 13:08:57.628825 22941 tablet_copy_source_session.cc:215] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:57.639709 24356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7d0f07529640fcbd96e1a627491d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:57.653096 23003 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.656515 24304 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:57.681584 24356 tablet_copy_client.cc:806] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:57.682140 24356 tablet_copy_client.cc:670] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:57.700591 24356 tablet_copy_client.cc:538] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:57.727396 24356 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:57.731736 24363 ts_tablet_manager.cc:933] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:57.739612 22999 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.750756 24329 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:57.755533 23655 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.763914 24329 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:57.764856 24363 tablet_copy_client.cc:323] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:08:57.784735 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:08:57.785246 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-0cccb8c9157c4c8f9c0a83fbb86bfdc3
I20260709 13:08:57.792552 23090 tablet_copy_source_session.cc:215] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:57.823052 24363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:57.837119 23654 raft_consensus.cc:1217] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:08:57.879964 24363 tablet_copy_client.cc:806] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:57.880570 24363 tablet_copy_client.cc:670] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:57.882676 24356 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:57.883627 24356 tablet_bootstrap.cc:492] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:57.884383 24356 ts_tablet_manager.cc:1403] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.157s	user 0.008s	sys 0.017s
I20260709 13:08:57.887486 24356 raft_consensus.cc:359] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.888324 24356 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:57.889014 24356 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:08:57.891027 24367 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:57.894963 24356 ts_tablet_manager.cc:1434] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:08:57.897917 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-8c7d0f07529640fcbd96e1a627491d86 received from {username='slave'} at 127.0.0.1:52582
I20260709 13:08:57.898298 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-8c7d0f07529640fcbd96e1a627491d86 on tablet 8c7d0f07529640fcbd96e1a627491d86 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:57.901958 24363 tablet_copy_client.cc:538] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:57.919206 24363 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:08:57.927407 24351 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:57.928341 24351 tablet_bootstrap.cc:492] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:57.929026 24351 ts_tablet_manager.cc:1403] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.343s	user 0.090s	sys 0.128s
I20260709 13:08:57.932489 24351 raft_consensus.cc:359] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.949029 24351 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:57.949678 24351 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.952615 24351 ts_tablet_manager.cc:1434] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:08:57.954527 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-65ec39fe8fb84cf39e1a859ea7b735d1 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:08:57.954924 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-65ec39fe8fb84cf39e1a859ea7b735d1 on tablet 65ec39fe8fb84cf39e1a859ea7b735d1 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:57.964462 23002 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.969007 24348 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:57.984799 24363 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:57.987928 24363 tablet_bootstrap.cc:492] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:08:57.988641 24363 ts_tablet_manager.cc:1403] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.013s
I20260709 13:08:57.991648 24363 raft_consensus.cc:359] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.992509 24363 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:08:57.993746 24363 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:57.996042 24363 ts_tablet_manager.cc:1434] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:58.002839 22929 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:58.006909 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-0cccb8c9157c4c8f9c0a83fbb86bfdc3 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:08:58.007000 24348 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:58.008160 23657 raft_consensus.cc:1217] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:58.007344 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-0cccb8c9157c4c8f9c0a83fbb86bfdc3 on tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:08:58.037721 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:58.093788 23657 raft_consensus.cc:1217] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:08:58.122346 23657 raft_consensus.cc:1217] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:58.143599 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:58.189160 22929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:58.189630 22929 raft_consensus.cc:606] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:58.191942 23080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:58.192361 23080 raft_consensus.cc:606] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:58.198086 23080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:08:58.198681 23080 raft_consensus.cc:606] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:58.202682 22922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:58.203163 22922 raft_consensus.cc:606] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:08:58.204159 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:58.205621 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:58.212033 24369 raft_consensus.cc:1064] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:58.214692 24369 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:58.225737 22929 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:58.226979 23002 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:58.228312 23657 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:58.228909 24371 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.229765 24342 raft_consensus.cc:993] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:58.229882 24348 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.230279 24310 raft_consensus.cc:1081] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:58.231958 23003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52166
I20260709 13:08:58.232440 23003 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.232735 23003 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.241490 23003 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.244688 24348 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.258388 24371 raft_consensus.cc:993] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:58.258837 24370 raft_consensus.cc:1081] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:58.262382 22922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:08:58.262924 22922 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.263255 22922 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.263737 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:58.264252 22924 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.264541 22924 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:58.265152 22924 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.266191 22924 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.268651 22922 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.270402 22922 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:58.272497 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:58.273069 23076 raft_consensus.cc:3055] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.273662 23076 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:58.274418 23076 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.274893 24348 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.276671 23076 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.276541 23655 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.279958 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:58.280535 23000 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.294077 23076 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:58.295563 23000 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:58.297492 22924 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:58.298916 23003 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:58.301311 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:58.301587 22972 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:58.302637 24216 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.303117 24216 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:58.303321 24308 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.302802 22827 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.303689 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:58.303841 24308 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:58.304201 23073 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.304003 24216 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.304737 24308 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.313164 22922 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.326802 23073 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:08:58.336141 23000 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.346901 22825 catalog_manager.cc:5697] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.368067 22828 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.391904 23073 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:58.403507 23002 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:58.403759 23655 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:58.405771 24370 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:58.406740 24348 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:58.416299 24342 raft_consensus.cc:1064] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:58.416728 24348 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.418967 24342 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:58.426611 23655 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:58.428251 23000 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:58.427984 23002 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.429339 23073 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:58.434600 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37e2e961b20a4588ba99edcaeaaf578c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:58.436282 23655 raft_consensus.cc:2955] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.429786 24342 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:08:58.445439 22828 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.443624 24342 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:08:58.455921 24310 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:58.467948 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 37e2e961b20a4588ba99edcaeaaf578c with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49884
I20260709 13:08:58.500342 24310 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.510779 24391 tablet_replica.cc:333] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:08:58.512562 24391 raft_consensus.cc:2243] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.513841 24391 raft_consensus.cc:2272] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.516547 23076 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.520222 23002 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.527177 22826 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.516544 23657 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.546298 24343 raft_consensus.cc:1064] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:58.549402 24391 ts_tablet_manager.cc:1916] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:58.551369 24343 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:58.559036 22922 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:58.568002 23076 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:58.569790 23657 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:58.570740 24342 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.573230 24391 ts_tablet_manager.cc:1929] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:58.573717 24391 log.cc:1199] T 37e2e961b20a4588ba99edcaeaaf578c P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/37e2e961b20a4588ba99edcaeaaf578c
I20260709 13:08:58.574230 24342 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.577688 24310 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.578692 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 37e2e961b20a4588ba99edcaeaaf578c (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:58.579486 23073 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.585295 23657 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:58.585506 23080 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:58.588186 24308 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:58.596025 24377 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:58.601922 22825 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.610327 22924 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:58.612308 23655 raft_consensus.cc:2955] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.613495 24308 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:58.632056 24393 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:58.634598 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c7d0f07529640fcbd96e1a627491d86 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:58.658931 22924 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.657054 24308 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.665632 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c7d0f07529640fcbd96e1a627491d86 with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:58.668689 24368 raft_consensus.cc:1064] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
W20260709 13:08:58.669142 24368 raft_consensus.cc:1068] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Unable to promote non-voter 01988c2c817947859340a730b7f1247d: Service unavailable: leader transfer in progress
I20260709 13:08:58.680051 24342 raft_consensus.cc:993] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:58.680519 24216 raft_consensus.cc:1081] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:08:58.683451 24398 tablet_replica.cc:333] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:58.686008 23002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52166
I20260709 13:08:58.686558 23002 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.686882 23002 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.686978 24398 raft_consensus.cc:2243] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.689277 24398 raft_consensus.cc:2272] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.690923 24368 raft_consensus.cc:993] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:58.701678 24368 raft_consensus.cc:1081] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:58.695410 23073 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:58.698086 23002 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.699350 23080 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.705250 24216 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:58.708124 24398 ts_tablet_manager.cc:1916] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:58.711367 22922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:08:58.712018 22922 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.712378 22922 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.721349 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:58.721937 22924 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.722218 22924 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:58.723029 22924 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.723577 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:58.724089 22924 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.724157 23074 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.723830 23654 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.732491 22924 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:08:58.737042 22972 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:58.737742 24377 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.734735 23002 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:58.738204 24377 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:58.739322 24377 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:58.741019 24398 ts_tablet_manager.cc:1929] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:58.741633 24398 log.cc:1199] T 8c7d0f07529640fcbd96e1a627491d86 P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/8c7d0f07529640fcbd96e1a627491d86
I20260709 13:08:58.739547 23074 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:08:58.741061 23002 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:58.744907 22922 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:58.746847 22825 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.759801 22922 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:58.759960 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 8c7d0f07529640fcbd96e1a627491d86 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:58.761117 24216 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:58.762012 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:58.762562 23003 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.764626 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:58.765156 23080 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.765480 23080 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:58.766155 23080 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:58.770277 23080 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.776451 23003 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:58.784090 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:58.784842 24310 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.786485 24310 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:58.787644 23080 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:08:58.787333 24310 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:08:58.795102 23002 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:58.803009 23654 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:58.803009 22924 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:58.804729 24394 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:58.806639 24394 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:58.814093 22826 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 3, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.835147 23654 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.836180 22931 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:58.838747 24266 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:58.814055 24394 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.846993 22924 raft_consensus.cc:2955] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.853439 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65ec39fe8fb84cf39e1a859ea7b735d1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:58.862056 22825 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 5 to 6, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:58.865942 23073 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:58.867713 24308 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:58.876441 22828 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.882674 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 65ec39fe8fb84cf39e1a859ea7b735d1 with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34256
I20260709 13:08:58.885083 24409 tablet_replica.cc:333] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:08:58.887545 24409 raft_consensus.cc:2243] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.890955 24409 raft_consensus.cc:2272] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.898370 24409 ts_tablet_manager.cc:1916] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:58.959645 24409 ts_tablet_manager.cc:1929] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:08:58.965811 24409 log.cc:1199] T 65ec39fe8fb84cf39e1a859ea7b735d1 P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/65ec39fe8fb84cf39e1a859ea7b735d1
I20260709 13:08:58.967842 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 65ec39fe8fb84cf39e1a859ea7b735d1 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:59.206367 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:59.226487 22931 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:59.227918 24394 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:59.243043 23073 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:59.254523 24308 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:59.285115 23654 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Advancing to term 2
I20260709 13:08:59.292809 23080 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:59.294870 23654 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:59.300530 24401 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:59.305552 24304 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:59.358814 24310 raft_consensus.cc:1064] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
W20260709 13:08:59.359254 24310 raft_consensus.cc:1068] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Unable to promote non-voter 01988c2c817947859340a730b7f1247d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:59.364722 23003 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:59.366914 24401 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:59.377719 24310 raft_consensus.cc:1064] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:08:59.384261 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:59.408572 24310 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:59.417779 23654 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:59.421870 24304 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:59.424630 23080 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:59.427453 24401 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:59.432461 23003 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:59.436736 24412 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:59.436362 24304 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.440778 23003 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.442471 23080 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.464546 22826 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.471086 23657 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.482919 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:59.485045 23003 raft_consensus.cc:606] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:59.488462 22931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:59.489015 22931 raft_consensus.cc:606] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:08:59.493988 23000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:08:59.494498 23000 raft_consensus.cc:606] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:08:59.505496 22931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:08:59.508352 22931 raft_consensus.cc:606] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:08:59.509668 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:59.511238 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:59.551580 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 54682.9us
I20260709 13:08:59.565694 22924 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:59.574105 23657 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:59.575891 24310 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:59.579356 23080 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:59.580777 24310 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:59.583202 24304 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.588725 23080 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.588064 23657 raft_consensus.cc:2955] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.605149 22828 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:08:59.612895 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:59.615367 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52140
I20260709 13:08:59.617089 24422 tablet_replica.cc:333] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:08:59.618202 24422 raft_consensus.cc:2243] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.619045 24422 raft_consensus.cc:2272] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.623384 24422 ts_tablet_manager.cc:1916] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:59.636075 24422 ts_tablet_manager.cc:1929] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:59.636427 24422 log.cc:1199] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/0cccb8c9157c4c8f9c0a83fbb86bfdc3
I20260709 13:08:59.637686 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet 0cccb8c9157c4c8f9c0a83fbb86bfdc3 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:08:59.746179 24343 raft_consensus.cc:993] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:59.746678 24394 raft_consensus.cc:1081] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:59.748138 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:59.748580 22924 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.748859 22924 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.753096 22924 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:59.754429 22924 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:08:59.755044 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:59.755267 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:08:59.755609 23003 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.755786 23080 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.755973 23003 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:59.756697 23003 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:59.757779 23003 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.761680 24394 raft_consensus.cc:993] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:59.762200 24394 raft_consensus.cc:1081] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:08:59.762239 23080 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:08:59.763490 22895 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:59.763862 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:08:59.764147 24304 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:59.764387 22924 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.764649 24304 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:59.764827 22924 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.765411 24304 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:59.765914 23003 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:08:59.772017 22924 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:59.773700 22924 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:08:59.774288 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:59.774603 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:08:59.774852 23003 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.775117 23657 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.775297 23003 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:08:59.774884 22825 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 3 to 4, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.776122 23003 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:59.777251 23003 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.783424 23003 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:08:59.784281 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:08:59.784878 23657 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:08:59.785002 24304 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:59.785468 24304 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:59.786140 24304 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:08:59.796038 22825 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 3 to 4, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.890755 24304 raft_consensus.cc:993] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:59.891119 24310 raft_consensus.cc:1081] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:08:59.892297 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:08:59.892724 23080 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.892982 23080 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.897909 23080 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:59.899567 23080 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:08:59.900349 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:08:59.900668 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:08:59.900930 22931 raft_consensus.cc:3055] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.901147 23003 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.901259 22931 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:08:59.901991 22931 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:59.903069 22931 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.907092 23003 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:59.908228 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:08:59.908957 22931 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:08:59.908958 24423 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.910483 24423 raft_consensus.cc:697] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:08:59.911262 24423 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:08:59.920841 22825 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.041751 24310 raft_consensus.cc:993] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:00.042199 24310 raft_consensus.cc:1081] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:00.043565 23654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:09:00.044085 23654 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.044438 23654 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.050396 23654 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:00.052734 23654 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:00.053026 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:00.053639 22924 raft_consensus.cc:3055] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.053957 22924 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:00.055313 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:00.055078 22924 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:00.057185 22924 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.056160 23080 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.063889 22924 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:00.064916 23622 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:00.065114 23080 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:00.065572 24317 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.076097 24317 raft_consensus.cc:697] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:00.077036 24317 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:00.086843 22825 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.178274 23654 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:00.179466 24304 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:00.191094 23003 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:00.192371 24304 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:00.308243 23003 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:00.309348 24304 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:00.313759 23080 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:00.315006 24304 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:00.426160 23000 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.427320 24348 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.437160 22924 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.438381 24440 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.512048 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:00.578269 23073 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:00.579447 24317 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:00.597011 22924 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:00.598492 24317 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:00.678956 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:00.689618 23000 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:00.694980 22924 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:00.695163 23073 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:00.695178 22971 consensus_peers.cc:597] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9dd0ac5baf440fc96bcfc581bb5d2de. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.696447 24437 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.697234 24343 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.704352 24437 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.709414 22924 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.721805 23080 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:00.722594 23073 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.731395 22825 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:00.743391 23045 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23b2c8978a514c01ba48a8c4a08a7570. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.743734 22924 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:00.743749 23000 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:00.745707 24440 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:00.746636 24423 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:00.751385 22931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:09:00.751915 22931 raft_consensus.cc:606] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:00.760339 23073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:09:00.760878 23073 raft_consensus.cc:606] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:00.761183 24439 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.762841 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:00.762707 23000 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.764305 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:00.767280 22924 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.783854 22827 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.790318 23000 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:00.798058 23080 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:00.798573 22971 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3222d52f8784a58a81fe1c534bbaf98. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.798712 22924 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:00.799396 24343 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.802196 24343 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.816161 24437 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.817714 22924 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.832983 22924 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:00.833552 22825 catalog_manager.cc:5697] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.836268 23080 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.848383 23074 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:00.850848 23002 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:00.852483 22896 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5db53771823404097dd71493c3b242b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.853806 24304 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.864187 24445 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.887310 24304 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.894381 23000 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:00.914218 22828 catalog_manager.cc:5697] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.916082 23074 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:01.174480 24348 raft_consensus.cc:993] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:01.184121 24348 raft_consensus.cc:1081] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:01.186939 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:09:01.187988 22924 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.188575 22924 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:01.229754 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 64220.9us
I20260709 13:09:01.236517 24467 ts_tablet_manager.cc:933] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:01.231829 22924 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:01.253777 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:01.254662 23000 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.266044 22924 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:01.276798 23000 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:01.301927 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:01.303493 24466 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.305550 24466 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:01.306962 24466 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:01.315960 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:01.311393 24469 ts_tablet_manager.cc:933] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:01.316571 23080 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.316892 23080 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:01.318687 24467 tablet_copy_client.cc:323] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:09:01.321214 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet d9dd0ac5baf440fc96bcfc581bb5d2de from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:09:01.321949 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet d9dd0ac5baf440fc96bcfc581bb5d2de from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-d9dd0ac5baf440fc96bcfc581bb5d2de
I20260709 13:09:01.317786 23080 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:01.333814 23080 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.350070 24469 tablet_copy_client.cc:323] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:09:01.364634 23015 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet d3222d52f8784a58a81fe1c534bbaf98 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:09:01.365263 23015 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet d3222d52f8784a58a81fe1c534bbaf98 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-d3222d52f8784a58a81fe1c534bbaf98
I20260709 13:09:01.375890 23015 tablet_copy_source_session.cc:215] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:01.385947 24310 raft_consensus.cc:993] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:09:01.386565 24310 raft_consensus.cc:1081] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:09:01.404789 23016 tablet_copy_source_session.cc:215] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:01.410034 23002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52166
I20260709 13:09:01.412699 23002 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.413072 23002 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.409682 24474 ts_tablet_manager.cc:933] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:01.416229 24469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3222d52f8784a58a81fe1c534bbaf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:01.419116 23080 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:01.454212 24467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9dd0ac5baf440fc96bcfc581bb5d2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:01.490031 23002 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:01.507894 23002 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:01.534653 24484 ts_tablet_manager.cc:933] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
W20260709 13:09:01.539127 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45594.5us
I20260709 13:09:01.552716 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:01.553503 22931 raft_consensus.cc:3055] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.553854 22931 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:01.554853 22931 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:01.574617 22931 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:01.575868 24434 consensus_queue.cc:1175] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b655449a388a41e3a606c6ea794825ad" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:09:01.531235 22828 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:01.608006 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 152732us
I20260709 13:09:01.615962 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:01.616577 23080 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.625764 23080 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:01.626536 24474 tablet_copy_client.cc:323] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:09:01.641963 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet 23b2c8978a514c01ba48a8c4a08a7570 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:09:01.642627 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet 23b2c8978a514c01ba48a8c4a08a7570 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-23b2c8978a514c01ba48a8c4a08a7570
I20260709 13:09:01.649086 22931 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:01.650876 24484 tablet_copy_client.cc:323] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:09:01.660463 24469 tablet_copy_client.cc:806] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:01.661245 24469 tablet_copy_client.cc:670] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:01.662043 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet f5db53771823404097dd71493c3b242b from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:09:01.656055 23090 tablet_copy_source_session.cc:215] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:01.662648 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet f5db53771823404097dd71493c3b242b from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-f5db53771823404097dd71493c3b242b
I20260709 13:09:01.656370 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:01.664772 24437 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.665266 24437 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:01.666288 24437 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:01.668556 24467 tablet_copy_client.cc:806] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:01.669272 24467 tablet_copy_client.cc:670] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:01.670758 24469 tablet_copy_client.cc:538] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:01.671123 22941 tablet_copy_source_session.cc:215] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:01.673682 24467 tablet_copy_client.cc:538] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:01.680181 24469 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:01.683981 24474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b2c8978a514c01ba48a8c4a08a7570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:01.686637 24484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5db53771823404097dd71493c3b242b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:01.691920 22828 catalog_manager.cc:5697] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 3, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.702134 24467 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:01.723776 24474 tablet_copy_client.cc:806] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:01.724642 24474 tablet_copy_client.cc:670] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:01.726398 24484 tablet_copy_client.cc:806] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:01.729946 24484 tablet_copy_client.cc:670] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:01.734889 24484 tablet_copy_client.cc:538] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:01.736302 24474 tablet_copy_client.cc:538] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:01.738469 24467 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.739455 24467 tablet_bootstrap.cc:492] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:01.740165 24467 ts_tablet_manager.cc:1403] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.004s
I20260709 13:09:01.743191 24467 raft_consensus.cc:359] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.743880 24467 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:01.745007 24467 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.749437 24474 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:01.751228 24467 ts_tablet_manager.cc:1434] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:01.753799 24469 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.764001 24469 tablet_bootstrap.cc:492] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:01.764896 24469 ts_tablet_manager.cc:1403] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.012s
I20260709 13:09:01.765730 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.768149 24469 raft_consensus.cc:359] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.768989 24469 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:01.769585 24469 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.754271 24484 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:01.771916 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-d9dd0ac5baf440fc96bcfc581bb5d2de received from {username='slave'} at 127.0.0.1:41504
I20260709 13:09:01.772850 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-d9dd0ac5baf440fc96bcfc581bb5d2de on tablet d9dd0ac5baf440fc96bcfc581bb5d2de with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:01.787035 24469 ts_tablet_manager.cc:1434] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:09:01.792760 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-d3222d52f8784a58a81fe1c534bbaf98 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:09:01.793183 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-d3222d52f8784a58a81fe1c534bbaf98 on tablet d3222d52f8784a58a81fe1c534bbaf98 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:01.799562 23002 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:01.801090 24479 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:01.829048 23078 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:01.836943 24434 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:01.863793 23654 raft_consensus.cc:1217] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:01.908264 24474 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.909173 24474 tablet_bootstrap.cc:492] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:01.909825 24474 ts_tablet_manager.cc:1403] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.004s
I20260709 13:09:01.929311 24484 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.929042 24474 raft_consensus.cc:359] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.929903 24474 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:01.930383 24484 tablet_bootstrap.cc:492] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:01.930586 24474 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.933684 24474 ts_tablet_manager.cc:1434] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:09:01.936373 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-23b2c8978a514c01ba48a8c4a08a7570 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:09:01.936806 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-23b2c8978a514c01ba48a8c4a08a7570 on tablet 23b2c8978a514c01ba48a8c4a08a7570 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:01.938421 24484 ts_tablet_manager.cc:1403] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.184s	user 0.019s	sys 0.035s
I20260709 13:09:01.941625 24484 raft_consensus.cc:359] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.942401 24484 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:01.943074 24484 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:01.945258 24484 ts_tablet_manager.cc:1434] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:09:01.952813 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-f5db53771823404097dd71493c3b242b received from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:01.953270 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-f5db53771823404097dd71493c3b242b on tablet f5db53771823404097dd71493c3b242b with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:01.967494 23654 raft_consensus.cc:1217] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:02.099438 22928 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:02.100805 24481 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.110586 23078 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:02.112304 24482 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.183959 23657 raft_consensus.cc:1217] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:02.190125 23657 raft_consensus.cc:1217] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:02.221906 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.269043 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "defec66b69804f8c85671fbdd904172d"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:09:02.269673 23002 raft_consensus.cc:606] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:02.272289 22931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5db53771823404097dd71493c3b242b"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:09:02.272912 22931 raft_consensus.cc:606] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:02.274324 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:02.275588 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:02.343528 24437 raft_consensus.cc:993] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:02.344086 24482 raft_consensus.cc:1081] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:02.345659 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "defec66b69804f8c85671fbdd904172d"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:09:02.346158 23080 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.346483 23080 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.352901 23080 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.355834 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:02.356007 23080 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:02.356423 23002 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.357054 23002 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:02.356948 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:02.357668 23657 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.358019 23002 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.359758 23002 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.367741 23002 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:02.368685 23657 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:02.368911 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:02.369719 24478 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.370165 24478 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:02.370996 24478 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.381508 22827 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.395318 24465 raft_consensus.cc:993] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:02.396296 24445 raft_consensus.cc:1081] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:02.397676 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5db53771823404097dd71493c3b242b"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:09:02.398170 23080 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.398489 23080 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.404870 23080 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:02.406715 23080 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:02.407325 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:02.407928 22931 raft_consensus.cc:3055] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.407981 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:02.408347 22931 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:02.408535 23002 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.409175 22931 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:02.410576 22931 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.416040 23002 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:02.416594 22931 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:02.417237 23045 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:02.417984 24478 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.418434 24478 raft_consensus.cc:697] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:02.419219 24478 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:02.444612 24437 raft_consensus.cc:1064] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:02.447170 24437 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.464784 23657 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:02.464061 22827 catalog_manager.cc:5697] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.464946 22931 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:02.466394 23078 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:02.468261 24483 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.470058 24483 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.473179 24483 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.487002 24483 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.489643 23078 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.497705 22926 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.505092 23657 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.522506 22827 catalog_manager.cc:5697] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.542713 23002 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.552989 22926 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:02.554381 24482 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.552178 23657 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:02.555922 24437 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.565725 24481 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.576339 22926 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.579943 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3222d52f8784a58a81fe1c534bbaf98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:02.585574 22827 catalog_manager.cc:5697] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.586028 23657 raft_consensus.cc:2955] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.610347 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet d3222d52f8784a58a81fe1c534bbaf98 with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34256
I20260709 13:09:02.615374 24511 tablet_replica.cc:333] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:09:02.616466 24511 raft_consensus.cc:2243] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.617856 24511 raft_consensus.cc:2272] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.622511 24511 ts_tablet_manager.cc:1916] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:02.624840 24481 raft_consensus.cc:1064] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:02.627420 24481 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.639626 23657 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:02.639595 24511 ts_tablet_manager.cc:1929] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:02.640336 24511 log.cc:1199] T d3222d52f8784a58a81fe1c534bbaf98 P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/d3222d52f8784a58a81fe1c534bbaf98
I20260709 13:09:02.641335 24510 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.642418 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet d3222d52f8784a58a81fe1c534bbaf98 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:02.645226 23080 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:02.646370 22926 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:02.646343 24481 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.648114 24510 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.657338 24510 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.658972 23080 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.666409 22926 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.669128 23657 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.674903 22826 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 2 to 3, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.699723 23002 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.708984 23654 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:02.710253 23078 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:02.711377 24483 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.712743 24510 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.722950 24481 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.724288 23654 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.731621 23080 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.733091 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9dd0ac5baf440fc96bcfc581bb5d2de with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:02.739171 22827 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.755364 24439 raft_consensus.cc:1064] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:02.757867 24439 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.766646 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet d9dd0ac5baf440fc96bcfc581bb5d2de with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49884
I20260709 13:09:02.769094 22926 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:02.769968 23002 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:02.770331 23657 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:02.770963 24439 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.771881 24478 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.773653 24478 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:02.776939 24517 tablet_replica.cc:333] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:09:02.781025 24517 raft_consensus.cc:2243] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.782186 24517 raft_consensus.cc:2272] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.786715 24517 ts_tablet_manager.cc:1916] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:02.800452 24478 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.811790 23002 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.816457 23000 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:02.821398 24517 ts_tablet_manager.cc:1929] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:02.821956 24517 log.cc:1199] T d9dd0ac5baf440fc96bcfc581bb5d2de P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/d9dd0ac5baf440fc96bcfc581bb5d2de
I20260709 13:09:02.824067 23657 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.825923 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet d9dd0ac5baf440fc96bcfc581bb5d2de (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:02.827013 22828 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.832306 22999 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:02.834749 24476 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.846077 23080 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:02.854460 23657 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:02.854555 22997 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:02.855970 24439 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:02.857800 24439 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:02.860410 24439 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:02.867094 24478 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.816212 22926 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.871728 23655 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.884301 23654 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:02.887337 24475 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:02.900866 22999 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:02.914484 22928 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:02.916393 24439 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.923761 23655 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Advancing to term 2
I20260709 13:09:02.924178 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23b2c8978a514c01ba48a8c4a08a7570 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:02.951328 22827 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.966871 23655 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:02.976541 24475 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.993284 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 23b2c8978a514c01ba48a8c4a08a7570 with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49884
I20260709 13:09:02.994297 24517 tablet_replica.cc:333] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:09:02.995325 24517 raft_consensus.cc:2243] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.996170 24517 raft_consensus.cc:2272] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.004108 24517 ts_tablet_manager.cc:1916] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:03.016415 24525 raft_consensus.cc:1064] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:03.018760 24525 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:03.027019 23657 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:03.030550 24475 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:03.034080 22928 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:03.034185 23002 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:03.036399 24517 ts_tablet_manager.cc:1929] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:03.036592 24478 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:03.036890 24517 log.cc:1199] T 23b2c8978a514c01ba48a8c4a08a7570 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/23b2c8978a514c01ba48a8c4a08a7570
I20260709 13:09:03.038967 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 23b2c8978a514c01ba48a8c4a08a7570 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:03.043836 24475 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:03.048207 24478 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.054450 23657 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.058957 22999 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.069657 22826 catalog_manager.cc:5697] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.070993 22928 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.095326 23080 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:03.099864 22928 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:03.100201 23657 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:03.101190 24478 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:03.102023 24529 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:03.108678 24475 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.110870 22928 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.118207 23657 raft_consensus.cc:2955] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.119643 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5db53771823404097dd71493c3b242b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:03.131175 22828 catalog_manager.cc:5697] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:03.148058 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet f5db53771823404097dd71493c3b242b with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52140
I20260709 13:09:03.159811 24534 tablet_replica.cc:333] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:09:03.160959 24534 raft_consensus.cc:2243] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.161710 24534 raft_consensus.cc:2272] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.171864 24534 ts_tablet_manager.cc:1916] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:03.182979 24534 ts_tablet_manager.cc:1929] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:03.183326 24534 log.cc:1199] T f5db53771823404097dd71493c3b242b P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/f5db53771823404097dd71493c3b242b
I20260709 13:09:03.184995 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet f5db53771823404097dd71493c3b242b (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:03.276378 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:03.823323 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:03.858198 23080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:09:03.858695 23080 raft_consensus.cc:606] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:09:03.861289 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:09:03.861814 22928 raft_consensus.cc:606] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:03.864215 23080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:09:03.864660 23080 raft_consensus.cc:606] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:09:03.865692 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:03.866994 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:04.157939 24478 raft_consensus.cc:993] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:04.158447 24536 raft_consensus.cc:1081] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:04.159854 23654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47784
I20260709 13:09:04.160346 23654 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:04.160624 23654 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.165506 23654 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:04.167873 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:04.168270 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:04.168479 23002 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.168829 23080 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:04.169164 23080 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:04.167095 23654 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:04.169977 23080 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:04.171070 23080 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.175690 23002 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:04.177340 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:04.178946 24535 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:04.179364 24535 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:04.183522 23080 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:04.185356 24535 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:04.215561 22827 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.238909 22928 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:09:04.246290 22896 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c435cd2efc84579b5b18dbaa04ee538. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.246469 23002 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:04.248509 23080 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:04.249104 24533 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:04.250680 24445 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:04.264547 24546 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.265800 23080 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.267436 23002 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.282997 22928 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:04.283351 22827 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
W20260709 13:09:04.295563 22896 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e45d03aff8ab48f6bc531f18ca6d386c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.296011 23002 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:04.296698 23080 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:04.297606 24546 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:04.299256 24533 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:04.309464 24533 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.311208 23080 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.314281 23002 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.327474 22828 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.334928 23002 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:04.349059 24547 raft_consensus.cc:993] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:09:04.349565 24547 raft_consensus.cc:1081] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:09:04.351967 23002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:52166
I20260709 13:09:04.352212 22926 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:04.352451 23002 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:04.352828 23002 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.353475 24483 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:04.354517 22971 consensus_peers.cc:597] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09c7979afa3c4fcb83838f29edec3b67. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.355775 23080 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:04.357096 24483 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:04.362041 23002 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:04.363502 24483 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.365016 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:04.365770 22926 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:04.366209 22926 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:04.365569 22928 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.367252 22926 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:04.368856 22926 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.385885 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:04.386524 23073 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.386850 23080 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.387087 22827 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.393885 22926 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:04.395298 22972 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:04.395846 23073 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:04.396116 24510 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:04.399613 24510 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:04.397966 23002 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:04.400465 24510 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:04.417387 24478 raft_consensus.cc:993] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:04.418069 24478 raft_consensus.cc:1081] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:04.419539 23654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47784
I20260709 13:09:04.420053 23654 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:04.420269 23654 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.417346 22931 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:04.426488 23654 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:04.428891 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:04.429476 22928 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.429800 23654 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:04.431507 22828 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 3 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 4 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.434250 22928 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:04.435138 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:04.435447 23622 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:04.435806 23073 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:04.436299 23073 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:04.436385 24540 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:04.436914 24540 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:04.437762 23073 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:04.437732 24540 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:04.438889 22896 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2c9f6da39cd452dbbc2fe4221c4b7ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.439182 23073 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.444280 23000 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:04.444862 23080 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:04.445619 24533 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:04.446276 23073 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:04.452977 24533 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:04.462519 22828 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.470525 23000 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.466841 24546 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.483976 23080 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.486157 22828 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:04.699951 24562 ts_tablet_manager.cc:933] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:09:04.701534 23080 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:04.703104 24540 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:04.705344 24562 tablet_copy_client.cc:323] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:09:04.707108 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet e45d03aff8ab48f6bc531f18ca6d386c from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:09:04.707599 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet e45d03aff8ab48f6bc531f18ca6d386c from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-e45d03aff8ab48f6bc531f18ca6d386c
I20260709 13:09:04.726485 23002 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:04.727988 24565 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:04.730837 22941 tablet_copy_source_session.cc:215] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:04.736734 24562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45d03aff8ab48f6bc531f18ca6d386c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.780611 24562 tablet_copy_client.cc:806] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:04.781206 24562 tablet_copy_client.cc:670] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:04.795723 24569 ts_tablet_manager.cc:933] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:04.799844 24562 tablet_copy_client.cc:538] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:04.812273 24562 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:04.815840 23073 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:04.818303 24483 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:04.827571 22928 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:04.829808 24483 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:04.830080 24569 tablet_copy_client.cc:323] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:09:04.832211 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 09c7979afa3c4fcb83838f29edec3b67 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:09:04.832711 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 09c7979afa3c4fcb83838f29edec3b67 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-09c7979afa3c4fcb83838f29edec3b67
I20260709 13:09:04.848884 23016 tablet_copy_source_session.cc:215] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:04.867895 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:04.869232 24562 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:04.870116 24562 tablet_bootstrap.cc:492] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:04.870755 24562 ts_tablet_manager.cc:1403] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.012s
I20260709 13:09:04.872915 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c7979afa3c4fcb83838f29edec3b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.904366 24575 ts_tablet_manager.cc:933] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:09:04.911381 24562 raft_consensus.cc:359] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:04.912326 24562 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:04.912938 24562 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:04.923388 24562 ts_tablet_manager.cc:1434] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 13:09:04.924978 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-e45d03aff8ab48f6bc531f18ca6d386c received from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:04.925861 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-e45d03aff8ab48f6bc531f18ca6d386c on tablet e45d03aff8ab48f6bc531f18ca6d386c with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:04.942736 24575 tablet_copy_client.cc:323] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:09:04.944389 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet 7c435cd2efc84579b5b18dbaa04ee538 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:09:04.944720 24569 tablet_copy_client.cc:806] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:04.944901 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet 7c435cd2efc84579b5b18dbaa04ee538 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-7c435cd2efc84579b5b18dbaa04ee538
I20260709 13:09:04.945276 24569 tablet_copy_client.cc:670] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:04.949501 24569 tablet_copy_client.cc:538] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:04.953476 22941 tablet_copy_source_session.cc:215] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:04.957502 24575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c435cd2efc84579b5b18dbaa04ee538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.960201 24569 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:04.979249 24575 tablet_copy_client.cc:806] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:04.979889 24575 tablet_copy_client.cc:670] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:04.983251 24575 tablet_copy_client.cc:538] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:04.995573 24569 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:04.995985 24562 ts_tablet_manager.cc:933] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:09:04.996646 24569 tablet_bootstrap.cc:492] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:04.997679 24575 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:04.998651 24569 ts_tablet_manager.cc:1403] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.004s
I20260709 13:09:05.001881 24569 raft_consensus.cc:359] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:05.002772 24569 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:05.003461 24569 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:05.007114 24569 ts_tablet_manager.cc:1434] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:05.007411 22928 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.008936 24565 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.028738 24562 tablet_copy_client.cc:323] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:09:05.030855 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:09:05.031359 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet a2c9f6da39cd452dbbc2fe4221c4b7ee from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-a2c9f6da39cd452dbbc2fe4221c4b7ee
I20260709 13:09:05.039324 22941 tablet_copy_source_session.cc:215] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:05.041368 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-09c7979afa3c4fcb83838f29edec3b67 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:09:05.041859 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-09c7979afa3c4fcb83838f29edec3b67 on tablet 09c7979afa3c4fcb83838f29edec3b67 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:05.061028 24562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:05.064283 24575 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:05.065263 24575 tablet_bootstrap.cc:492] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:05.073124 23073 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.084758 24540 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:05.095811 24575 ts_tablet_manager.cc:1403] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.034s
I20260709 13:09:05.099176 24575 raft_consensus.cc:359] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:05.108824 24575 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:05.109516 24575 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:05.111227 23654 raft_consensus.cc:1217] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:05.112618 24575 ts_tablet_manager.cc:1434] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:09:05.127122 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-7c435cd2efc84579b5b18dbaa04ee538 received from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:05.127542 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-7c435cd2efc84579b5b18dbaa04ee538 on tablet 7c435cd2efc84579b5b18dbaa04ee538 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:05.132061 24562 tablet_copy_client.cc:806] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:05.132660 24562 tablet_copy_client.cc:670] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:05.145702 24562 tablet_copy_client.cc:538] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:05.155308 24562 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:05.169297 23654 raft_consensus.cc:1217] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:05.181880 24562 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:05.182879 24562 tablet_bootstrap.cc:492] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:05.183607 24562 ts_tablet_manager.cc:1403] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.013s
I20260709 13:09:05.188181 24562 raft_consensus.cc:359] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:05.188877 24562 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:05.189491 24562 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:05.192291 24562 ts_tablet_manager.cc:1434] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:05.193926 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-a2c9f6da39cd452dbbc2fe4221c4b7ee received from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:05.194345 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-a2c9f6da39cd452dbbc2fe4221c4b7ee on tablet a2c9f6da39cd452dbbc2fe4221c4b7ee with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:05.238380 23654 raft_consensus.cc:1217] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:05.556540 24510 raft_consensus.cc:1064] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:05.559497 24510 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:05.567046 23073 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.567176 22928 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.568693 23654 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.568689 24556 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:05.570119 24483 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.571587 24510 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.574093 24546 raft_consensus.cc:1064] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:05.581202 24546 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:05.607127 23656 raft_consensus.cc:1217] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:09:05.645102 23080 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.646996 24445 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.647928 23657 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.649827 24533 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.651325 23073 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.656534 24510 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.659789 23000 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.664606 24593 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.671350 23656 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.684926 22928 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.685287 24546 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.694356 22828 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.702967 23080 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.707737 23000 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.718977 23656 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.792878 24593 raft_consensus.cc:1064] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:05.796965 24593 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:05.811295 23073 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.811820 23000 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.813171 24445 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.814792 24593 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.815528 23656 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:05.816996 24445 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.830467 23002 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:05.837078 22828 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.848047 23656 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.849450 24483 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.854671 23080 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.857210 24546 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.859242 24483 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.862596 23656 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.862900 23654 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.866387 22931 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:05.873425 24588 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.875299 23080 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.877591 23656 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.881069 24533 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.884361 24445 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.886931 23000 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.889799 22825 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.893021 23080 raft_consensus.cc:2955] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.902930 24445 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.907377 23076 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.925398 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e45d03aff8ab48f6bc531f18ca6d386c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:05.925310 23654 raft_consensus.cc:2955] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.928078 22827 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 4 to 5, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.935103 23080 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:05.949805 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 09c7979afa3c4fcb83838f29edec3b67 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:05.957999 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet e45d03aff8ab48f6bc531f18ca6d386c with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52140
I20260709 13:09:05.962034 22825 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 4 to 5, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.966816 24607 tablet_replica.cc:333] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:09:05.970475 24607 raft_consensus.cc:2243] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.971189 24607 raft_consensus.cc:2272] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.975380 24607 ts_tablet_manager.cc:1916] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:05.979357 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 09c7979afa3c4fcb83838f29edec3b67 with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49884
I20260709 13:09:05.981034 24608 tablet_replica.cc:333] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:09:05.982020 24608 raft_consensus.cc:2243] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.982825 24608 raft_consensus.cc:2272] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.986372 24608 ts_tablet_manager.cc:1916] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:05.989640 22931 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:05.993592 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:05.997810 23654 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.999313 24445 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.999578 23000 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:06.001161 24605 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:06.006250 24605 raft_consensus.cc:1064] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:06.007793 24546 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.010289 24607 ts_tablet_manager.cc:1929] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:06.010932 24607 log.cc:1199] T e45d03aff8ab48f6bc531f18ca6d386c P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/e45d03aff8ab48f6bc531f18ca6d386c
I20260709 13:09:06.013314 24605 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:06.014575 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet e45d03aff8ab48f6bc531f18ca6d386c (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:06.022238 23002 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.023427 23654 raft_consensus.cc:2955] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.028403 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c435cd2efc84579b5b18dbaa04ee538 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:06.042788 22829 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.048602 23080 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:06.050357 24593 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:06.057333 23657 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:06.058837 24546 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:06.063328 23002 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:06.064599 24445 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:06.061234 24608 ts_tablet_manager.cc:1929] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:06.069088 24608 log.cc:1199] T 09c7979afa3c4fcb83838f29edec3b67 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/09c7979afa3c4fcb83838f29edec3b67
I20260709 13:09:06.073834 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 09c7979afa3c4fcb83838f29edec3b67 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:06.077302 24533 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.083329 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c435cd2efc84579b5b18dbaa04ee538 with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34256
I20260709 13:09:06.081589 23657 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.115789 23080 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.116207 23002 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.124257 24613 tablet_replica.cc:333] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:09:06.125542 24613 raft_consensus.cc:2243] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.126411 24613 raft_consensus.cc:2272] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.128298 22829 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 4 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.136770 24613 ts_tablet_manager.cc:1916] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:06.146878 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:09:06.147444 22999 raft_consensus.cc:606] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:06.152663 22926 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:06.153594 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:06.155148 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:06.157320 23657 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:06.158427 24445 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:06.159590 23080 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:06.164525 24445 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:06.166849 24613 ts_tablet_manager.cc:1929] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:06.167264 24613 log.cc:1199] T 7c435cd2efc84579b5b18dbaa04ee538 P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/7c435cd2efc84579b5b18dbaa04ee538
I20260709 13:09:06.165984 24546 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.170362 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 7c435cd2efc84579b5b18dbaa04ee538 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:06.170931 23657 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.176033 23080 raft_consensus.cc:2955] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.186371 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:06.189189 22829 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 5 to 6, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:06.202383 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet a2c9f6da39cd452dbbc2fe4221c4b7ee with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:52140
I20260709 13:09:06.203306 24607 tablet_replica.cc:333] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:09:06.204301 24607 raft_consensus.cc:2243] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.205034 24607 raft_consensus.cc:2272] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.208127 24607 ts_tablet_manager.cc:1916] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:06.225306 24607 ts_tablet_manager.cc:1929] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:09:06.225641 24607 log.cc:1199] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/a2c9f6da39cd452dbbc2fe4221c4b7ee
I20260709 13:09:06.229653 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet a2c9f6da39cd452dbbc2fe4221c4b7ee (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:06.585361 24588 raft_consensus.cc:993] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:06.585844 24483 raft_consensus.cc:1081] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:06.588229 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:09:06.588647 23080 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:06.588927 23080 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.593009 23080 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:06.594866 23080 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:06.596387 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:06.596712 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:06.596891 23654 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.597231 23002 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:06.597527 23002 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:06.598249 23002 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:06.600145 23002 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.602973 23654 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:06.604184 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:06.605499 24591 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:06.605986 24591 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:06.607000 23002 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:06.607378 24591 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:06.617975 22825 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.069060 22999 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:07.070209 24475 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:07.081063 23654 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:07.086037 24475 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:07.156239 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:07.270618 22999 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:07.279899 23080 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:07.281361 22926 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:07.282287 22971 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca18e836a5464ec5b09378b03ae8b23f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:07.283468 24483 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.284309 24588 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.293291 24588 raft_consensus.cc:2955] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.294860 22926 raft_consensus.cc:2955] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.295572 23080 raft_consensus.cc:2955] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.310312 22825 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 2, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 1 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.315838 23080 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:07.323025 22999 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:07.324014 22926 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:07.324445 24475 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:07.325556 24591 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:07.329113 23045 consensus_peers.cc:597] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e54cbb7e06ba404b91d84809d3aa8548. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:07.336393 24475 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.337611 22931 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.357941 23002 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.376168 22931 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:07.379112 22825 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.388319 23073 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:09:07.389698 22896 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 590119d9a7e74f099c0a28550f4fb3f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:07.390635 24445 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:07.395740 23002 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:07.397166 24445 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:07.399523 24445 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.404791 23073 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.421181 23002 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:07.435909 22931 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:08.206969 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:08.403580 22828 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index -1 to 3, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:08.494275 24646 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:08.494843 24535 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.495056 24646 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.498696 24646 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.495414 24535 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.504444 24535 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:08.508839 24644 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.509873 24644 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.517351 24644 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.513945 24643 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:08.520570 24643 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.519457 23002 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:08.522727 24643 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.527535 24644 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:08.538411 24483 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.538980 24483 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.540853 24483 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.541177 24643 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:08.541720 24643 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:08.546947 23043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.003s	sys 0.010s
W20260709 13:09:08.547262 23043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.003s	sys 0.010s
I20260709 13:09:08.547930 24634 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.548547 24634 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:08.550536 24634 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:08.543628 24643 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:08.557160 22896 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adf5adaae5184191bdaff064d051da2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.559576 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:08.560653 23077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:09:08.561271 23077 raft_consensus.cc:606] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:09:08.564842 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:08.565476 24648 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:08.568569 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:08.567277 24648 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:08.595883 22860 debug-util.cc:398] Leaking SignalData structure 0x7b0800091a20 after lost signal to thread 21778
W20260709 13:09:08.597054 22860 debug-util.cc:398] Leaking SignalData structure 0x7b08000395e0 after lost signal to thread 22863
W20260709 13:09:08.597421 22860 debug-util.cc:398] Leaking SignalData structure 0x7b08000396a0 after lost signal to thread 22877
W20260709 13:09:08.632534 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 56483.8us
I20260709 13:09:08.633224 24475 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.635182 24475 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:08.638047 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:08.639945 22828 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 356) took 1199 ms. Trace:
I20260709 13:09:08.642198 24658 ts_tablet_manager.cc:933] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:08.646613 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 70203.6us
I20260709 13:09:08.648180 24475 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:08.649068 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:08.650846 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:08.651746 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:08.651922 24649 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:08.652652 24649 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.655469 24649 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.647840 24646 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.697662 24662 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:08.698169 24662 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.699913 24643 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.700070 24662 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.700078 24483 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.700451 24643 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.700877 24483 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:08.701857 24662 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.702505 24643 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.702723 24662 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.703110 24483 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:08.703902 24639 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.798171 24483 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.798729 24483 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.800616 24661 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:08.799693 24643 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.703902 24653 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.704473 24639 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.640511 22828 rpcz_store.cc:276] 0709 13:09:07.440991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.441386 (+   395us) service_pool.cc:224] Handling call
0709 13:09:08.639837 (+1198451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:08.470621 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:08.471202 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:08.471235 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:09:08.471252 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:08.471558 (+   306us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:08.471622 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:08.471648 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:08.471848 (+   200us) tablet.cc:701] Row locks acquired
0709 13:09:08.471862 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:09:08.471996 (+   134us) write_op.cc:270] Start()
0709 13:09:08.472108 (+   112us) write_op.cc:276] Timestamp: P: 1783602548471954 usec, L: 0
0709 13:09:08.472130 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:08.472726 (+   596us) log.cc:844] Serialized 599 byte log entry
0709 13:09:08.518729 (+ 46003us) op_driver.cc:464] REPLICATION: finished
0709 13:09:08.521423 (+  2694us) write_op.cc:301] APPLY: starting
0709 13:09:08.521495 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:08.521604 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:08.521700 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:08.521881 (+   181us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:08.522022 (+   141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:08.522062 (+    40us) write_op.cc:312] APPLY: finished
0709 13:09:08.522270 (+   208us) log.cc:844] Serialized 23 byte log entry
0709 13:09:08.522420 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:08.522494 (+    74us) write_op.cc:454] Released schema lock
0709 13:09:08.522529 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:08.522807 (+   278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:08.522833 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":2477,"apply.run_cpu_time_us":1360,"apply.run_wall_time_us":1360,"num_ops":1,"prepare.queue_time_us":63876,"prepare.run_cpu_time_us":2373,"prepare.run_wall_time_us":2373,"replication_time_us":46432}]]}
I20260709 13:09:08.800671 24631 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.801317 24647 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.823623 24631 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:08.840179 24641 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:08.815083 24535 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:08.822505 24643 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.843019 24483 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.814080 24648 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.847679 24666 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.848377 24666 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:08.851397 24667 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.852115 24667 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.801606 24646 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:08.572724 24644 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:08.822108 24591 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:08.859388 24483 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.840231 24655 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:08.821195 24661 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:08.927259 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:09.074119 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 190012us
I20260709 13:09:08.861119 24483 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:09.078498 24668 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.085681 24483 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.086963 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.089576 24670 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.091275 24640 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.021317 24660 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.017793 24654 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:08.858409 24648 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:08.856114 24535 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.100834 24646 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.101262 24657 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.025264 24650 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.021626 24664 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.008694 24671 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.099228 24631 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:08.862476 24591 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.100478 24652 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.025431 24651 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.115006 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.115646 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.138397 24631 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.109504 24639 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:08.846457 24641 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.079157 24668 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.092082 24640 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.129467 24675 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.109696 24648 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:09.112370 24671 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.207854 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.129774 24650 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.202648 24643 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.193696 24639 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.207506 24658 tablet_copy_client.cc:323] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:09:09.077471 24655 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.228677 22825 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35510 (request call id 339) took 1772 ms. Trace:
I20260709 13:09:09.109158 24660 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.222795 24661 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.090423 24670 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:09.215965 24669 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:08.846361 24647 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.216967 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.229095 22825 rpcz_store.cc:276] 0709 13:09:07.455819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.479225 (+ 23406us) service_pool.cc:224] Handling call
0709 13:09:09.228621 (+1749396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1018633,"reported_tablets":1}
I20260709 13:09:09.239022 23080 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:09:09.189297 24631 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:09.215636 24650 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.113234 24654 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:08.845355 24653 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.124802 24664 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.228785 24641 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:09.248255 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 172788us
I20260709 13:09:09.111891 24657 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.278656 24647 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:09.204355 24651 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.238616 24673 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.250306 24661 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.208684 24675 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.236163 24672 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.230597 24639 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.286121 24647 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.192251 24652 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.303409 24677 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.300695 24591 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.306999 24535 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:09.297950 24661 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.271060 24669 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.289464 24680 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.311352 24640 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.331105 24669 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.307642 24647 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.313568 24655 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.357849 24540 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.358554 24540 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.308135 24672 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.386052 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:09.395794 24483 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.520138 24483 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.359984 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.524039 23654 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:09.412191 24475 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.361171 24445 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.525132 24475 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.361716 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.525188 24445 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.503826 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:09.399953 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.322598 24677 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.333262 24648 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:09.334892 24640 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.539027 23079 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:09.556815 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.559019 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.580009 23656 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:09.566959 24445 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.413849 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:09.582536 24483 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:09.584663 23622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.015s	sys 0.035s
W20260709 13:09:09.585124 23622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.016s	sys 0.035s
I20260709 13:09:09.587054 24533 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.590857 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:09.590219 24475 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.362224 24630 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.411296 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.395560 24645 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.588308 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 1677) took 1044 ms. Trace:
I20260709 13:09:09.591725 24533 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.355926 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.369195 24662 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.594755 24483 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:09.447554 24656 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.498557 24668 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.356755 24655 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.397884 24676 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.369154 24591 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.406152 24634 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.309245 24673 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.397486 24650 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.396780 24646 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.498924 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.337604 24680 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.601137 24669 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.647255 24669 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.602581 24663 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.602771 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:09.603389 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 83477.2us
I20260709 13:09:09.603621 24690 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.561841 24631 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:09.592492 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:09.610463 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:09.555809 24675 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.446797 24664 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.611354 23079 rpcz_store.cc:276] 0709 13:09:08.534647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.399534 (+864887us) service_pool.cc:224] Handling call
0709 13:09:09.579461 (+179927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.397137 24621 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.612030 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:09.587739 24644 consensus_meta.cc:287] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:09:09.614015 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:09.614395 24483 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:09.578559 24667 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.617198 24684 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.415369 24671 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.617286 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.617918 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:09.621420 24445 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:09.625165 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:09.626982 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:09.610378 22860 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef8a0 after lost signal to thread 22955
I20260709 13:09:09.359922 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.638032 24651 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.638214 24634 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.639149 24665 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:09.590525 24640 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.611239 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet ca18e836a5464ec5b09378b03ae8b23f from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:09:09.617890 24540 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.618076 23649 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:09.645274 24646 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.627472 24666 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.648314 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.630112 24660 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.625819 24645 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.935878 24672 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:09.940467 24677 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:09.940618 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 526820us
I20260709 13:09:09.639588 24630 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.942471 23075 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:09.942507 24621 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.631974 24639 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.944056 22997 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 1.
I20260709 13:09:09.943861 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.648904 24656 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:09.868821 24654 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.944808 24621 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:09.922916 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 313491us
I20260709 13:09:09.879899 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:09.951782 24483 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.954087 24445 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.949906 23002 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:09.951099 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:09.938511 24533 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.751820 24663 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.847985 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:09.943573 24634 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.631574 24591 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.848313 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:09.629727 24655 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:09.760720 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 560) took 1227 ms. Trace:
I20260709 13:09:10.099702 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.172526 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.095901 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.174378 24677 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:09.991042 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.168624 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:10.116693 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 165630us
I20260709 13:09:10.176682 23655 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:10.177654 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.001114 23000 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:10.178177 22931 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:09:10.069536 24445 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.783922 24647 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:09.946986 24661 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.176285 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:09.935395 24680 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:09.760768 24694 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.185663 24483 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:09.761970 24689 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.186236 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.184221 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.846921 24673 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:09.645901 24657 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.192752 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.163578 24666 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:10.197227 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.168289 24644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52574 (request call id 14) took 2721 ms. Trace:
I20260709 13:09:09.695647 24670 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.148862 24651 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.196183 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.095829 24649 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.198143 22922 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:09.988288 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet ca18e836a5464ec5b09378b03ae8b23f from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-ca18e836a5464ec5b09378b03ae8b23f
I20260709 13:09:09.925582 24652 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.200726 24483 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.128278 24669 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.113874 24675 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.104581 24621 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.105917 24686 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.180184 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:09.671824 24650 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.190618 24677 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:10.255095 22999 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:09.639801 24676 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.000509 24631 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.179065 24540 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.190775 24667 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.236765 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.239111 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:10.263674 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 87445.8us
I20260709 13:09:10.241387 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.994976 24665 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:10.242568 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.175455 23652 rpcz_store.cc:276] 0709 13:09:08.533605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.451939 (+918334us) service_pool.cc:224] Handling call
0709 13:09:09.760620 (+308681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:10.243786 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.976051 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.223070 24680 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.269610 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:10.231730 22860 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8ee0 after lost signal to thread 23030
I20260709 13:09:10.242188 24693 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:10.236534 23619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.031s	sys 0.059s
I20260709 13:09:09.991967 23653 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:09:10.231510 24651 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.233124 24645 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.306457 24646 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.254343 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.327076 24692 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:10.328096 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.077848 24684 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.244342 23045 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:10.296790 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.297469 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.247536 24656 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.234236 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.332731 24677 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:10.328438 23619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.031s	sys 0.066s
I20260709 13:09:10.301340 23016 tablet_copy_source_session.cc:215] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:10.334156 24684 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.325167 24651 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.326153 24591 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:10.230746 24644 rpcz_store.cc:276] 0709 13:09:07.429199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.434097 (+  4898us) service_pool.cc:224] Handling call
0709 13:09:07.440058 (+  5961us) log.cc:844] Serialized 506 byte log entry
0709 13:09:08.452384 (+1012326us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b1800315460. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:08.531451 (+ 79067us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800315460. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:08.572976 (+ 41525us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b1800315460. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1a455 00007f3924f63b0b 00007f3924fe8b63 00007f3925010752 00007f3929fd0d29
0709 13:09:09.360233 (+787257us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b1800315460. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:10.130004 (+769771us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42,"raft.queue_time_us":335,"raft.run_cpu_time_us":1163,"raft.run_wall_time_us":1163,"spinlock_wait_cycles":41297408,"thread_start_us":69411,"threads_started":2,"wal-append.queue_time_us":5898,"wal-append.run_cpu_time_us":1633,"wal-append.run_wall_time_us":1008123}
I20260709 13:09:10.301317 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.300940 23621 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.337217 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.327016 24665 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.325289 24660 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.338614 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.266057 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.352120 23075 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:10.352084 22922 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:10.232839 24666 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.302546 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.303130 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.245611 24649 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:10.269451 24630 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:10.343941 24663 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.340000 24642 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.265275 24696 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.262651 24686 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:10.001003 24690 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.269376 24680 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.269812 24641 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.269706 24640 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.251017 24621 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.249209 24675 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.304808 23072 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:09:10.269238 24540 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.269637 24667 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.374820 22928 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:10.375419 24621 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.316013 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.245344 24694 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.375888 24667 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.269069 24631 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.317692 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.253962 24674 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.234849 24689 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.325912 22896 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:10.326215 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.327198 24653 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.361660 24642 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:10.329174 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 84886.4us
I20260709 13:09:10.329689 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.386322 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:09.849053 23004 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:10.330868 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.327801 24692 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.326985 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.332780 24655 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.297058 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.336900 24672 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.245959 24588 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.354128 23000 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:10.393365 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.393618 24672 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.356127 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.357820 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.324002 24693 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.341801 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.344043 24669 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.361115 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.296715 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.362947 22970 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:10.397046 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:10.339990 22860 debug-util.cc:398] Leaking SignalData structure 0x7b0800350960 after lost signal to thread 23104
I20260709 13:09:10.364745 23006 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.365463 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.404484 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.368093 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.332744 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.369130 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.361778 24696 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.368126 24664 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:10.371809 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.372681 24641 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.341638 24644 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:10.373389 24675 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.374155 24540 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.376220 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.303848 24650 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.378535 24703 ts_tablet_manager.cc:933] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.420429 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.366324 24680 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.422413 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.380460 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.381743 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.382115 24690 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:10.242146 24681 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:10.344314 24660 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.383507 24640 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.343875 24676 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.386722 22997 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:09:10.387172 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.387297 22998 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:10.389722 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.390059 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.436934 24640 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.441082 24640 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.441443 24660 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.435879 24702 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.447431 24702 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.447943 24702 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.448343 24686 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.384490 24674 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.392212 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.392356 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.393070 24649 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.395030 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.396776 24588 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:10.399904 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.402490 22970 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:10.366950 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 66073.4us
I20260709 13:09:10.405594 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.456544 23621 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:10.456736 24674 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.457633 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca18e836a5464ec5b09378b03ae8b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.457696 24674 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.458365 24674 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.458709 24674 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.405233 22925 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:10.406327 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.406438 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:10.408110 22860 debug-util.cc:398] Leaking SignalData structure 0x7b080024c0c0 after lost signal to thread 23681
I20260709 13:09:10.408324 24693 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.408257 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.408674 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.395237 24672 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.412034 24642 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.412057 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.412757 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.412865 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.413134 24664 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.469169 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.413412 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.404156 24669 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:10.380350 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 54516.2us
I20260709 13:09:10.465870 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.423467 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:10.423133 22924 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 1.
I20260709 13:09:10.429963 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.430466 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.435707 24692 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.421245 24639 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.482229 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.484426 23075 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:10.390529 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 53728.2us
I20260709 13:09:10.440466 22926 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:10.438098 24630 raft_consensus.cc:993] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:10.440541 24621 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:10.391064 22971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.707s (SENT) [suppressed 5 similar messages]
I20260709 13:09:10.459997 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:10.460201 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 57814.9us
I20260709 13:09:10.462889 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.500910 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.502099 23045 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.502679 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:10.468083 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.468218 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.503362 23045 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.436738 24689 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.469756 23005 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 1.
W20260709 13:09:10.490496 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 138473us
I20260709 13:09:10.465766 24686 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.506884 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.508637 24630 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.511521 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.505432 23046 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:10.466404 24666 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.481882 24664 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:10.525154 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:10.533541 23046 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:10.534420 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.535629 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.536958 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.547410 23621 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:10.549149 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.550625 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.512677 23622 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.552940 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.554412 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.550580 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.557343 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.557471 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.561635 23078 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:09:10.532704 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.561861 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.558043 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.557989 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:10.510605 24692 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.558652 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.509202 24686 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.572247 24697 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.580037 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:10.581293 24694 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.582907 24669 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:10.523407 24680 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.586793 24680 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.437561 24681 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:10.587740 22931 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:10.587245 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.534085 24703 tablet_copy_client.cc:323] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:09:10.575722 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 570) took 1016 ms. Trace:
I20260709 13:09:10.576265 24678 raft_consensus.cc:1081] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:10.576371 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.573343 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.554317 24630 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:10.589203 23006 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:10.596052 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:10.610646 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 50334us
I20260709 13:09:10.611188 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.611310 23046 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:10.597731 24445 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.554780 24693 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.612023 24445 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.599103 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:10.612425 24445 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.600039 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.588152 24686 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.600350 23075 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:10.559137 24684 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.604907 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:10.606137 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 214681us
I20260709 13:09:10.565054 24591 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.607560 23000 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:10.568249 24692 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.574604 24660 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.609436 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:10.614909 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.615612 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.601224 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:10.640957 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 115909us
I20260709 13:09:10.626242 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.620169 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.523478 24642 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:09:10.636596 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.648587 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.649333 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.637923 24709 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.649999 24709 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.650475 24709 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.638839 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.621958 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.642037 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:10.652966 24711 ts_tablet_manager.cc:933] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:09:10.642031 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:10.605454 24588 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.654767 24710 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.655732 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.656718 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:10.656930 23622 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.618690 24644 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.627521 24689 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.661871 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.627091 24639 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.636488 24591 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:10.627353 24684 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.639257 24692 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.671355 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.655198 24710 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.655857 24645 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.639438 24660 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:10.613298 24702 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.656015 24540 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.686199 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.663286 24654 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.710348 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.716132 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.657429 24690 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.688321 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:10.662344 24697 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.725054 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.726514 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.676693 24631 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.680604 24591 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:10.732712 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44503.5us
I20260709 13:09:10.732903 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.675274 24696 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:10.669515 24689 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.668948 24665 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.741721 24681 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.742241 24701 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.731144 24650 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.742784 24701 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.743069 24650 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:10.743346 24701 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.736984 24646 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.659710 24651 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.679330 24684 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.740023 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.687634 24645 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.715430 24660 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.743470 24650 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.738339 24655 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.747001 24445 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.689159 24710 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.717285 24649 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.730038 24709 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.750696 24707 ts_tablet_manager.cc:933] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
I20260709 13:09:10.717245 24540 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.755558 24645 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.734282 24653 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.733445 22971 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.740535 24689 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.764374 23002 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:10.608857 23650 rpcz_store.cc:276] 0709 13:09:09.408949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.433228 (+ 24279us) service_pool.cc:224] Handling call
0709 13:09:10.317108 (+883880us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:10.323778 (+  6670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.397385 (+ 73607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.398402 (+  1017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.403884 (+  5482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:10.403922 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.425487 (+ 21565us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b5400554454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:10.425540 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.425662 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186314752}
I20260709 13:09:10.752621 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:10.760558 24646 raft_consensus.cc:697] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:10.791805 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 58441.7us
I20260709 13:09:10.774447 24540 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:10.797345 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 142159us
I20260709 13:09:10.783106 24674 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.811626 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.817961 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.819104 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.820951 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:10.821820 24483 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.789732 24621 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:10.823338 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.760392 24672 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.796938 24696 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.855187 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:10.860278 24653 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.860357 24718 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.862643 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:10.863301 24718 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.798997 24663 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:10.912087 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 47927.6us
I20260709 13:09:10.854429 24621 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.857246 24681 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.863637 24718 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:10.848804 24698 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.929534 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:10.930157 22998 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:10.921746 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 100857us
I20260709 13:09:10.936656 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:10.927414 24646 consensus_queue.cc:237] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:10.916366 24643 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:10.969825 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 204189us
I20260709 13:09:11.062177 24722 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:11.062897 24722 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:11.066830 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 66268.3us
I20260709 13:09:10.948894 24718 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.948266 24711 tablet_copy_client.cc:323] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
I20260709 13:09:11.078626 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:11.037792 24702 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:10.924506 24663 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:10.936373 24651 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:11.101236 24640 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 13:09:11.114156 22972 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.115562 22972 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:11.099872 24707 tablet_copy_client.cc:323] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.193:39171
W20260709 13:09:11.142918 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 531654us
I20260709 13:09:11.143558 23046 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.143864 22972 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.144850 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:09:11.150471 24686 consensus_meta.cc:287] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.003s
I20260709 13:09:11.150863 24686 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.154254 22972 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.155447 22972 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.110889 24724 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.055274 24684 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.135540 24715 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:11.136507 24631 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:11.160034 24696 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.139214 24709 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.156145 24651 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.142802 24646 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.169485 24646 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:11.169945 24646 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.160260 24724 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:11.116917 24640 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.163630 24674 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.180660 24445 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.167040 24696 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:11.205353 24540 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.168851 24672 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.205473 24718 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.206001 24650 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.177768 24724 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.214176 24540 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:11.183844 24663 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.206671 24714 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.191956 24696 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.167900 24631 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.207082 24651 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:11.215694 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 150125us
I20260709 13:09:11.176082 24715 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.233969 24716 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.205349 24646 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.247793 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:11.250794 23657 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.254127 23656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47784
I20260709 13:09:11.254776 23656 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.255167 23656 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.245913 23001 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:11.274189 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 130693us
I20260709 13:09:11.274614 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:11.275169 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:11.278432 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:11.268077 24718 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:11.281946 23046 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:11.280354 24695 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.286466 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:11.280066 23656 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.287084 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:11.289484 23079 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.278856 24722 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:11.290872 24591 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.003s
I20260709 13:09:11.290930 24631 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.278136 24686 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.278209 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.279315 24709 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.284971 24714 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.283733 24641 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.286659 24684 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.288193 24727 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:11.304880 24640 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.305249 24727 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.306941 24727 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:11.303002 24714 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:11.303892 24650 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:11.308781 24710 consensus_meta.cc:287] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.003s
I20260709 13:09:11.310982 24714 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.312669 24715 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:11.316556 24689 consensus_meta.cc:287] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.000s
I20260709 13:09:11.316881 24689 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.317600 24696 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.318368 24689 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:11.311184 24710 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.319211 24696 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:11.313807 24701 consensus_meta.cc:287] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.005s
I20260709 13:09:11.320235 24701 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.320848 24710 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.321571 24701 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:11.352427 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 196777us
I20260709 13:09:11.356673 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.360208 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:11.364558 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:11.367799 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:11.369786 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 87803.1us
I20260709 13:09:11.370317 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:11.371150 23046 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:11.291381 24591 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:11.380025 24710 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.380764 24591 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:11.382922 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.386164 24686 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.393544 23072 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.393597 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.406754 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1444) took 1064 ms. Trace:
I20260709 13:09:11.407245 23001 rpcz_store.cc:276] 0709 13:09:10.342706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.669421 (+326715us) service_pool.cc:224] Handling call
0709 13:09:10.749873 (+ 80452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.271441 (+521568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.406251 (+134810us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54002e36d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:11.406587 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124448128}
I20260709 13:09:11.420521 24646 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.425673 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:11.429177 24660 consensus_meta.cc:287] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.004s
I20260709 13:09:11.429970 24660 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:11.440231 24692 consensus_meta.cc:287] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.727s	user 0.003s	sys 0.009s
I20260709 13:09:11.442369 24670 raft_consensus.cc:3055] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.442865 24670 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:11.444360 24670 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.452283 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.413343 24591 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.458685 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:11.440865 24692 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.479686 24692 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.472054 23653 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.476372 24724 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.503116 24658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47800 (request call id 555) took 2977 ms. Trace:
I20260709 13:09:11.503636 24658 rpcz_store.cc:276] 0709 13:09:08.525386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.525507 (+   121us) service_pool.cc:224] Handling call
0709 13:09:08.642489 (+116982us) ts_tablet_manager.cc:934] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
0709 13:09:10.456401 (+1813912us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:10.798191 (+341790us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:10.819296 (+ 21105us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:11.280046 (+460750us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:11.290031 (+  9985us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:11.502728 (+212697us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:11.502866 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":75247,"tablet-copy.queue_time_us":116078,"thread_start_us":333739,"threads_started":2}
I20260709 13:09:11.505782 24658 tablet_copy_client.cc:806] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:11.506619 24658 tablet_copy_client.cc:670] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:09:11.495841 24645 consensus_meta.cc:287] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.706s	user 0.003s	sys 0.012s
I20260709 13:09:11.507532 24645 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.508788 23002 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.509244 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.509878 24645 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.511184 24660 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:11.511397 24724 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:11.511430 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 155089us
I20260709 13:09:11.453508 24670 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.515034 22972 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.515377 24715 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:11.516247 24715 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.517542 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.518776 24715 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.519238 24724 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.520051 24724 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:11.521130 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50679.5us
I20260709 13:09:11.524375 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:11.528986 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:11.532617 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.537501 22998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1428) took 1373 ms. Trace:
I20260709 13:09:11.540334 24647 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:11.540784 24647 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:11.541159 24647 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.541316 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.545163 23656 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.537963 22998 rpcz_store.cc:276] 0709 13:09:10.164446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.440072 (+275626us) service_pool.cc:224] Handling call
0709 13:09:10.929988 (+489916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.999506 (+ 69518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.537002 (+537496us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540030e8d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:11.537302 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125945088}
I20260709 13:09:11.551925 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.550102 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.556831 22828 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index -1 to 5, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.558203 24689 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:11.559787 24708 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.560168 24708 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:11.561465 24708 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.563860 24708 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.564117 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.566220 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:11.567278 23072 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 2: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:11.568121 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.570291 24645 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.571722 23005 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.572126 23002 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.575255 22940 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet 590119d9a7e74f099c0a28550f4fb3f5 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
W20260709 13:09:11.636445 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 112273us
W20260709 13:09:11.644136 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 126733us
I20260709 13:09:11.642246 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.580166 22941 tablet_copy_service.cc:140] P 0db2f61e34a24096a5baf0de9a32d4f7: Received BeginTabletCopySession request for tablet adf5adaae5184191bdaff064d051da2a from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:52582)
I20260709 13:09:11.630633 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.582638 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.689190 23079 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:11.636650 23650 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.565119 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.644745 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:11.693655 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.583742 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:11.580273 22940 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet 590119d9a7e74f099c0a28550f4fb3f5 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-590119d9a7e74f099c0a28550f4fb3f5
I20260709 13:09:11.703534 22930 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.704512 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.705935 23072 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.654397 24647 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.635533 24714 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.722020 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:11.723224 24643 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:11.724025 24643 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:11.726153 24643 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.717505 24715 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:11.727702 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.728628 24715 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.729007 24715 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:11.731310 23006 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.731869 24639 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:11.732048 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.731959 24724 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.732360 24733 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:11.733026 22998 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 2: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:11.733026 24639 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.733155 24724 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.733621 24709 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.733842 24724 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:11.734086 24709 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:11.734247 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.735164 24709 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.736555 24709 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.733641 24639 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:11.735471 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:11.734943 24724 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:11.731643 22970 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:11.744621 23002 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 2: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:11.742342 22972 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.719018 22941 tablet_copy_service.cc:161] P 0db2f61e34a24096a5baf0de9a32d4f7: Beginning new tablet copy session on tablet adf5adaae5184191bdaff064d051da2a from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:52582: session id = 01988c2c817947859340a730b7f1247d-adf5adaae5184191bdaff064d051da2a
I20260709 13:09:11.752612 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.753211 24643 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.754225 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.743072 24724 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.730012 24715 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.754242 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:11.750929 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 119575us
I20260709 13:09:11.756986 24639 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.757690 24647 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:11.754520 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.758260 24734 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.759497 24645 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.760056 24645 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:11.756341 23078 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:11.760756 24650 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.761261 24645 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.765275 24724 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.766482 22940 tablet_copy_source_session.cc:215] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:11.768172 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.769300 24725 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.769775 22972 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.770562 24725 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.771522 22930 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:11.759989 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.776187 24725 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.776906 24715 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.758952 24639 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.779567 22999 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:11.750905 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:11.787215 22970 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:11.788354 24734 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:11.788709 24734 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:11.789151 24734 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.789942 24591 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:11.790911 24647 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.791249 24647 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:11.795120 24647 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.798058 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:11.788587 24621 consensus_meta.cc:287] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.838s	user 0.004s	sys 0.014s
I20260709 13:09:11.803126 23002 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.804975 24647 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.805701 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.813457 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.814206 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.815375 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.821154 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.833509 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.805476 24621 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.839836 22922 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.839766 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.841316 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:11.842481 24707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590119d9a7e74f099c0a28550f4fb3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.857896 24660 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.858388 24660 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:11.859145 24621 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.859338 24660 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.845777 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.846766 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.866197 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.847267 24714 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:11.868193 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:11.847832 24734 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:11.869019 23078 raft_consensus.cc:2393] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:11.852381 23075 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:11.852990 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:11.854089 23072 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.872546 23004 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.872749 22999 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.854120 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:11.855976 23073 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.873795 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.874257 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:11.856735 23001 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.874610 24621 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:11.875877 24621 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:11.876200 24621 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:11.877378 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:11.877905 23076 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.878119 24715 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.879133 24715 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:11.880146 24715 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:11.884763 22941 tablet_copy_source_session.cc:215] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:11.884855 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.885813 23002 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:11.886315 23076 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:11.877113 24621 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.886693 24734 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:11.906536 23075 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.907059 24680 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:11.907557 24654 consensus_queue.cc:1059] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:11.909175 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.909847 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.908517 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.925626 22825 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.927232 24680 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.927596 24680 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:11.928534 24680 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.929090 24670 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.929883 24680 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.930305 24670 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.930685 24670 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:11.911800 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:11.912582 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.912906 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.913398 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.914332 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.922144 22970 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:11.924243 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.911307 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.937336 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:11.938365 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.939043 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.936590 23077 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:11.940016 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.940227 23074 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:11.942174 24725 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.942986 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.943820 23071 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:11.944418 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 64240.1us
W20260709 13:09:11.946099 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 113811us
I20260709 13:09:11.949231 23077 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:09:11.950511 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:11.951143 24721 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.954365 23076 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:11.953899 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.956734 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:11.959106 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.959522 23075 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:11.959641 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.959822 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:11.960001 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.960517 23651 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:11.960845 23071 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.957520 22972 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:11.964217 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:11.955629 24725 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:11.968976 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:11.969254 24675 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.969686 23075 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:11.958460 24721 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.931624 24670 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:11.974298 24670 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.976384 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:11.978569 23655 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.974951 24711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf5adaae5184191bdaff064d051da2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.967700 24643 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.979319 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:11.963047 24654 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:11.990717 22972 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:11.978354 24725 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:11.996731 24683 consensus_queue.cc:1059] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:11.998505 24445 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:11.998646 24683 consensus_queue.cc:1243] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:11.999231 24683 raft_consensus.cc:3055] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.999130 24445 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:11.999600 24683 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:12.000680 24683 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:12.001339 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.001859 24683 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.002347 23076 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.002586 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.007913 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.004988 24643 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.015837 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.008663 24653 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:12.016114 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 82600.6us
I20260709 13:09:12.016571 23076 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:12.028924 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.028924 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:12.022380 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.033298 24725 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.022420 24653 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:12.036286 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.037084 23076 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:12.037149 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.038748 23072 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.040860 24445 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:12.042032 23072 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.042364 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.043131 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.040818 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.044327 23071 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:12.044533 24654 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.045202 24669 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:12.046751 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.047395 23073 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:12.027154 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:12.047907 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:12.055688 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 46352.6us
I20260709 13:09:12.056915 24693 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.057137 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.057286 24693 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.060398 24693 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.061488 24693 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.061703 24621 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.069655 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.070964 24675 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:12.072448 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.071996 24675 raft_consensus.cc:3055] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.073556 24675 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:12.074005 24669 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.075239 24669 consensus_queue.cc:1059] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:12.072394 24714 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.076239 24669 raft_consensus.cc:3055] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.076647 24669 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.074024 24707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47786 (request call id 406) took 1556 ms. Trace:
I20260709 13:09:12.077462 24658 tablet_copy_client.cc:538] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:12.076359 24714 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:12.080127 24714 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.080821 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet e54cbb7e06ba404b91d84809d3aa8548 from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:43468)
I20260709 13:09:12.081369 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet e54cbb7e06ba404b91d84809d3aa8548 from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:43468: session id = 01988c2c817947859340a730b7f1247d-e54cbb7e06ba404b91d84809d3aa8548
I20260709 13:09:12.081694 23073 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.084040 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.071589 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.087975 24647 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.089339 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.089954 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.091094 24647 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.095975 24669 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.096529 23079 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:12.097297 24669 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.077462 24707 rpcz_store.cc:276] 0709 13:09:10.517390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.517483 (+    93us) service_pool.cc:224] Handling call
0709 13:09:10.784494 (+267011us) ts_tablet_manager.cc:934] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
0709 13:09:11.841041 (+1056547us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:11.866644 (+ 25603us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:11.866747 (+   103us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:12.003490 (+136743us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:12.027849 (+ 24359us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:12.073826 (+ 45977us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:12.073944 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":119005,"tablet-copy.queue_time_us":71677,"thread_start_us":209737,"threads_started":2}
I20260709 13:09:12.099948 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.103988 24707 tablet_copy_client.cc:806] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:12.104574 24707 tablet_copy_client.cc:670] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:12.118043 24704 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.125700 24704 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.126729 24704 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.127933 24707 tablet_copy_client.cc:538] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:12.128049 24704 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.128861 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.132351 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.132301 24683 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:12.133335 24692 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:12.133754 24692 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:12.134533 24658 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:12.134440 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:12.135181 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:12.074764 24675 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.119730 23090 tablet_copy_source_session.cc:215] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:12.137811 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.141013 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:12.145185 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:12.153781 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:12.146914 24647 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.134615 24692 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.156777 24692 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.156242 24675 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.160989 24653 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:12.161653 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.167436 23079 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.168450 23079 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.169504 23079 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.171764 23079 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.175166 23071 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:12.186146 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.187700 24653 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.190145 24653 consensus_queue.cc:1059] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:12.191408 24683 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.191864 24683 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:12.192106 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:12.192905 24683 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.193413 23652 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:12.201725 22930 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:12.194342 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 190235us
I20260709 13:09:12.204275 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:12.204716 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.205863 24724 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.194372 23079 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:12.196667 24683 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.197873 23072 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:12.218261 24707 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:12.224725 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.225306 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.228438 22828 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35496 (request call id 358) took 1577 ms. Trace:
I20260709 13:09:12.229063 24714 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.230319 23076 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:12.232427 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:12.228871 22828 rpcz_store.cc:276] 0709 13:09:10.651466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.651603 (+   137us) service_pool.cc:224] Handling call
0709 13:09:12.228353 (+1576750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:11.748141 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:11.751797 (+  3656us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:11.751848 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:09:11.751880 (+    32us) tablet.cc:662] Decoding operations
0709 13:09:11.752339 (+   459us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:11.752435 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:11.752460 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:11.752778 (+   318us) tablet.cc:701] Row locks acquired
0709 13:09:11.752822 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:09:11.752997 (+   175us) write_op.cc:270] Start()
0709 13:09:11.754003 (+  1006us) write_op.cc:276] Timestamp: P: 1783602551752940 usec, L: 0
0709 13:09:11.754043 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:09:11.756281 (+  2238us) log.cc:844] Serialized 599 byte log entry
0709 13:09:12.043497 (+287216us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b54004054a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f88343 00007f3924f8bd75 00007f3924f8bd09 00007f3924f8bc99 00007f3924f8bc61 00007f3924f8af5d 000000000038f354 000000000038f199 00007f3921f1d475 00007f3921f1f7c1
0709 13:09:12.043766 (+   269us) op_driver.cc:464] REPLICATION: finished
0709 13:09:12.151477 (+107711us) write_op.cc:301] APPLY: starting
0709 13:09:12.151595 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:12.151773 (+   178us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:12.151832 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:12.152219 (+   387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:12.152487 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:12.152555 (+    68us) write_op.cc:312] APPLY: finished
0709 13:09:12.152886 (+   331us) log.cc:844] Serialized 23 byte log entry
0709 13:09:12.217112 (+ 64226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:12.220819 (+  3707us) write_op.cc:454] Released schema lock
0709 13:09:12.220883 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:12.221342 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:12.221370 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":107377,"apply.run_cpu_time_us":2353,"apply.run_wall_time_us":69870,"num_ops":1,"prepare.queue_time_us":67314,"prepare.run_cpu_time_us":10078,"prepare.run_wall_time_us":69483,"raft.queue_time_us":327900,"raft.run_cpu_time_us":13510,"raft.run_wall_time_us":219236,"replication_time_us":289576,"spinlock_wait_cycles":13804416,"thread_start_us":302522,"threads_started":4,"wal-append.queue_time_us":78366}]]}
I20260709 13:09:12.242688 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.243089 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:12.245707 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.249786 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.252233 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.255194 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:12.256649 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.260195 24714 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:12.263144 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.260648 22922 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.264369 22925 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:12.262348 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.261963 22827 catalog_manager.cc:5697] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.267792 24621 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:12.269275 22927 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.270473 24745 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.270641 24621 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:12.271028 24745 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:12.271096 24621 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:12.272197 24621 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.278805 22999 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:12.278663 24745 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.280131 23076 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.280207 24714 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:12.281754 24645 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.282121 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.273716 22827 catalog_manager.cc:5697] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.286963 24746 consensus_queue.cc:1059] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:09:12.291872 24746 raft_consensus.cc:3055] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.292339 24746 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:12.293541 24746 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.297279 24746 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.301184 24711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47786 (request call id 408) took 1780 ms. Trace:
I20260709 13:09:12.304692 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.305080 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.305899 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.307236 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.273737 24621 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.310846 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.318920 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.318783 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.301759 24711 rpcz_store.cc:276] 0709 13:09:10.520567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.520667 (+   100us) service_pool.cc:224] Handling call
0709 13:09:10.653302 (+132635us) ts_tablet_manager.cc:934] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171)
0709 13:09:11.973527 (+1320225us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:12.174842 (+201315us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:12.174958 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:12.299889 (+124931us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:12.300528 (+   639us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:12.300920 (+   392us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:12.301109 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":96267,"tablet-copy.queue_time_us":131620,"thread_start_us":305478,"threads_started":2}
I20260709 13:09:12.325137 24711 tablet_copy_client.cc:806] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:12.327126 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.327886 23073 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:12.329082 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.329259 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.330380 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.330595 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.330816 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.331291 23079 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 2: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:12.331380 23077 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:12.332198 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.333720 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.334983 22927 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:12.335564 24704 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:12.335886 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.336565 24669 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.336877 24693 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.336946 24669 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.337965 24669 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.338310 23620 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.339319 24669 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.327049 24711 tablet_copy_client.cc:670] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:12.346261 22895 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.346864 24704 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.347294 24692 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.354548 24693 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.357302 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.359647 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.361066 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.363479 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.373518 23046 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.373560 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.374302 23077 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:12.374357 24708 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.374986 22895 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.374325 22927 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.377701 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.377939 24683 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.378453 24692 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.379133 24724 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.383647 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.384420 24708 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.385174 23073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:09:12.385895 23046 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.385867 23073 raft_consensus.cc:606] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:09:12.386628 24708 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.387944 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:12.388325 22927 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.389531 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:12.389973 24675 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.390959 24683 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.392825 23046 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.393600 24708 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.394964 23046 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.395880 24708 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.397548 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.398552 24708 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.398988 23046 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:12.418154 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.442952 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 65314.1us
I20260709 13:09:12.402804 24692 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.443832 22895 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.457132 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.458303 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.458582 24669 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.459111 24669 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.459578 24746 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.459872 24744 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.460055 24669 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.462862 24683 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:12.435214 24708 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.464236 24746 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.464587 24746 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:12.446082 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.467298 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.470345 24708 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.471702 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.472842 24714 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.474108 23046 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.474875 24708 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.475347 24708 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.442600 24693 consensus_queue.cc:1059] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:12.476425 24693 raft_consensus.cc:3055] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.476236 24708 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:12.476807 24693 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.477644 24693 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.478933 24693 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.469766 23620 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.479894 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.490479 24683 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.490899 24704 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.451726 24715 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:12.492465 24647 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.492851 24647 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.492899 24714 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:12.493654 24714 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.494005 24703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54cbb7e06ba404b91d84809d3aa8548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.496824 24714 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:12.493801 24647 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.504591 24647 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.505345 24746 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:12.507167 24746 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.511900 23620 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.512746 24721 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.513243 24721 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.514120 24721 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.516588 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.517587 24654 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.517697 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.518062 24654 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.519028 24654 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.525038 22895 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.527679 22925 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.529093 24660 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.541651 24445 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:12.548763 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 54101.8us
I20260709 13:09:12.549131 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.549697 22895 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.553128 24445 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.551730 22829 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 3, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.554838 22829 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:12.561049 22925 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:12.562318 23076 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:12.558346 22829 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 5, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.561832 24675 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:12.566630 24675 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.568596 24675 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:12.559465 24721 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.574510 24724 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:12.575133 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.575881 23076 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:12.593186 22927 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:12.591749 22827 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.601402 22895 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.602396 24445 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.602787 22895 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.603789 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:12.609813 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 62368.8us
I20260709 13:09:12.613067 24683 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.608023 24692 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.609381 24675 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:09:12.625522 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.628304 23076 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:09:12.635246 22925 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.634045 24721 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.635288 24715 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:12.647176 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:12.657830 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 54150.1us
I20260709 13:09:12.653954 24658 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:12.658812 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.660188 24660 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:12.656251 24715 consensus_queue.cc:1059] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:09:12.664217 24703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47784 (request call id 558) took 2675 ms. Trace:
I20260709 13:09:12.673831 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52140
I20260709 13:09:12.674387 23002 raft_consensus.cc:606] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:09:12.675696 24746 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.678980 22827 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 2 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.684547 22827 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 3 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.688884 23073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:09:12.689496 23073 raft_consensus.cc:606] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Received request to transfer leadership
I20260709 13:09:12.666075 24660 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:12.691630 24660 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.692080 22828 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 1 to 2, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 2 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.693655 22828 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 5, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 5 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.698985 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52140
I20260709 13:09:12.699312 24715 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.699604 23002 raft_consensus.cc:606] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:09:12.701444 24715 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.702404 24675 raft_consensus.cc:993] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:12.702409 24715 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:12.704780 24675 raft_consensus.cc:1081] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:12.705346 24715 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.709218 23073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34268
W20260709 13:09:12.709924 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 62842.5us
I20260709 13:09:12.712031 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.715662 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.668087 24703 rpcz_store.cc:276] 0709 13:09:09.988635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.193629 (+204994us) service_pool.cc:224] Handling call
0709 13:09:10.420769 (+227140us) ts_tablet_manager.cc:934] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
0709 13:09:12.492643 (+2071874us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:12.583813 (+ 91170us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:12.583919 (+   106us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:12.663441 (+ 79522us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:12.663771 (+   330us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:12.664053 (+   282us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:12.664166 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":72998,"tablet-copy.queue_time_us":133374,"thread_start_us":149802,"threads_started":2}
I20260709 13:09:12.718132 23072 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:12.718304 24703 tablet_copy_client.cc:806] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:12.718562 24658 tablet_bootstrap.cc:492] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:12.718920 24703 tablet_copy_client.cc:670] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:12.718961 23077 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:12.720363 24745 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:12.728310 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 69634us
I20260709 13:09:12.729967 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.730387 23073 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.730823 23073 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.737071 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:12.735620 24692 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.739297 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.739929 23079 raft_consensus.cc:2376] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2. Re-sending same reply.
I20260709 13:09:12.736507 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.736564 24658 ts_tablet_manager.cc:1403] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.602s	user 0.024s	sys 0.011s
I20260709 13:09:12.744009 23077 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
W20260709 13:09:12.748657 24769 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:09:12.757869 24658 raft_consensus.cc:359] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.759104 24658 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:12.759912 24660 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.760447 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:12.774977 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 46107.7us
I20260709 13:09:12.776715 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:12.774843 23073 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.778976 22895 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:12.783846 23654 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.785080 24746 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:12.785471 24746 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:12.785851 24746 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.787140 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52140
I20260709 13:09:12.787694 22999 raft_consensus.cc:606] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:09:12.789912 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:12.790614 23002 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:12.792236 24764 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:09:12.793270 24658 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:09:12.795881 22877 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:09:12.796254 22877 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for adf5adaae5184191bdaff064d051da2a already in progress
W20260709 13:09:12.796509 22877 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for adf5adaae5184191bdaff064d051da2a already in progress
I20260709 13:09:12.801769 24707 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:12.801587 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.802625 24707 tablet_bootstrap.cc:492] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:12.803102 24675 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.803297 24707 ts_tablet_manager.cc:1403] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.604s	user 0.030s	sys 0.022s
I20260709 13:09:12.805851 23073 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:12.806371 24714 raft_consensus.cc:993] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:12.799331 22895 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.806859 24639 raft_consensus.cc:1081] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:12.807500 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.807713 24692 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.807777 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:12.808467 24692 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.808688 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.808571 24746 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.809464 24692 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.808486 22999 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:12.810967 22999 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:12.811771 22999 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:09:12.811455 22971 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.813601 22999 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.819389 22999 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:12.819860 24746 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:12.820878 24675 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.823738 24658 ts_tablet_manager.cc:1434] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 13:09:12.829520 24715 raft_consensus.cc:993] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:12.809898 22895 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:12.829991 24715 raft_consensus.cc:1081] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:09:12.830385 24746 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:12.830745 24746 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:12.830812 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:12.831220 24746 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.831455 22925 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.831737 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-ca18e836a5464ec5b09378b03ae8b23f received from {username='slave'} at 127.0.0.1:41504
I20260709 13:09:12.832172 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-ca18e836a5464ec5b09378b03ae8b23f on tablet ca18e836a5464ec5b09378b03ae8b23f with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:12.833586 23080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:09:12.834087 23080 raft_consensus.cc:606] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Received request to transfer leadership
W20260709 13:09:12.827929 23045 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.824286 22927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:09:12.836469 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.837455 22927 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.837905 22927 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.837643 24763 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.842630 22925 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:12.847599 23046 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:12.849311 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.849450 22927 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.851588 24721 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.849704 24660 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:12.852027 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:12.853356 23002 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.853987 24721 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:12.855783 24715 consensus_queue.cc:1059] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:12.856662 22895 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.856804 24715 raft_consensus.cc:3055] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.857649 24715 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.858596 24714 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:12.859180 24714 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.858523 24715 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.860284 24715 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.856104 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:12.861831 22927 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:12.863814 24721 raft_consensus.cc:2764] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:12.860107 24714 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.869359 23002 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:12.869601 23073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:09:12.870826 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.871079 23073 raft_consensus.cc:606] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Received request to transfer leadership
I20260709 13:09:12.871331 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:12.871855 24746 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.874476 22999 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.874536 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.874789 24445 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.878830 24445 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.876024 24721 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:12.876626 24683 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.879989 24721 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:12.880245 24683 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:12.880460 24721 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.881376 24683 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.873946 24746 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:12.877209 22877 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:09:12.884737 22877 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for ca18e836a5464ec5b09378b03ae8b23f already in progress
I20260709 13:09:12.877751 24707 raft_consensus.cc:359] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:09:12.885102 22877 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ca18e836a5464ec5b09378b03ae8b23f already in progress
I20260709 13:09:12.885241 24707 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:12.885954 24707 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.878870 22895 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.887446 24692 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.888548 24714 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:12.890394 24591 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.890726 24591 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:12.891507 24591 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:12.892763 24591 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.897868 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.898262 24707 ts_tablet_manager.cc:1434] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.004s
I20260709 13:09:12.876781 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:12.900924 24721 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.901629 24703 tablet_copy_client.cc:538] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:12.901983 24660 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.907976 23650 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:12.910432 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.910391 24675 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:12.910784 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.914822 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.915926 24654 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:12.916435 24654 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.918166 24703 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:12.918500 24654 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:12.919714 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:12.922266 23072 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:12.924849 24721 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:12.925464 23650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47784
I20260709 13:09:12.926036 23650 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.926415 23650 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.933540 23650 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.935186 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:12.936287 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:12.936559 23654 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 1 LEARNER]: Advancing to term 2
I20260709 13:09:12.936740 23004 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:12.939175 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:12.939888 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.944636 23004 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.946444 24715 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.951058 23650 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:12.954044 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:12.926994 22829 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 5 to 6, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 6 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.961592 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:12.961987 23005 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.962178 23001 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.968968 23001 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:12.971953 23076 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:12.974565 23621 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:12.975394 24721 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.975911 24721 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:12.978329 24721 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:12.982831 23001 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:12.984805 23005 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:12.985916 24654 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:12.987877 22927 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.990293 24654 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:12.990983 22927 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.992411 22927 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.995393 24703 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:12.997547 24703 tablet_bootstrap.cc:492] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:12.996447 22927 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:13.000006 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:12.997442 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:12.999564 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-590119d9a7e74f099c0a28550f4fb3f5 received from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:13.001135 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-590119d9a7e74f099c0a28550f4fb3f5 on tablet 590119d9a7e74f099c0a28550f4fb3f5 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:13.002771 24703 ts_tablet_manager.cc:1403] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.012s
I20260709 13:09:13.003455 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:13.005239 23080 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:13.011461 23080 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:13.012614 23080 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.014097 23080 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.020663 22827 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.948678 23073 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:13.004287 22925 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.027067 24591 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:13.031049 23002 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:13.033658 24654 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.034193 24654 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:13.035000 24703 raft_consensus.cc:359] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:13.035071 24654 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.036007 24703 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:13.036685 24703 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:09:13.045022 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47683.1us
I20260709 13:09:13.045836 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:13.047808 24660 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:13.051113 24693 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.051594 24693 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:13.052539 24693 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.056193 24703 ts_tablet_manager.cc:1434] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
I20260709 13:09:13.058096 22828 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 3 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.062474 22925 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:13.063788 24714 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:13.068747 24711 tablet_copy_client.cc:538] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:13.081027 24711 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:09:13.105300 24660 consensus_queue.cc:1059] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:13.106557 24721 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:13.106935 24721 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:13.107811 24721 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.108753 24721 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:13.110148 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.126761 23004 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:13.129917 24714 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:13.140902 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 95183.9us
I20260709 13:09:13.144889 24445 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:13.145455 24445 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.152971 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:13.153801 23004 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:13.156358 24445 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.158308 24693 consensus_queue.cc:1059] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:13.161756 24693 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:13.177594 22895 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:13.178521 24445 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:13.183491 23080 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.179095 22895 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:13.191785 23073 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:13.173890 24721 raft_consensus.cc:3055] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:13.236315 24785 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:09:13.191155 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.291807 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:13.295531 23080 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:13.294086 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 177701us
I20260709 13:09:13.293699 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-e54cbb7e06ba404b91d84809d3aa8548 received from {username='slave'} at 127.0.0.1:43468
I20260709 13:09:13.190209 22825 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 3 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.315316 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:13.316534 23648 raft_consensus.cc:1217] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:13.311609 23077 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:13.327330 22825 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 3 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.327874 23656 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:13.334288 23655 raft_consensus.cc:1217] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:13.349501 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 01988c2c817947859340a730b7f1247d-e54cbb7e06ba404b91d84809d3aa8548 on tablet e54cbb7e06ba404b91d84809d3aa8548 with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:13.357127 24786 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.357650 24786 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.324079 24721 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:13.361318 24786 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:13.385581 24786 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:13.386978 24721 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.417838 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:13.452513 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 160828us
W20260709 13:09:13.455698 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 276699us
I20260709 13:09:13.457280 24772 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:13.465750 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 138446us
W20260709 13:09:13.465950 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.470715 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:13.472186 23079 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:09:13.480216 23045 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.465333 24675 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.474541 24654 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.505290 24654 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.474766 24692 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:13.508792 24692 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:13.527559 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 55004.3us
I20260709 13:09:13.512280 24692 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:13.531244 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 56027us
I20260709 13:09:13.512460 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:13.504317 24675 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.515218 23001 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:13.542815 24445 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:13.560768 24445 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:13.595376 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 110462us
I20260709 13:09:13.598037 24654 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:13.533366 24799 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 13:09:13.603644 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 61261us
I20260709 13:09:13.563330 23004 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.557164 24797 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:13.599435 24794 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.587307 24800 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:09:13.618355 24654 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.644080 24654 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.646782 24654 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:13.668447 24445 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.672709 24693 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.673264 24693 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:13.676473 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 135365us
I20260709 13:09:13.678002 24693 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:13.654953 24675 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.626796 24794 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.695094 24794 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.708916 24794 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.711774 23004 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:13.710078 24794 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.712680 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:13.713356 23072 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:13.713546 24794 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.714079 24802 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:13.725159 24802 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:13.731773 24826 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:13.732302 24826 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.724592 24772 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:13.734444 24826 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:13.734359 24772 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.734637 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:13.735793 24823 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.736271 24823 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.736430 24772 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.736692 24823 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.737049 24812 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:13.739626 24802 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:13.740309 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:13.740869 23072 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:13.749164 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:13.749428 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:13.754014 22930 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:13.755333 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:13.755972 23079 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.753600 23655 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:13.759905 23080 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:13.764261 24803 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.765020 23077 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:13.764763 24803 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.767413 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:13.767997 23002 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.766759 22970 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:13.734468 24819 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:13.769338 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:13.774623 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:13.775233 22927 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.775521 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:13.776254 22999 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:13.775784 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:13.781718 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:13.783270 23003 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.781148 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:13.784940 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:13.785686 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:13.786257 23080 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:13.788481 23075 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:13.789192 23006 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:13.791926 23000 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:13.787853 24826 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.780191 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:13.791637 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:13.800002 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:13.800789 22927 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.790459 24772 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.801879 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 186167us
I20260709 13:09:13.775149 24692 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.794428 24826 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.794531 23077 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:13.792315 24724 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.787299 24715 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:09:13.807538 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:13.806710 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:13.810842 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:13.791635 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:13.794866 23650 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:13.793395 24813 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.802950 24794 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.814491 22927 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:09:13.819227 24822 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:13.821030 24801 raft_consensus.cc:1064] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:13.795022 24818 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:13.812179 24724 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.826588 22922 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:13.832582 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:13.828238 22998 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:13.828334 24813 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.802405 24786 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:13.811022 24826 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.808386 24772 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.815873 22925 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:13.810818 24800 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:09:13.823987 24816 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:13.841225 22931 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:13.836856 24445 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:09:13.892850 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:13.828883 24794 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.840153 22972 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:13.891836 24813 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.845531 24724 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.905413 22923 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 2: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:13.906479 24827 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.909266 24772 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.836968 23648 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
W20260709 13:09:13.920362 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 80305us
W20260709 13:09:13.903457 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.929765 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:09:13.932377 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 95741.7us
I20260709 13:09:13.920589 24794 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.931674 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:13.903954 24816 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:13.838001 24822 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:13.949373 24804 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:13.951793 24803 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.945624 24816 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.928453 24827 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.061870 24827 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:13.945760 24693 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.946014 24654 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:14.073071 24715 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.056085 24823 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.073586 24715 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.047142 24826 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.058115 24692 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:14.058934 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 111336us
I20260709 13:09:14.059440 24711 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:13.948091 24824 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:14.092476 24824 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.092860 24824 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.093199 24721 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.094391 24711 tablet_bootstrap.cc:492] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:09:14.095325 24711 ts_tablet_manager.cc:1403] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 1.015s	user 0.033s	sys 0.009s
I20260709 13:09:14.059826 24804 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:14.096047 24804 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.095784 24813 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.051127 24794 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.098399 24794 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.098501 24813 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:14.081949 24715 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:14.109537 24711 raft_consensus.cc:359] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:14.068813 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:14.122303 23075 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:14.064757 24693 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.125258 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:14.125983 23075 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.110337 24724 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.065610 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:14.127358 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 174466us
I20260709 13:09:14.064018 24822 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.130033 23654 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Advancing to term 3
I20260709 13:09:14.131775 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:14.115465 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:14.139704 23073 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
W20260709 13:09:14.141536 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.144658 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:14.145525 23655 raft_consensus.cc:2368] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4.
I20260709 13:09:14.146530 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:14.147261 23652 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:14.077914 24823 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:14.143378 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.149396 22931 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:14.156903 22895 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:14.080255 24786 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:09:14.128901 24693 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:14.167078 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.125298 24711 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:09:14.175174 22896 leader_election.cc:400] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4.
I20260709 13:09:14.177376 22896 leader_election.cc:403] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:14.174005 23654 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:14.141124 24692 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:14.197853 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:14.144320 24813 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:14.103541 24816 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.174957 24819 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:14.197752 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 256768us
I20260709 13:09:14.199865 23003 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:14.197361 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:14.195720 24692 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:14.195873 24823 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.234406 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.257243 22928 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:14.245124 23075 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:14.199165 24805 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.202806 23006 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:14.210445 24819 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.201968 24796 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.263335 24826 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:14.265290 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:14.259809 24840 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:09:14.248021 24724 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.295154 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:14.271027 24819 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.270798 24823 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.300881 23657 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:14.303272 24824 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.305208 23002 raft_consensus.cc:2368] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3.
W20260709 13:09:14.289038 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 125870us
I20260709 13:09:14.245554 24711 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:14.308043 23003 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.253338 24812 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.259438 24692 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.311440 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:14.308575 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 414413us
I20260709 13:09:14.314368 24711 ts_tablet_manager.cc:1434] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 0.219s	user 0.001s	sys 0.005s
I20260709 13:09:14.314706 24816 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:14.293147 24796 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.341588 24796 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:14.342047 24803 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:14.342640 24693 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.344626 24824 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.342602 24803 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.347409 24803 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:14.353847 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 420638us
I20260709 13:09:14.357046 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:14.357623 22998 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.359647 24825 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:14.360075 24825 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.360406 24825 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.372619 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:14.373250 23004 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:14.373929 24832 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:14.323837 24812 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.379132 24812 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.379724 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.380424 22929 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:14.380398 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:14.307041 24804 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.418475 23003 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:14.402318 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:14.427487 22931 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.385944 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:14.428858 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:14.430739 22930 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.429361 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:14.434127 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:14.336407 24809 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:14.423669 24795 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.438231 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:14.474207 24792 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:14.474371 24798 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:14.474725 24792 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:14.435613 24645 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:14.476006 24645 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.478790 22998 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:14.468400 24795 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.482734 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:14.483549 23650 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 2: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:14.485462 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.485997 22927 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:14.487772 22941 tablet_copy_service.cc:342] P 0db2f61e34a24096a5baf0de9a32d4f7: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-adf5adaae5184191bdaff064d051da2a received from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:14.488243 22941 tablet_copy_service.cc:434] P 0db2f61e34a24096a5baf0de9a32d4f7: ending tablet copy session 01988c2c817947859340a730b7f1247d-adf5adaae5184191bdaff064d051da2a on tablet adf5adaae5184191bdaff064d051da2a with peer 01988c2c817947859340a730b7f1247d
I20260709 13:09:14.489825 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:14.493257 24591 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.474874 24798 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.475391 24792 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.440428 24850 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.503005 22930 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:14.569926 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 99162.1us
W20260709 13:09:14.608443 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 274032us
I20260709 13:09:14.679262 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:14.683343 22922 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.542843 22931 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:14.437390 24818 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.696602 24591 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.470453 24809 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.698598 24591 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.699288 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:14.699625 24809 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.699888 23080 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
W20260709 13:09:14.689636 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.702533 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:14.568536 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:14.625672 24813 raft_consensus.cc:476] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Not starting pre-election -- already a leader
W20260709 13:09:14.617954 24844 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:09:14.569654 24827 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.700942 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:14.709470 22924 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 2: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:14.703400 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:14.711855 23075 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.617367 24805 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4.
W20260709 13:09:14.720386 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 362514us
I20260709 13:09:14.568560 24815 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:14.625737 23001 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:14.724303 24795 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:14.438289 24819 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.726971 22922 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:14.692173 24798 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.703441 24850 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.728119 22925 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:14.710894 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.732208 23075 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:09:14.771301 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 55718.7us
I20260709 13:09:14.805951 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.805757 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:14.814113 22999 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:14.808534 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.815327 22931 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:14.676770 24816 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:14.815266 23622 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:14.586410 24793 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:14.814136 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.808211 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:14.816155 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:14.818142 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:14.819236 24813 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.822861 24862 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.823910 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:14.824177 24843 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:14.824501 23657 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:14.824532 24843 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.739856 24827 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.823026 24813 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.826874 22922 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:14.791009 24841 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:14.622416 24692 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.786365 24693 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:14.773849 24645 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.792060 24853 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.843348 24841 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.843703 24853 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.773620 23071 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:14.834399 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:14.846848 23657 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:14.821208 24816 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.834488 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:14.848034 22930 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.848469 23656 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:14.835830 22927 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:14.836184 24814 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:14.817358 24800 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.833334 22970 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:14.818737 24818 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:14.837656 24745 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:14.825971 24843 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.618969 24825 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.849876 24814 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.862139 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:14.861454 22930 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:14.937307 24862 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:15.352708 24862 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.854069 24863 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.086665 24870 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.356779 24863 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.356926 24870 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.359341 24863 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:15.359438 24870 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:15.089396 24877 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:15.128377 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.360427 22926 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:15.360188 24877 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.362274 24877 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.362543 24809 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:15.363154 24809 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.365388 24809 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.142750 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:15.368854 22923 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:15.217087 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 378212us
I20260709 13:09:15.372982 24805 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.373483 24805 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.375010 22896 leader_election.cc:400] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3.
I20260709 13:09:15.375314 22896 leader_election.cc:403] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.375561 24805 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.377605 24805 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3.
W20260709 13:09:15.171015 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.937645 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 86221.3us
I20260709 13:09:15.185705 23046 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:15.502862 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 317217us
I20260709 13:09:14.993927 23075 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
W20260709 13:09:14.995333 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 164283us
I20260709 13:09:15.521632 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.522871 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:15.522975 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.523471 23657 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.523809 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:15.525414 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:15.526027 23651 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.985220 24745 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.530042 24745 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.064232 24789 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:14.838322 24793 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:14.802388 24792 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.535597 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:15.536211 24792 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.536756 24792 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.053234 24798 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.537614 24797 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:15.537981 23657 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:15.538138 24797 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.539347 24798 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:14.852216 24800 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:14.853470 24813 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:14.851857 24816 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:15.171078 24823 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:15.260318 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 426988us
I20260709 13:09:15.023370 24814 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:14.998198 24818 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.231459 24804 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.037793 24825 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:15.173209 24827 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.037915 24841 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.058179 24843 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.085546 24852 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.261018 24859 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:15.616829 24859 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:15.618001 24859 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.001917 24860 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.299801 24864 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.306988 24819 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.380878 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.389130 22923 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:15.423415 24853 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.427235 24815 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.452742 24824 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.459328 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.460814 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:15.633718 23003 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.628989 24812 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.634217 24812 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:15.634449 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.634469 22827 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 255) took 1798 ms. Trace:
I20260709 13:09:15.635399 22827 rpcz_store.cc:276] 0709 13:09:13.835931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.836098 (+   167us) service_pool.cc:224] Handling call
0709 13:09:15.634415 (+1798317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1025,"reported_tablets":6}
I20260709 13:09:15.636233 24812 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:15.636412 22825 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 369) took 1424 ms. Trace:
I20260709 13:09:15.630290 24864 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.636739 22825 rpcz_store.cc:276] 0709 13:09:14.211801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.248422 (+ 36621us) service_pool.cc:224] Handling call
0709 13:09:14.802961 (+554539us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400002490. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee60b2 00007f392ae5fa89 00007f392adf7da6 00007f392adc9088 00007f392aec737e 00007f39293882a4 00007f3929388232 00007f3929388161 00007f39293880dc
0709 13:09:15.354420 (+551459us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400404f54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f74090 00007f3925012f3a 00007f392adc91cc 00007f392aec737e 00007f39293882a4 00007f3929388232 00007f3929388161 00007f39293880dc 00007f3929387392 00007f392334548c 00007f39233448c6
0709 13:09:15.636356 (+281936us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148317,"reported_tablets":4,"spinlock_wait_cycles":70942848}
I20260709 13:09:15.638988 24864 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:15.639153 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.461267 23622 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:15.461529 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.639783 24815 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:15.640105 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 178918us
I20260709 13:09:15.640655 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:15.641229 23001 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.642513 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:15.642813 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:15.462212 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:15.644073 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.644474 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.644624 22925 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:15.645017 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.645509 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:15.645602 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.626809 24860 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:15.646338 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 177622us
I20260709 13:09:15.456838 24861 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.647161 24786 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.647053 24861 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.647698 24786 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:15.650123 24861 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.464756 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.650298 24786 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.650913 22998 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:15.452796 24802 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.651800 24865 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:15.651925 24802 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.652596 24865 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:15.652930 24865 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:15.653954 24802 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.653738 24865 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.476248 24845 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.654881 24865 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.486249 22972 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:15.639784 23656 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
W20260709 13:09:15.655812 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 169626us
I20260709 13:09:15.487668 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:15.656805 22930 raft_consensus.cc:2368] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:15.490911 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.493949 24857 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.662356 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.494438 24715 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.494895 24817 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.495719 24832 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.496459 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.496785 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.496464 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.499800 24850 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:14.707108 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:15.507642 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.508163 24714 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.513573 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.676664 23071 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:15.514282 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:15.680613 23080 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.680651 24715 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.514964 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.684409 24832 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:15.656418 24812 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:14.856775 24692 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.532806 24789 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.722921 24789 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.533929 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.541550 24800 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.542275 23650 raft_consensus.cc:2368] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:15.542507 24772 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.723980 23649 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:15.724082 24772 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.725068 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.725584 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:15.543005 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1813) took 1412 ms. Trace:
I20260709 13:09:15.726305 23650 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:15.726199 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.727257 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.727876 23650 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:15.552281 24793 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.551719 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.544008 24797 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.554359 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.729279 23650 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Advancing to term 6
I20260709 13:09:15.554481 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:15.555720 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.730000 23653 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:15.730504 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:15.556411 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.556706 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.732589 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.733127 23655 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:15.733465 22896 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:15.556447 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:15.734615 24850 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.734722 23652 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.735044 24850 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.735400 24850 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.561784 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.570035 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:15.737056 23074 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:15.737247 23076 raft_consensus.cc:2368] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:15.574144 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.579689 24805 raft_consensus.cc:1064] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:15.586500 23046 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:15.739645 24841 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.726222 24772 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:15.739998 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 153600us
I20260709 13:09:15.740350 23650 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:15.666504 24825 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.741109 24825 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.741537 24763 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.741946 24763 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.742341 24763 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.587387 24816 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.585888 22970 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:15.613865 24745 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:15.615581 24852 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:15.626899 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:15.752636 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 125816us
I20260709 13:09:15.754823 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:15.755216 22971 leader_election.cc:400] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:15.600561 23651 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:15.629374 23000 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:15.632910 24824 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:15.643524 22923 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:15.464036 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.648945 24823 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.649400 24860 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.475798 24848 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.743213 24825 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.666968 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:15.668017 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:15.675896 24714 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.693424 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:15.770583 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 102628us
I20260709 13:09:15.665220 23621 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:15.702386 22972 leader_election.cc:400] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:15.771557 22972 leader_election.cc:403] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.655220 24845 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:15.772156 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 69879.3us
I20260709 13:09:15.776846 24845 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:15.777976 24805 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.778767 24797 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.755061 24724 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.710423 23080 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:15.774468 23622 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:15.714313 23001 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:15.683525 24715 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.740154 24841 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.741639 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:15.587715 24843 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.587774 24794 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.691623 24812 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.822753 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.823232 24812 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.823807 24812 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.819190 24794 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.824259 24812 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.826027 24812 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.826093 24794 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.745018 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:15.826821 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 85479.3us
I20260709 13:09:15.828888 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:15.693771 24861 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.829949 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:15.746639 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 160843us
I20260709 13:09:15.757927 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:15.830677 23002 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:15.726356 22997 rpcz_store.cc:276] 0709 13:09:14.130977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.131152 (+   175us) service_pool.cc:224] Handling call
0709 13:09:15.237268 (+1106116us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:15.237456 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.540788 (+303332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.540817 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.540868 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:15.540898 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.542706 (+  1808us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400402ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:15.542749 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.542857 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701282560}
W20260709 13:09:15.831179 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 73354.4us
I20260709 13:09:15.829991 24861 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:15.832404 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:15.832751 22970 leader_election.cc:400] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:15.833847 24861 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.709503 24864 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:15.660374 23003 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:15.836040 24825 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.835907 24864 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.836439 24825 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.727522 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:15.836840 24825 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.837186 23649 raft_consensus.cc:2368] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:15.704849 24817 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.764046 24848 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.764977 24832 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.759693 23004 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:15.765513 24745 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.765888 24852 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:15.766706 24850 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.768313 24824 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:15.772935 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 107742us
I20260709 13:09:15.693324 24857 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.775157 24792 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.666257 24804 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:15.889287 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 55500.8us
I20260709 13:09:15.758688 24884 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.897892 24884 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.783493 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:15.206231 24801 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.784256 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.760526 24809 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.787428 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.811813 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.808182 24818 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:15.789460 24724 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.787117 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:15.814035 23652 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:16.084092 24724 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.818270 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:16.084908 22928 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:15.752091 24816 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.785723 24841 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.821316 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.830152 24819 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:15.756446 23000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1509) took 1594 ms (client timeout 2024 ms). Trace:
W20260709 13:09:16.094879 23000 rpcz_store.cc:269] 0709 13:09:14.162517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.380580 (+1218063us) service_pool.cc:224] Handling call
0709 13:09:15.756371 (+375791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:16.095378 24819 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.095950 24819 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.096207 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.097491 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.838025 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.839866 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:16.098901 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 259123us
W20260709 13:09:16.101465 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.843287 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.102274 24789 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:16.102877 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.103047 24789 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:16.103675 24692 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:16.104138 24692 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.808662 24845 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:16.104532 24789 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.105782 24845 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:16.106775 24845 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:15.853516 24817 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.854307 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.109048 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.109441 24816 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:16.110241 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.858211 24445 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.773480 24823 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:15.866111 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.111159 24445 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:15.769526 24851 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.780159 24813 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.114316 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.884681 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.885306 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:15.781924 24797 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.856334 24848 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.081259 24809 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.860885 24715 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.861857 23072 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:15.876569 24812 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.876986 24808 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.928450 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.931519 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:09:15.898412 24884 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.883208 24645 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:15.947873 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 58040.7us
I20260709 13:09:15.948953 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.883529 24794 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:15.889372 24852 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:15.893529 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:15.954588 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 71619.4us
I20260709 13:09:15.856511 24860 consensus_queue.cc:1050] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:15.898878 24857 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.928898 24863 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:15.918287 24824 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.958793 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.927891 24804 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:15.968554 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:15.946580 24861 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:15.974457 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:15.958945 24772 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:16.228348 24861 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.228549 24772 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.230127 23001 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:16.230484 24861 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:15.958603 24675 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:16.121449 24851 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.958171 24815 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.231534 24675 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.232071 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.030157 24850 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.032980 24825 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.034623 24792 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:16.038792 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.061924 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.230544 24772 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.071575 24763 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.240679 23071 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:16.116991 22972 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:16.242298 24804 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:16.243137 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 126236us
I20260709 13:09:16.115510 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.244356 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.112062 24445 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.107271 24841 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.104548 24692 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.133481 23003 raft_consensus.cc:606] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.114281 24813 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.136037 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.253362 24813 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.254271 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:16.255160 23075 raft_consensus.cc:2368] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:16.232942 24824 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.256098 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.256417 23000 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:16.136597 23621 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.190158 24852 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:16.261931 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 443707us
I20260709 13:09:16.152330 24794 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:09:16.263147 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 126634us
I20260709 13:09:16.264020 24818 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.264155 23621 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.153930 22999 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:16.222069 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:16.222117 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 68672.6us
I20260709 13:09:16.118547 24797 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:16.225937 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 73012.8us
I20260709 13:09:15.973006 24864 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:16.265182 24818 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.312722 24813 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.305063 24794 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.238220 24815 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.238312 24675 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.343195 24692 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:16.315416 24884 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:15.772688 24714 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.135469 24808 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.357097 24808 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.241784 23004 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:15.918809 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 60983.1us
W20260709 13:09:16.353304 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 156729us
I20260709 13:09:16.360526 22895 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.361958 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.236310 24851 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.248406 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.149482 24645 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.249593 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.239785 24835 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.251232 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:16.372751 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 121560us
I20260709 13:09:16.376466 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:16.251967 24724 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.251281 24904 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.242339 24825 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.136058 24812 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.227702 24863 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.254344 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.121574 24809 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.268918 24841 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.342064 22825 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.396153 23077 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:16.396515 22825 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.269939 22971 leader_election.cc:400] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:16.399917 22971 leader_election.cc:403] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:09:16.400494 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 132891us
W20260709 13:09:16.343297 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 79201us
I20260709 13:09:16.402702 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.407119 24815 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:16.408059 24864 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.408054 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.408684 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:16.344548 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.409677 23005 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.346380 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.348623 24852 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.348950 24692 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.345523 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.118932 24819 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.412312 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.412598 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.412783 24819 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.354044 24814 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.414001 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.414068 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.240608 22998 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:16.360556 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.257491 24802 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:16.417652 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57204us
I20260709 13:09:16.134630 24823 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.365692 22895 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:16.418963 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53319us
I20260709 13:09:16.364053 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:16.367600 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.368295 24715 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:16.421043 24715 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:16.421794 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 55492.4us
I20260709 13:09:16.422966 24852 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:16.369207 24827 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:16.424289 24814 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.378818 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.379962 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.374787 24861 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.385499 24645 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.376245 24772 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.386324 24835 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.435787 24715 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.392877 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:16.394263 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 139978us
I20260709 13:09:16.436527 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.436791 24864 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:16.268075 23027 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf880 after lost signal to thread 21778
I20260709 13:09:16.437434 23650 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
W20260709 13:09:16.438200 23027 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0e40 after lost signal to thread 22863
I20260709 13:09:16.410884 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:16.439455 23027 debug-util.cc:398] Leaking SignalData structure 0x7b080039e0a0 after lost signal to thread 22955
I20260709 13:09:16.440212 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.398984 22825 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.423414 24852 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:16.443017 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:16.444243 22928 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.447220 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:16.351751 24763 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:16.351908 24824 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.448689 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.450670 22927 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.389591 24832 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.466609 23078 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:16.476920 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.395501 24792 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.450418 24692 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:16.474748 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.485718 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.489277 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:16.491016 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:16.493696 23622 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.477849 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.465710 24900 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:16.501690 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.504863 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:16.505677 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:16.507108 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.509239 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:16.450070 24864 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:16.496876 22997 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.498286 22927 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:16.498210 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:16.475634 24813 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.521055 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.518275 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.524447 23656 raft_consensus.cc:2368] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:16.482232 24832 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.530555 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.530740 23006 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.531147 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:16.531750 23657 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.533156 23076 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:16.533430 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:16.534060 23077 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.497385 24816 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.534528 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.496678 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.537891 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.522768 24805 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:16.529793 23027 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4020 after lost signal to thread 23030
I20260709 13:09:16.545913 24445 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:16.551256 24445 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:16.551882 24445 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.494814 24818 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:09:16.554541 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:16.548913 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.525691 24902 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.495013 24786 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:16.526139 24848 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.532740 24832 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.559028 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.493232 24714 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.542147 24864 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.515760 24692 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.561537 24897 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.587248 24692 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.560173 24812 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:16.588083 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:16.588868 23027 debug-util.cc:398] Leaking SignalData structure 0x7b08000d67a0 after lost signal to thread 23104
W20260709 13:09:16.589951 23027 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2be0 after lost signal to thread 23681
I20260709 13:09:16.590453 22997 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:16.591883 24789 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.592293 24789 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:16.595432 23077 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:16.570930 23657 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:16.571671 23652 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:16.571827 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.535410 24900 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.572882 22929 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.596352 22895 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:16.573467 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:16.576237 24911 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:16.625633 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:16.580207 24884 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.559628 24902 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:16.547905 24805 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:16.555501 24899 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:16.584023 23079 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:16.597548 24445 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.598362 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 461) took 1044 ms. Trace:
I20260709 13:09:16.633896 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.599113 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:16.602058 22970 leader_election.cc:400] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:16.635769 22970 leader_election.cc:403] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.601869 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:16.636572 22999 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.639500 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.640261 22930 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:16.645205 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.612550 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:16.614122 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:16.611704 24809 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.651852 24851 raft_consensus.cc:1064] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:16.651924 23074 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:16.652917 24809 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.615129 24900 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.654384 24851 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.654851 24797 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.562885 24848 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:16.520748 24852 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.649060 23652 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:16.649123 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:16.616528 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:16.650051 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:16.650667 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48737.4us
I20260709 13:09:16.729276 23655 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.729730 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.615931 24789 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.658155 24724 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.663800 24863 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.623278 24897 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:16.666728 23079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 311) took 1808 ms (client timeout 1710 ms). Trace:
I20260709 13:09:16.666922 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.633621 24805 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.629658 24902 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.633561 24817 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.674154 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:16.746004 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 71923.6us
I20260709 13:09:16.746654 23620 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.747987 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.624454 24835 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:16.676049 24714 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:16.685890 24912 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:09:16.695350 24445 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:16.634951 23654 rpcz_store.cc:276] 0709 13:09:15.554202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.554299 (+    97us) service_pool.cc:224] Handling call
0709 13:09:16.598147 (+1043848us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54006a1654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:16.598292 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872967936}
I20260709 13:09:16.696914 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.731284 22930 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:16.752136 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.769955 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.754351 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:16.755707 24890 raft_consensus.cc:993] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:16.756456 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:16.742102 23079 rpcz_store.cc:269] 0709 13:09:14.858272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.490667 (+632395us) service_pool.cc:224] Handling call
0709 13:09:16.666527 (+1175860us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400389ad4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:16.666640 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130217856}
I20260709 13:09:16.727965 24848 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.771075 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:16.771591 23074 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.779850 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:16.769917 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 103081us
W20260709 13:09:16.766089 23620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.710s (SENT) [suppressed 26 similar messages]
I20260709 13:09:16.782672 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:16.784874 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.742379 24903 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.785931 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.786352 22999 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:16.787603 22929 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:16.787487 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.771423 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.773998 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:16.789058 22926 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:09:16.774550 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 77718us
I20260709 13:09:16.775000 24445 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.775800 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:16.746392 22827 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.793895 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:16.767423 24823 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.767118 24786 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.796751 22970 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.797703 22924 raft_consensus.cc:2368] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:16.766952 24864 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.769493 24897 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:16.811997 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:16.804951 24832 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.805794 24890 raft_consensus.cc:1081] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:09:16.781585 24899 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:16.796639 24789 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.775482 24825 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.795094 24904 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:16.813664 22928 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:16.814574 23655 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:16.784461 24841 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:16.768831 24817 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:16.824110 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:16.825137 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.802484 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:16.798921 24801 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.795322 24808 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.795365 24895 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.796790 24857 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.801710 24900 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.835906 24792 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.813364 23045 leader_election.cc:400] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:16.820794 24896 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.854280 22922 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:16.886938 23078 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.820971 24835 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:16.861327 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 89976.7us
I20260709 13:09:16.883826 23045 leader_election.cc:403] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:09:16.884550 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 43766.9us
I20260709 13:09:16.886027 24802 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.853777 24815 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.891336 22971 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:16.889776 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 76527us
I20260709 13:09:16.893067 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:16.842341 24899 raft_consensus.cc:697] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:16.895849 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.879016 24801 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:16.902038 23046 leader_election.cc:400] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:16.904033 23046 leader_election.cc:403] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.886320 24792 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:16.896376 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 125432us
I20260709 13:09:16.924361 23621 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:16.923674 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 132303us
W20260709 13:09:16.926975 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 124111us
I20260709 13:09:16.869326 24841 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:16.930562 22896 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:16.882367 24645 consensus_queue.cc:1059] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:09:16.896970 24714 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.911036 24824 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.906989 24801 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.918164 24895 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.929704 24851 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.919272 24857 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:09:16.918167 24792 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.931761 24864 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:17.001113 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 140087us
I20260709 13:09:16.904412 24804 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:16.996441 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 230350us
I20260709 13:09:16.961457 24823 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:09:17.009377 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 110675us
I20260709 13:09:17.043300 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:17.044153 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:17.044872 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:17.047940 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:17.058835 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:17.060259 23654 raft_consensus.cc:2368] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:17.060669 23657 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:16.925655 24897 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.060611 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:17.005681 24797 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:17.074692 23656 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 2 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:17.002270 24851 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.083181 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:17.084877 22997 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:17.063704 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:17.089356 24832 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:17.094278 23074 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:17.077924 24835 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.077623 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:17.056969 24939 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:09:17.151695 24922 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.009s
I20260709 13:09:17.151456 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:17.165354 22997 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:17.166096 23074 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:17.165942 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 117617us
W20260709 13:09:17.156222 24925 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:09:17.082953 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:17.104571 24924 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:09:17.103207 24825 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:17.079721 24802 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:09:17.062733 24861 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:09:17.185001 23072 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:17.185410 24935 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:09:17.186241 24921 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:09:17.009470 24899 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:17.106675 24817 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:17.305033 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 137845us
I20260709 13:09:17.308483 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:17.309712 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:17.312199 24918 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:09:17.337340 23621 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:17.346973 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 448404us
I20260709 13:09:17.308552 24944 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.350539 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:17.352275 23074 raft_consensus.cc:2368] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:17.346029 23620 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:17.354622 23074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:09:17.355283 23074 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.355719 23074 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.359776 23001 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:17.354631 23652 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:17.338531 24841 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:17.366216 22999 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:17.366453 22970 leader_election.cc:400] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
W20260709 13:09:17.368291 24923 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:09:17.341663 24930 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:17.372797 22970 leader_election.cc:403] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:17.389237 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:17.393548 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:17.342991 24884 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:17.405776 23004 raft_consensus.cc:1240] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.405926 24943 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:09:17.408912 24794 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:17.409160 24930 raft_consensus.cc:697] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:17.409475 24794 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:17.410216 24930 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.410573 24794 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:17.415031 24794 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:17.419440 24848 consensus_meta.cc:287] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.001s
I20260709 13:09:17.419839 24848 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:17.438815 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 72494.1us
W20260709 13:09:17.440554 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 103279us
I20260709 13:09:17.396126 24851 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:17.451031 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 105108us
I20260709 13:09:17.453243 23045 leader_election.cc:400] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:17.454839 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:17.456329 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:17.449496 23074 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.463171 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:17.463950 23073 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:17.466233 23078 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.467958 23075 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.451270 23001 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:17.411758 24884 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.473498 23075 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:17.461982 24902 consensus_meta.cc:287] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.004s
I20260709 13:09:17.481899 23074 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:17.486009 24940 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:17.486922 24945 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:17.479550 22896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.004s	sys 0.021s
I20260709 13:09:17.469131 24857 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:17.488178 22896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.005s	sys 0.021s
W20260709 13:09:17.493916 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 563392us
I20260709 13:09:17.471684 23072 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:17.499329 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 58043.2us
I20260709 13:09:17.479923 24645 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:17.506820 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:17.497344 24805 consensus_meta.cc:287] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.729s	user 0.005s	sys 0.005s
I20260709 13:09:17.490021 24895 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:17.494449 24817 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.483136 24902 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.526819 22925 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:17.527186 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:17.524772 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:17.536338 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:17.515059 24857 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:17.537848 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:17.548102 23074 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:17.520084 24948 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:09:17.552066 22930 raft_consensus.cc:1240] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.553761 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:17.561033 22999 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:17.526782 24945 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:17.524869 24940 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:17.576344 23657 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:17.576181 23654 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:17.565915 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:17.536566 24949 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.583541 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:17.523253 24805 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.544520 24848 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:17.535636 24835 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:09:17.552002 24941 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.524514 24942 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:17.561647 24772 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:17.618460 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 64794.1us
I20260709 13:09:17.577903 24819 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.562031 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 622) took 1126 ms. Trace:
I20260709 13:09:17.561746 24951 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:17.622009 22896 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:17.608541 23653 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:17.627596 22927 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.629088 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:17.609328 24852 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.615159 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:17.636881 22998 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:17.628520 24789 consensus_meta.cc:287] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.792s	user 0.010s	sys 0.000s
I20260709 13:09:17.583380 24816 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:17.627914 24819 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.651108 24951 raft_consensus.cc:697] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:17.666088 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 209825us
I20260709 13:09:17.666316 22896 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:17.666810 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:17.653340 24884 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:17.658360 24852 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.628126 24857 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:17.677479 24884 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:17.679214 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:17.680228 24956 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:17.667708 24816 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:17.685849 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:17.686409 22999 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:17.686633 22999 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:17.687211 22999 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.687950 22999 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.664736 24772 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:09:17.695137 24952 log.cc:927] Time spent T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:09:17.689872 24848 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.696321 24954 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.653163 24945 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.702118 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:17.702720 23653 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.684265 24816 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:17.706411 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:17.706529 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:17.719175 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:17.693614 24902 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:17.705016 22999 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:17.623212 23651 rpcz_store.cc:276] 0709 13:09:16.416954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.438842 (+ 21888us) service_pool.cc:224] Handling call
0709 13:09:16.439167 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:16.463420 (+ 24253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.465408 (+  1988us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:16.514022 (+ 48614us) log.cc:844] Serialized 52 byte log entry
0709 13:09:16.769366 (+255344us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:16.994237 (+224871us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.422784 (+428547us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b1800413380. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3921f1fa40 00007f3921f1a4e4 00007f3921f1a455 00007f3928a023c7 00007f39250149a7 00007f39250240bf 00007f3925024038
0709 13:09:17.422993 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.496691 (+ 73698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.513671 (+ 16980us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.532842 (+ 19171us) raft_consensus.cc:1685] finished
0709 13:09:17.532869 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.543449 (+ 10580us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":442311,"prepare.queue_time_us":650914,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2197,"raft.queue_time_us":270643,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":15584,"spinlock_wait_cycles":30946688,"thread_start_us":442164,"threads_started":3,"wal-append.queue_time_us":342676}
I20260709 13:09:17.722886 24819 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:17.708317 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:17.654546 24940 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.713811 24957 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.714571 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:17.724864 24805 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:17.686049 24931 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:09:17.735374 23045 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:17.737600 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:17.740765 24955 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:09:17.738361 24902 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.745882 24817 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.737519 24848 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:09:17.760499 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:17.739827 24816 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.769541 24816 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:17.746058 24884 consensus_queue.cc:1059] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:09:17.757938 24931 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:17.772375 24902 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:17.737073 24951 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.812307 24813 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:17.793996 24902 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.812727 24813 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:17.874311 22922 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.873421 24848 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:17.896406 24792 consensus_meta.cc:287] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.887s	user 0.012s	sys 0.000s
I20260709 13:09:17.895995 23648 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:17.905719 24848 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:17.942830 24897 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:17.896744 24813 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.914517 24792 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.972858 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:17.952768 24902 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:17.961289 24825 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.968080 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:18.006644 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1531) took 1257 ms. Trace:
I20260709 13:09:18.007121 22930 rpcz_store.cc:276] 0709 13:09:16.748721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.785127 (+ 36406us) service_pool.cc:224] Handling call
0709 13:09:16.785366 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.556004 (+770638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.006344 (+450340us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400346a54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:18.006547 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762765184}
I20260709 13:09:18.011080 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 431) took 1077 ms. Trace:
I20260709 13:09:18.011556 22922 rpcz_store.cc:276] 0709 13:09:16.934093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.934240 (+   147us) service_pool.cc:224] Handling call
0709 13:09:16.934545 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.874766 (+940221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.010829 (+136063us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54001c8754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:18.011015 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160807296}
I20260709 13:09:18.016870 24445 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:18.025435 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 422) took 1550 ms. Trace:
I20260709 13:09:18.025902 22927 rpcz_store.cc:276] 0709 13:09:16.455981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.517850 (+ 61869us) service_pool.cc:224] Handling call
0709 13:09:16.518180 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.632641 (+1114461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.999839 (+367198us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003d31d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:18.000002 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2550989568}
I20260709 13:09:17.981537 24645 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.985931 24813 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.035867 23004 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:18.041560 24817 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:17.978544 24897 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:17.981937 24825 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.045719 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:18.057737 24801 consensus_meta.cc:287] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 1.059s	user 0.007s	sys 0.006s
I20260709 13:09:18.052572 24817 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:18.044847 24645 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.079139 24841 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:18.086877 24841 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.089079 24841 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:18.113360 23001 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:18.138597 23046 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.020s	sys 0.047s
I20260709 13:09:18.049603 24963 consensus_queue.cc:1059] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:09:18.112422 24792 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:18.152299 24933 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:18.083920 24801 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.152911 24933 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:18.157081 24936 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:18.157610 24936 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:18.140857 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:18.169085 24890 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:09:18.153432 24848 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:18.140618 23046 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.020s	sys 0.047s
W20260709 13:09:18.236675 23073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.028s
W20260709 13:09:18.237038 23073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.011s	sys 0.028s
W20260709 13:09:18.239360 23619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.021s	sys 0.031s
W20260709 13:09:18.239753 23619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.022s	sys 0.031s
W20260709 13:09:18.241716 22896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.024s
W20260709 13:09:18.242055 22896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.003s	sys 0.024s
W20260709 13:09:18.250308 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 277473us
I20260709 13:09:18.267153 23074 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:09:18.230072 24950 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:18.272858 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:18.265704 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:18.277287 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:18.228178 24933 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:18.278817 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:18.281301 22999 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:18.285595 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:18.284231 23074 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:18.282258 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:18.293608 23005 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:18.284308 24971 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.375809 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:18.276026 24841 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:09:18.371155 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:18.384507 23653 consensus_meta.cc:287] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.003s
W20260709 13:09:18.415830 24958 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:09:18.432912 24967 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:09:18.371232 24936 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:18.315703 24938 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:18.230034 24817 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.427490 23653 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:18.424222 24895 raft_consensus.cc:3055] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.416739 24971 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:18.430487 24897 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:18.284149 24959 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.283030 24964 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:18.465971 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 189422us
W20260709 13:09:18.435497 23648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 654) took 1835 ms (client timeout 2059 ms). Trace:
I20260709 13:09:18.469800 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:18.470582 22924 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
W20260709 13:09:18.434631 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.478649 22925 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.021s	sys 0.023s
W20260709 13:09:18.541677 22925 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.022s	sys 0.023s
I20260709 13:09:18.283712 24850 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.173s
W20260709 13:09:18.483688 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 204938us
I20260709 13:09:18.540495 22972 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:18.551012 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 60138.6us
I20260709 13:09:18.448833 24645 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:18.455789 24895 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:18.561911 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 145637us
I20260709 13:09:18.446383 24938 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:18.570282 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 308372us
I20260709 13:09:18.570393 24715 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:18.556097 24815 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.559811 24824 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:18.623359 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 46013.3us
W20260709 13:09:18.626500 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 56627.8us
I20260709 13:09:18.628171 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:18.629751 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:18.573320 24715 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.634693 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:18.565264 24797 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.640478 24715 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:18.640789 24976 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:09:18.641476 24988 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:18.467923 24971 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.568125 24801 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:18.562510 24841 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:09:18.570220 24928 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:18.565542 24973 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.570498 24863 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.617534 24824 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:18.688742 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:18.689531 22999 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:18.692036 22999 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:18.693585 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:18.694528 22999 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:18.669309 24988 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:18.700004 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 95492.2us
W20260709 13:09:18.477525 23648 rpcz_store.cc:269] 0709 13:09:16.595432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.598299 (+  2867us) service_pool.cc:224] Handling call
0709 13:09:18.418650 (+1820351us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400302854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:18.428270 (+  9620us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210279296}
W20260709 13:09:18.702229 24816 consensus_meta.cc:287] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.003s
I20260709 13:09:18.699316 24824 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:18.634121 24815 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:18.703411 24801 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:18.752558 24675 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.753002 23652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:18.764087 23652 raft_consensus.cc:606] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:18.764541 23652 raft_consensus.cc:614] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:18.763985 24675 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:18.766446 25002 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.767086 25002 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.767701 23652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "492dd607be6348c79999243a8383806d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:18.768282 23652 raft_consensus.cc:606] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:18.768545 24815 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:18.769170 25002 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:18.769779 23005 raft_consensus.cc:1240] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:09:18.772403 23652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:18.772989 23652 raft_consensus.cc:606] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:18.774072 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:18.753959 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 395) took 1217 ms. Trace:
I20260709 13:09:18.766511 24675 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:18.681358 24797 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.699697 24863 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:18.757310 24995 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 13:09:18.790174 23652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:18.682931 24895 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.700336 24928 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:18.809489 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 182388us
W20260709 13:09:18.812345 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 218941us
I20260709 13:09:18.816764 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 1845) took 1130 ms. Trace:
I20260709 13:09:18.817154 23073 rpcz_store.cc:276] 0709 13:09:17.679925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.680072 (+   147us) service_pool.cc:224] Handling call
0709 13:09:17.680883 (+   811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.681260 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.681290 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.681717 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.237405 (+555688us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:18.237447 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.237525 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.810210 (+572685us) raft_consensus.cc:1685] finished
0709 13:09:18.810237 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.810386 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":965,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8532,"thread_start_us":555314,"threads_started":1,"wal-append.queue_time_us":742440}
I20260709 13:09:18.859522 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:18.809870 24926 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:18.860607 23653 raft_consensus.cc:2410] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:18.860327 24926 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:18.808928 24895 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.904263 24993 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:18.908959 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 91919.4us
I20260709 13:09:18.809664 23652 raft_consensus.cc:606] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:18.918344 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:18.919348 24944 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:18.919981 23656 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:18.921805 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:18.922427 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.956879 22928 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:18.923460 23655 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.925004 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:18.945152 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.868274 24933 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.959532 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:18.868305 24948 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.961077 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:18.968528 24987 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:09:18.784801 23004 rpcz_store.cc:276] 0709 13:09:17.536126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.538117 (+  1991us) service_pool.cc:224] Handling call
0709 13:09:17.579489 (+ 41372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.046703 (+467214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.753688 (+706985us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54000efbd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:18.753892 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927378176}
I20260709 13:09:18.912585 24926 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:18.868042 24930 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:18.933535 24957 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:18.987411 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1544) took 1010 ms. Trace:
I20260709 13:09:18.988274 22997 rpcz_store.cc:276] 0709 13:09:17.976835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.976949 (+   114us) service_pool.cc:224] Handling call
0709 13:09:17.977537 (+   588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.977914 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.977954 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.025449 (+ 47495us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.455721 (+430272us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:18.455766 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.455838 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.987163 (+531325us) raft_consensus.cc:1685] finished
0709 13:09:18.987195 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.987344 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2271,"raft.queue_time_us":2321,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":50311,"thread_start_us":407924,"threads_started":1,"wal-append.queue_time_us":575419}
I20260709 13:09:18.956664 24692 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:18.868990 24945 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:09:18.973135 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:19.031589 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:19.031600 23650 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:19.034641 24988 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.035224 23650 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:19.040691 24971 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.042227 24928 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:18.973459 24933 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.006276 24938 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.033460 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:18.939817 24993 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:18.967311 24944 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.017022 24714 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:18.973673 24948 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.016963 24930 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.016906 24957 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.062389 24675 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:19.083249 23073 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:19.089450 24801 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.090041 24675 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:19.092386 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.092562 24675 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.093751 23074 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:19.094699 24933 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.095497 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.095548 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.096956 24985 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:19.070168 24445 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:19.101228 24944 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.027426 24692 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:19.102540 24813 consensus_meta.cc:287] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 1.057s	user 0.011s	sys 0.000s
I20260709 13:09:19.103781 23657 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:09:19.104206 23657 pending_rounds.cc:85] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 4
I20260709 13:09:19.024025 23655 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:09:19.104460 23657 pending_rounds.cc:107] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:09:19.104929 23657 raft_consensus.cc:2889] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.110419 23655 pending_rounds.cc:85] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 3
I20260709 13:09:19.110737 23655 pending_rounds.cc:107] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:09:19.111007 23655 raft_consensus.cc:2917] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:09:19.133437 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:19.135103 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:19.111527 23655 raft_consensus.cc:2889] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.103785 24692 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.147357 24957 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:19.057622 24714 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.137949 24897 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.162299 24930 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.162920 24813 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.163442 24813 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.165683 24813 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:19.155900 23656 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:19.160419 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.161141 24948 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.132566 24945 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.175487 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47099.8us
I20260709 13:09:19.166152 24714 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.067260 24797 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.171337 24445 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:19.160964 24824 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.180979 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.183264 24928 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:19.184063 24816 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:19.186863 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:19.172600 24969 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.004s
I20260709 13:09:19.187856 24808 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:19.188280 25005 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:09:19.143784 24863 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.265257 23077 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:19.246065 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.270325 23078 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:19.270493 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.271733 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:19.255204 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 118217us
I20260709 13:09:19.220842 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.192943 22930 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:19.272192 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.266366 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.246675 23002 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:19.275553 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:19.277413 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:19.277951 23656 raft_consensus.cc:2376] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4. Re-sending same reply.
I20260709 13:09:19.279354 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:19.279717 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:19.281286 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:19.180249 24675 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:19.239970 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.284636 23078 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:09:19.285326 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.285112 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:19.283574 24801 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.239645 24944 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:19.282246 24969 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.018s	sys 0.006s
I20260709 13:09:19.283679 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:19.224130 24797 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:19.325736 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:19.273439 24997 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.585s	user 0.018s	sys 0.012s
I20260709 13:09:19.345638 24801 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.330669 24985 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:19.358659 24985 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.359181 24985 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.330909 24863 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.364208 24863 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.364658 24863 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.365386 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1850) took 1087 ms. Trace:
I20260709 13:09:19.341955 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:19.365764 23003 rpcz_store.cc:276] 0709 13:09:18.277850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.278083 (+   233us) service_pool.cc:224] Handling call
0709 13:09:18.278391 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.444320 (+165929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.444386 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.470978 (+ 26592us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.697736 (+226758us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:18.697786 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.697869 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.165873 (+468004us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:19.365128 (+199255us) raft_consensus.cc:1685] finished
0709 13:09:19.365149 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.365331 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97821,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":32511,"spinlock_wait_cycles":23390592,"thread_start_us":294887,"threads_started":2,"wal-append.queue_time_us":133474}
I20260709 13:09:19.312222 24825 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.342526 24957 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.181639 24945 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.350665 24818 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.378430 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 66328.5us
I20260709 13:09:19.380740 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:19.283644 24808 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.348500 24993 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.343232 24675 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.383559 24818 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.357635 24797 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.411545 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.353154 24944 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.453198 24797 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.457677 24808 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.462209 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:19.455265 24895 consensus_meta.cc:287] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.000s
I20260709 13:09:19.455544 24675 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:18.806742 24964 consensus_queue.cc:1175] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" responder_term: 3 status { last_received { term: 3 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:19.457173 24818 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.469595 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.396596 24947 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:19.478096 23079 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:09:19.405874 24801 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.479773 23079 pending_rounds.cc:85] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 3
I20260709 13:09:19.482539 23079 pending_rounds.cc:107] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:09:19.408622 23072 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:19.482936 23079 raft_consensus.cc:2917] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:09:19.485193 23079 raft_consensus.cc:2889] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.384248 23071 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:19.507746 25014 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:19.505776 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:19.509235 25014 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.517867 25014 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.394510 24963 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:19.520072 25020 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:19.384557 24957 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.510393 24947 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:19.527242 24992 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.894s	user 0.001s	sys 0.010s
I20260709 13:09:19.527796 25020 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.530201 23074 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:19.530845 25020 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.542985 25014 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:19.543215 24930 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:19.543757 24930 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.543779 25014 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.550514 24993 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:19.551008 24940 raft_consensus.cc:3055] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:19.551544 24940 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:19.551313 24993 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.552654 24940 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:19.560724 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.545989 25014 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.533638 24963 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.528107 24947 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.537071 25002 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:09:19.623157 25022 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:09:19.625599 24993 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.687492 23620 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:19.621212 25017 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:19.702458 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.719149 23077 raft_consensus.cc:2410] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:19.586699 24945 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.627905 24692 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:19.622727 24941 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.558774 25020 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:19.729439 25002 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.623245 24930 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:19.737556 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 193907us
I20260709 13:09:19.729621 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:19.728744 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 452799us
I20260709 13:09:19.577816 24816 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.629202 24944 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:19.732429 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.626647 24985 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.659945 24884 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.738981 23077 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:19.744971 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.712618 24825 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.746295 24825 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.691860 24993 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.723307 24938 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.691248 24988 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:19.714308 24895 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.550554 24863 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.712777 24818 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.752781 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.755839 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:19.757766 24884 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.773741 24884 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.773815 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 1889) took 1619 ms. Trace:
I20260709 13:09:19.774315 22922 rpcz_store.cc:276] 0709 13:09:18.154776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.154907 (+   131us) service_pool.cc:224] Handling call
0709 13:09:18.787590 (+632683us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b5800003698. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:18.787816 (+   226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.788175 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.788213 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.788711 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.622562 (+833851us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b18000a6a80. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3924bb24bc 00007f3921f0048b 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa0d1
0709 13:09:19.622788 (+   226us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:19.622836 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.622919 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.771894 (+148975us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b18000a6a80. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:19.773583 (+  1689us) raft_consensus.cc:1685] finished
0709 13:09:19.773606 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.773758 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9441,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":17307,"spinlock_wait_cycles":118769664,"thread_start_us":15369,"threads_started":1,"wal-append.queue_time_us":32065}
I20260709 13:09:19.757270 24938 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.740463 25002 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.782071 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.736825 24941 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.768003 24818 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.784462 24863 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.766556 24945 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:19.786824 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47470.5us
I20260709 13:09:19.739900 25020 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.744156 24816 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:19.789871 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50913.9us
I20260709 13:09:19.792249 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:19.787423 24938 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.764225 24993 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.764818 24895 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.764941 24988 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.767897 25028 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:19.800469 24985 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:19.801079 24692 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:19.801592 24692 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.791631 24945 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:19.804359 24963 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.806975 24945 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.809707 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:19.801080 24900 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:09:19.811074 25002 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:19.812851 24818 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:19.813246 24902 raft_consensus.cc:1064] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:19.814072 24816 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.814815 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:19.817070 24850 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:19.820876 23074 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.842401 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.842965 22931 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:19.820856 23076 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:19.838162 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:19.844550 22929 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.839847 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.840004 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.847380 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.849910 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:19.820235 25033 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.845930 24990 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:19.862897 24990 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.839263 24818 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.850513 25027 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:19.868975 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.880633 24988 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.880865 24895 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:19.881290 24990 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.881817 24825 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.882575 24941 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:19.887802 22929 raft_consensus.cc:2410] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:19.887261 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:19.890059 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 90675.7us
I20260709 13:09:19.890807 22895 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:19.889647 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 90298.2us
I20260709 13:09:19.893250 24900 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:19.893319 22895 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:19.895358 24949 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.895640 22895 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:19.896884 25033 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.897179 24949 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:19.899696 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 1895) took 1728 ms. Trace:
I20260709 13:09:19.899907 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.900457 22928 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:19.900071 22929 rpcz_store.cc:276] 0709 13:09:18.160755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.161429 (+   674us) service_pool.cc:224] Handling call
0709 13:09:19.838015 (+1676586us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b5800003698. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:19.889589 (+ 51574us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39983360}
W20260709 13:09:19.905210 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.890388 24804 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:19.914047 24804 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.915993 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.916575 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:19.918721 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.918114 24804 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.898949 25028 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:19.925932 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.926119 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:19.926330 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.927304 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.875365 24818 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.929312 23074 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:19.929700 23079 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:19.930689 22922 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:19.931303 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.933533 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.937991 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:19.939016 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:19.932924 24815 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:19.941717 24988 raft_consensus.cc:2764] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:09:19.941560 24815 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.945235 24815 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.933071 24675 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:19.945999 24675 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:19.947186 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.947922 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.948272 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.948953 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.949280 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.903290 24902 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:19.927577 24745 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.953320 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:19.943135 23045 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:19.953542 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:19.965708 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:20.011209 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57986.3us
W20260709 13:09:20.011603 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68542.6us
I20260709 13:09:20.010129 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.026595 24939 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.010105 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.033649 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:20.036316 23622 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:19.952680 24715 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.041194 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.043867 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:19.934585 24945 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.052286 23622 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.059551 24998 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.060242 24824 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:20.060425 24945 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:20.045985 24963 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.061203 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1549) took 1101 ms. Trace:
I20260709 13:09:20.062700 23622 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.061648 22927 rpcz_store.cc:276] 0709 13:09:18.959504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.960591 (+  1087us) service_pool.cc:224] Handling call
0709 13:09:18.963981 (+  3390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.150908 (+186927us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:19.160983 (+ 10075us) log.cc:844] Serialized 14 byte log entry
0709 13:09:19.344910 (+183927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:19.344964 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:19.345011 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.060978 (+715967us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002396d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:20.061024 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.061139 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":919,"prepare.queue_time_us":9735,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":71955,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":429205248,"thread_start_us":182578,"threads_started":2,"wal-append.queue_time_us":165342}
I20260709 13:09:19.948297 24675 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:20.048249 24946 consensus_queue.cc:1059] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:20.050163 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 498) took 1124 ms. Trace:
I20260709 13:09:20.039973 24884 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:09:20.063637 24963 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.053359 24816 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.041020 24964 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.053861 24941 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.054706 25036 raft_consensus.cc:993] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:19.962054 24692 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.078651 24945 raft_consensus.cc:1081] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:20.078765 24715 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:20.079108 25003 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.079382 24715 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.066241 24890 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.081485 24715 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:20.081722 24890 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.003939 25028 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.083120 25028 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.076366 24964 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.084470 24964 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.957720 25033 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.032428 24988 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.038389 24939 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:19.951257 24926 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:20.051548 24804 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.064796 23657 rpcz_store.cc:276] 0709 13:09:18.925706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.958535 (+ 32829us) service_pool.cc:224] Handling call
0709 13:09:18.958858 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.105486 (+146628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.049927 (+944441us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400661554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:20.050104 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332440320}
I20260709 13:09:20.066951 24824 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.056031 24818 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:20.081115 22925 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:20.088050 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 97336.9us
I20260709 13:09:20.080013 24692 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:19.956389 24938 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.097513 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:20.097641 22930 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:20.120512 22926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:20.127800 22926 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.128208 22926 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:20.078891 24902 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.129226 24902 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.130036 25020 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.130443 24804 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:20.131253 24902 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.126142 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:20.129236 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.131968 25028 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.120900 24988 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.098081 24926 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:20.141141 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:20.141685 22928 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.079622 25003 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.127099 24745 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.122373 24824 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.144876 24890 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:20.155862 25041 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:09:20.150261 24745 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.159039 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:20.160458 24979 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.537s	user 0.007s	sys 0.009s
I20260709 13:09:20.164804 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.164592 24926 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.165699 24926 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.166061 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:20.166774 22923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 1899) took 1985 ms (client timeout 1523 ms). Trace:
W20260709 13:09:20.167110 22923 rpcz_store.cc:269] 0709 13:09:18.181613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.272132 (+ 90519us) service_pool.cc:224] Handling call
0709 13:09:20.165910 (+1893778us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800003698. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:20.166714 (+   804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406144}
I20260709 13:09:20.167325 22928 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:20.170136 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:20.171046 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.182029 24824 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.182657 24745 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.177103 22926 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.184465 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.184504 24904 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:20.187608 24904 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:20.187794 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:20.188906 24890 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:20.190024 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.192052 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.192739 22931 raft_consensus.cc:2393] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:20.192659 24902 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.193348 24902 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.193454 24890 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.195606 24890 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:20.190712 24951 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:09:20.196501 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:20.197641 25042 log.cc:927] Time spent T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:20.197710 24902 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:20.200264 25003 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.202656 24957 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.202955 24940 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:20.188674 24904 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.209283 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.211459 22923 raft_consensus.cc:2368] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:20.214159 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 489) took 1297 ms. Trace:
I20260709 13:09:20.214553 23653 rpcz_store.cc:276] 0709 13:09:18.917084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.933341 (+ 16257us) service_pool.cc:224] Handling call
0709 13:09:20.213431 (+1280090us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:20.213604 (+   173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.213844 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.213876 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.213920 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:20.213955 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.214012 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.214107 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8414592}
I20260709 13:09:20.216063 24963 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:20.216428 24963 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:20.217213 24963 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.218318 24963 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.221346 23045 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:20.222003 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.221413 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.223868 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.223971 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.144484 24988 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:20.229364 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:20.237329 22926 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.239837 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.241122 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.241465 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.243439 23649 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:20.244848 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.254917 23651 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:20.257880 22927 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:20.260564 24938 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:20.262593 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.262719 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.263537 23656 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:20.234339 24902 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.279320 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.281733 24988 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:20.284081 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.293543 22999 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:20.295089 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.286139 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.237161 24797 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:20.290242 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.297676 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:20.291785 23656 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:20.308352 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.308445 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.309209 23652 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:20.309512 24947 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.310294 24835 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.250329 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 673) took 1431 ms. Trace:
I20260709 13:09:20.310031 24947 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.234246 24951 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:09:20.317543 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.313040 23075 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:20.282226 24904 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.310802 24835 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.321098 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.513033 24947 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.513294 23000 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:20.346890 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 45551.2us
W20260709 13:09:20.396287 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.353253 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.516283 23005 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:20.516937 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 503) took 1392 ms. Trace:
I20260709 13:09:20.517299 23654 rpcz_store.cc:276] 0709 13:09:19.124925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.127372 (+  2447us) service_pool.cc:224] Handling call
0709 13:09:19.127804 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.459154 (+331350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.459182 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.476063 (+ 16881us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.724283 (+248220us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:19.724338 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.516587 (+792249us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54006ed054. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:20.516654 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.516697 (+    43us) raft_consensus.cc:1685] finished
0709 13:09:20.516709 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.516884 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":505,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":9188,"spinlock_wait_cycles":761144704,"thread_start_us":214817,"threads_started":1,"wal-append.queue_time_us":266809}
I20260709 13:09:20.518258 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:20.354597 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.382164 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:20.521008 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.521554 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:20.435283 23003 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:20.523047 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.404731 22999 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:20.306663 24936 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.300154 24890 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.532831 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:20.350318 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.521759 23005 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:20.565682 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.573818 23046 leader_election.cc:400] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:20.574772 23046 leader_election.cc:403] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:20.533430 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:20.566129 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.437669 24863 raft_consensus.cc:993] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:20.421446 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.580211 23001 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:20.581085 25003 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:20.586046 23006 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:20.067077 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:20.527462 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:20.536847 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.602216 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.602831 23077 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
W20260709 13:09:20.573659 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.347980 24797 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:20.578970 24857 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.606113 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.457192 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.613135 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.615314 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.616392 23077 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:20.617789 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.620662 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:20.606894 23006 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:20.624214 24946 raft_consensus.cc:1081] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:09:20.636539 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.552898 24890 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.625895 24825 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:20.626385 24926 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.524591 24943 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.538394 24936 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.532008 24904 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.500757 24964 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:20.636355 24797 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.621618 25011 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:20.534776 24988 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:20.638098 24804 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.640441 24973 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.640599 25003 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.651943 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.652264 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.653388 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:20.776444 23004 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.777736 24890 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.654157 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.654237 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.780422 25003 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.654868 24972 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.782382 25003 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.782593 24972 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.783931 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:20.655419 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.658865 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:09:20.786685 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 127908us
I20260709 13:09:20.787930 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.316141 23648 rpcz_store.cc:276] 0709 13:09:18.806690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.807769 (+  1079us) service_pool.cc:224] Handling call
0709 13:09:20.055334 (+1247565us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:20.055549 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.057815 (+  2266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.057851 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.058338 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.133049 (+ 74711us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:20.139724 (+  6675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.144965 (+  5241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.209925 (+ 64960us) raft_consensus.cc:1685] finished
0709 13:09:20.211227 (+  1302us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.237755 (+ 26528us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":746,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":89338880,"thread_start_us":65570,"threads_started":1,"wal-append.queue_time_us":73909}
I20260709 13:09:20.664806 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.670019 22923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:52582
I20260709 13:09:20.791090 22923 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.791414 22923 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.672883 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1549) took 1986 ms. Trace:
I20260709 13:09:20.685063 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.641943 24989 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:20.664168 24835 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.683449 24902 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.707306 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:20.695510 24951 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:20.687065 24786 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:20.701462 24793 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.805923 24793 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.793933 24939 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.703576 24824 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.807894 24793 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.808334 24824 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.810396 24824 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.810583 22923 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.774622 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:20.793201 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 128466us
I20260709 13:09:20.811962 23006 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:20.795050 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:20.814083 23004 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:20.791992 23002 rpcz_store.cc:276] 0709 13:09:18.686603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.686746 (+   143us) service_pool.cc:224] Handling call
0709 13:09:18.706095 (+ 19349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.274894 (+568799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.672631 (+1397737us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54000bbdd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:20.672816 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242577664}
I20260709 13:09:20.803784 24902 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.816658 24936 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.816844 22827 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35496 (request call id 372) took 4288 ms. Trace:
I20260709 13:09:20.817430 23074 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:20.804469 24951 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.760594 24926 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.763165 24825 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.820990 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:20.817169 22923 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.793023 25029 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.794057 24900 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.828574 22896 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.783522 25011 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.775279 24988 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.783701 24804 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.826112 23072 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:20.765728 24943 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.785017 24973 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.824649 24930 raft_consensus.cc:2764] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:09:20.837620 24940 consensus_meta.cc:287] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.004s
I20260709 13:09:20.845882 25014 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.800434 24989 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:20.860925 23657 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:20.859391 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:20.883437 23002 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.883741 23045 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:20.886915 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:20.889720 22896 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.839984 24850 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.892750 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:20.827327 25029 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:20.816653 24902 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:20.850859 25014 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:20.906098 23620 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.834908 25019 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:09:20.907299 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.933988 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:20.938431 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.941810 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 441) took 1042 ms. Trace:
I20260709 13:09:20.942374 22930 rpcz_store.cc:276] 0709 13:09:19.899278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.899383 (+   105us) service_pool.cc:224] Handling call
0709 13:09:19.899686 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.127365 (+227679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.941513 (+814148us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540017f054. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:20.941734 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454306688}
I20260709 13:09:20.881754 24895 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.894399 24818 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.898065 24793 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.936829 24786 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.941215 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:20.929706 24946 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:20.896976 24948 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.817178 22827 rpcz_store.cc:276] 0709 13:09:16.528709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.528855 (+   146us) service_pool.cc:224] Handling call
0709 13:09:20.816760 (+4287905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:17.620765 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:17.675871 (+ 55106us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:17.678653 (+  2782us) write_op.cc:435] Acquired schema lock
0709 13:09:17.678682 (+    29us) tablet.cc:662] Decoding operations
0709 13:09:17.708920 (+ 30238us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:17.719987 (+ 11067us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:17.721418 (+  1431us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:17.733586 (+ 12168us) tablet.cc:701] Row locks acquired
0709 13:09:17.733629 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:09:17.739113 (+  5484us) write_op.cc:270] Start()
0709 13:09:17.744051 (+  4938us) write_op.cc:276] Timestamp: P: 1783602557738063 usec, L: 0
0709 13:09:17.745076 (+  1025us) op_driver.cc:348] REPLICATION: starting
0709 13:09:17.784360 (+ 39284us) log.cc:844] Serialized 536 byte log entry
0709 13:09:19.446202 (+1661842us) op_driver.cc:464] REPLICATION: finished
0709 13:09:19.479983 (+ 33781us) write_op.cc:301] APPLY: starting
0709 13:09:19.484964 (+  4981us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:19.506340 (+ 21376us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:19.513806 (+  7466us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:19.552602 (+ 38796us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:19.552758 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:19.552812 (+    54us) write_op.cc:312] APPLY: finished
0709 13:09:19.552990 (+   178us) log.cc:844] Serialized 23 byte log entry
0709 13:09:19.607547 (+ 54557us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:19.623379 (+ 15832us) write_op.cc:454] Released schema lock
0709 13:09:19.623422 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:19.623845 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:19.623876 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":965221,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":14694,"apply.run_cpu_time_us":5544,"apply.run_wall_time_us":147064,"num_ops":1,"prepare.queue_time_us":785552,"prepare.run_cpu_time_us":3729,"prepare.run_wall_time_us":176356,"replication_time_us":1643449}]]}
I20260709 13:09:20.897540 25029 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.897292 24850 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:20.948568 24938 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.905675 24940 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.932242 25014 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.938753 24902 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.955235 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:20.929913 24947 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:20.897964 24824 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:20.930771 25003 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:09:20.971481 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.940531 24972 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:20.992139 23002 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:20.972254 24965 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.939846 24957 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.982138 24850 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.014021 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:21.018347 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.033283 22999 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:21.034695 24943 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.035127 24991 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:21.017521 24965 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.036437 24965 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.036677 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.023218 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:20.987571 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:20.974653 24895 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:20.997822 24947 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:21.048051 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.045867 24900 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:20.982427 24793 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.052204 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:20.985728 24940 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.069008 23656 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.069453 23656 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:21.070268 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 257495us
I20260709 13:09:20.983052 24946 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.052934 24825 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:20.988128 24902 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:21.059922 24903 raft_consensus.cc:3055] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:20.978206 24818 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.061450 23002 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
W20260709 13:09:21.033335 25049 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:09:21.010396 24964 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:21.073143 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:21.046399 24904 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.067798 24947 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.109452 23621 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:21.070339 23656 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.120214 23621 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:21.067826 23648 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:21.075934 24902 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:21.128584 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 114648us
I20260709 13:09:21.015998 24824 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.075366 24926 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.136628 23621 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:21.141242 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:21.111114 24786 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.110934 24951 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:21.140854 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 248180us
I20260709 13:09:21.119131 25002 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.149770 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:21.076289 24903 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:21.068143 24930 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.072110 24900 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:21.140419 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.154805 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:21.136385 24988 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.153569 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:21.142017 24797 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.163894 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:21.146019 22998 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:21.144112 23651 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:21.170732 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:21.171546 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:21.158537 25067 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.221841 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:21.159672 24951 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:21.149672 24926 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.159375 24825 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:09:21.209389 24903 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.213754 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:21.216202 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:21.220290 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 49628.8us
W20260709 13:09:21.220319 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48869.9us
I20260709 13:09:21.156752 25072 raft_consensus.cc:2764] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:21.226063 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.157240 24989 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.226687 22925 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:21.229161 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:21.241621 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:21.230566 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:21.226135 24792 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.220746 24964 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.243724 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:21.228451 24926 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.228173 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.247979 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:21.219780 23004 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:21.253520 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:21.255124 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 101688us
W20260709 13:09:21.252547 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 108687us
I20260709 13:09:21.258196 22999 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:21.236617 24824 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:21.267409 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.257602 25053 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:09:21.230875 24951 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:21.280459 25064 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:09:21.281183 24793 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.281029 24947 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.282735 24965 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.283784 24947 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.284993 24946 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:21.285189 23071 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:21.251946 25071 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:21.285858 25071 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:21.286281 25071 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.292044 24895 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.296160 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.296572 24900 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.297834 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.299226 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.316576 23004 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:21.301507 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.317399 22999 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:21.318358 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:21.318270 25029 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:21.302582 24825 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:21.319803 24940 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.259132 24903 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.320068 24825 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.322490 24825 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.303946 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 648) took 1063 ms. Trace:
I20260709 13:09:21.323160 23657 rpcz_store.cc:276] 0709 13:09:20.240757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.240883 (+   126us) service_pool.cc:224] Handling call
0709 13:09:21.303794 (+1062911us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54004763d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:21.303891 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423904640}
I20260709 13:09:21.264925 24988 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.324539 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:21.324899 25073 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:21.326740 22971 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:21.327293 22997 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.327757 24890 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.253633 24926 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.328299 24890 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:21.328845 24890 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.266103 23648 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:21.312036 24946 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:21.314710 23621 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:21.315335 23653 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.299453 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.348529 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 688) took 1011 ms. Trace:
I20260709 13:09:21.304906 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.348209 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.354236 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 654) took 1070 ms. Trace:
I20260709 13:09:21.354482 23651 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:21.354624 23650 rpcz_store.cc:276] 0709 13:09:20.283784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.305102 (+ 21318us) service_pool.cc:224] Handling call
0709 13:09:21.304802 (+999700us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:21.354178 (+ 49376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28701056}
I20260709 13:09:21.355983 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:21.356357 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.356761 23651 raft_consensus.cc:3055] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:21.357239 23651 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:21.327952 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1912) took 1090 ms. Trace:
I20260709 13:09:21.331732 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:21.332335 23657 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:21.311226 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:21.307307 24857 consensus_meta.cc:287] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.003s
I20260709 13:09:21.342993 24965 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.351728 24946 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.352620 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:21.353271 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.348886 23655 rpcz_store.cc:276] 0709 13:09:20.337591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.337728 (+   137us) service_pool.cc:224] Handling call
0709 13:09:21.299303 (+961575us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:21.348469 (+ 49166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3479936}
W20260709 13:09:21.389173 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 154119us
I20260709 13:09:21.749657 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:21.749333 23075 rpcz_store.cc:276] 0709 13:09:20.237914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.238010 (+    96us) service_pool.cc:224] Handling call
0709 13:09:20.238240 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.312949 (+ 74709us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:20.526230 (+213281us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.949848 (+423618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.949894 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:20.949938 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.327720 (+377782us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b540038a9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:21.327770 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.327895 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126065,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":39654,"spinlock_wait_cycles":171396352,"thread_start_us":423341,"threads_started":1,"wal-append.queue_time_us":528473}
I20260709 13:09:21.750613 22970 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:21.398890 24988 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:21.751971 24991 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.752025 24988 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.622943 25071 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.753715 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:21.753980 24863 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:21.754499 23071 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.754796 24988 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.754534 24863 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.755095 25071 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.501672 24895 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:21.756358 24895 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.757488 24863 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:21.758448 24895 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.426297 25067 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.759464 25067 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:21.359251 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:21.763283 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 396894us
I20260709 13:09:21.397338 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:21.766517 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:21.635038 24850 consensus_meta.cc:287] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.000s
I20260709 13:09:21.788400 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:21.748710 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 434050us
W20260709 13:09:21.791350 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.404477 24825 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:21.804746 23080 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.000s	sys 0.018s
W20260709 13:09:21.805233 23080 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.019s
I20260709 13:09:21.808156 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:21.637979 25014 consensus_meta.cc:287] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 13:09:21.728734 25033 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:21.427137 24930 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:21.357546 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.857395 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.865940 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 520) took 1031 ms. Trace:
I20260709 13:09:21.866428 23655 rpcz_store.cc:276] 0709 13:09:20.834490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.857116 (+1022626us) service_pool.cc:224] Handling call
0709 13:09:21.865873 (+  8757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:21.867678 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.619817 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.787909 24857 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
W20260709 13:09:21.859092 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 499871us
I20260709 13:09:21.873458 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:21.792871 24991 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.390825 25076 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:21.865213 24926 consensus_meta.cc:287] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.003s
I20260709 13:09:21.714331 24938 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:21.860515 25018 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.406561 25066 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:21.639601 24964 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.412153 25029 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.426759 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:21.861680 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 84270.3us
I20260709 13:09:21.922293 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:21.410660 24951 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.759927 25067 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:21.786914 25072 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.809373 25071 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:21.406356 24902 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:21.905316 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.905316 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.906915 25018 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:21.947472 23655 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:21.954339 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:21.955157 23655 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
W20260709 13:09:21.947135 23045 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.588s (SENT) [suppressed 5 similar messages]
I20260709 13:09:21.923933 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 514) took 1105 ms. Trace:
I20260709 13:09:21.864339 24863 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.545379 25078 consensus_queue.cc:1059] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.399s
I20260709 13:09:21.927493 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:21.863157 25014 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:21.936578 24793 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.936754 24991 consensus_queue.cc:1059] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:21.924849 24964 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.940131 25072 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.946300 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 686) took 1629 ms. Trace:
I20260709 13:09:22.014592 23077 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:21.993702 25072 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.022488 24964 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.752308 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:22.035102 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.036082 23075 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:22.037315 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.411939 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 1930) took 1245 ms. Trace:
I20260709 13:09:21.956324 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:22.412497 22930 rpcz_store.cc:276] 0709 13:09:21.166521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.166631 (+   110us) service_pool.cc:224] Handling call
0709 13:09:21.166886 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.390701 (+223815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.390747 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.390804 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:21.390850 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.411314 (+1020464us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54000ce9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:22.411390 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.411644 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514149248}
I20260709 13:09:22.413986 23655 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:22.414422 23077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 1867) took 1825 ms (client timeout 1905 ms). Trace:
I20260709 13:09:22.416359 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:22.417964 23649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 687) took 2098 ms (client timeout 1957 ms). Trace:
I20260709 13:09:21.944041 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:22.424849 24857 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:22.425462 23657 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:22.426280 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 656) took 1454 ms. Trace:
I20260709 13:09:22.426013 24857 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.426718 23657 rpcz_store.cc:276] 0709 13:09:20.971467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.943725 (+972258us) service_pool.cc:224] Handling call
0709 13:09:22.426184 (+482459us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:22.426918 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 479655us
I20260709 13:09:22.398016 22829 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.966777 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:22.435875 24991 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:22.436483 24991 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:22.436733 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 469893us
I20260709 13:09:22.436968 24991 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:22.438275 22970 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:22.439786 25088 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:21.943202 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 69818.9us
I20260709 13:09:22.409750 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 426) took 1595 ms. Trace:
I20260709 13:09:21.945328 23071 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:22.458742 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 387) took 1151 ms. Trace:
I20260709 13:09:22.459112 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:22.459836 25074 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 1.176s	user 0.012s	sys 0.015s
I20260709 13:09:22.410516 23000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1874) took 1720 ms. Trace:
I20260709 13:09:22.126484 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 369) took 1826 ms. Trace:
I20260709 13:09:22.466640 24857 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.942585 23648 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.962533 23650 rpcz_store.cc:276] 0709 13:09:20.815058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.357318 (+542260us) service_pool.cc:224] Handling call
0709 13:09:21.920128 (+562810us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:22.471902 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.472821 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:22.473810 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 657) took 1502 ms. Trace:
I20260709 13:09:22.474165 23650 rpcz_store.cc:276] 0709 13:09:20.971775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.472305 (+1500530us) service_pool.cc:224] Handling call
0709 13:09:22.473724 (+  1419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:21.909183 23651 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.477210 23651 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:22.006982 23652 rpcz_store.cc:276] 0709 13:09:20.316621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.317787 (+  1166us) service_pool.cc:224] Handling call
0709 13:09:21.619570 (+1301783us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:21.942141 (+322571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13161344}
I20260709 13:09:21.778318 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:21.863739 24825 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:21.811311 24850 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.484292 23075 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:22.487248 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 1921) took 1102 ms. Trace:
I20260709 13:09:21.971006 24863 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:21.976522 24890 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.003s
I20260709 13:09:22.489094 24890 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:21.960054 24930 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.515820 22927 raft_consensus.cc:1240] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:22.108062 24902 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:21.969312 24903 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.915525 24926 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.521561 24926 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.917202 24938 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.523774 24863 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.113173 24946 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.114553 25014 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:21.955039 25018 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:22.532084 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 750974us
W20260709 13:09:22.535881 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 97882us
I20260709 13:09:21.870791 25033 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:22.540231 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:22.541138 22999 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:21.920859 25066 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:22.544231 23653 raft_consensus.cc:2368] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5.
I20260709 13:09:22.545459 25066 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:22.545552 24850 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.112907 25076 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.547004 25076 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.547415 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:22.549546 25076 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:21.942838 25067 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:22.552136 25033 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.553207 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:22.554435 24903 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.949476 25071 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:21.945020 25082 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:22.563037 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:22.414947 23077 rpcz_store.cc:269] 0709 13:09:20.588638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.783716 (+195078us) service_pool.cc:224] Handling call
0709 13:09:22.413955 (+1630239us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540042dbd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:22.414218 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583788928}
I20260709 13:09:22.564610 25071 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.565361 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.566041 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:22.566957 23654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 510) took 1753 ms (client timeout 1827 ms). Trace:
I20260709 13:09:22.568007 25014 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:22.568794 25014 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:22.566406 23077 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:22.570677 23077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 1918) took 1246 ms. Trace:
I20260709 13:09:22.570960 25014 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.571305 23077 rpcz_store.cc:276] 0709 13:09:21.324634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.564826 (+1240192us) service_pool.cc:224] Handling call
0709 13:09:22.570568 (+  5742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.573084 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.574148 23077 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:22.575516 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.414961 23079 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:22.422658 25072 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:22.412519 23072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 1850) took 2716 ms (client timeout 1523 ms). Trace:
I20260709 13:09:22.447033 25081 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.418481 23649 rpcz_store.cc:269] 0709 13:09:20.319160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.335913 (+ 16753us) service_pool.cc:224] Handling call
0709 13:09:22.415872 (+2079959us) spinlock_profiling.cc:243] Waited 9.65 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:22.417785 (+  1913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22184704}
W20260709 13:09:22.410251 23074 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 376) took 2100 ms (client timeout 2170 ms). Trace:
I20260709 13:09:22.585233 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.464833 23655 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:22.466210 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:22.467336 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:22.467197 23080 rpcz_store.cc:276] 0709 13:09:20.299818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.249780 (+949962us) service_pool.cc:224] Handling call
0709 13:09:21.250229 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.250457 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:21.805669 (+555212us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.126005 (+320336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.126081 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:22.126166 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.126289 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.126426 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":535813,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":101,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":1920,"thread_start_us":857895,"threads_started":2,"wal-append.queue_time_us":319903}
W20260709 13:09:22.219545 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.604496 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68957.2us
I20260709 13:09:22.469422 25029 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:22.459399 23071 rpcz_store.cc:276] 0709 13:09:21.306748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.352266 (+ 45518us) service_pool.cc:224] Handling call
0709 13:09:22.458508 (+1106242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.451834 23006 rpcz_store.cc:276] 0709 13:09:20.813789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.815477 (+  1688us) service_pool.cc:224] Handling call
0709 13:09:20.815782 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.880918 (+ 65136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.880950 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.895763 (+ 14813us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.076471 (+180708us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:21.118170 (+ 41699us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.118378 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.329880 (+211502us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:22.408742 (+1078862us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b54003e7e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:22.408859 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.408993 (+   134us) raft_consensus.cc:1685] finished
0709 13:09:22.409042 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.409402 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28757,"prepare.queue_time_us":66782,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3840,"raft.queue_time_us":555,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":27797,"spinlock_wait_cycles":202707072,"thread_start_us":136676,"threads_started":1,"wal-append.queue_time_us":341479,"wal-append.run_cpu_time_us":4354,"wal-append.run_wall_time_us":1027635}
I20260709 13:09:22.505888 25011 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:22.460526 23000 rpcz_store.cc:276] 0709 13:09:20.690327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.781668 (+ 91341us) service_pool.cc:224] Handling call
0709 13:09:20.781891 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.813266 (+ 31375us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:21.073752 (+260486us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.141904 (+ 68152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.141950 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:21.142006 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.307694 (+165688us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b4800212358. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3929f33aa1 00007f3929f2ab37 00007f3929f2a9ca 00007f392a02226f 00007f392a021f37 00007f392a03655c 00007f392a036508 00007f392a036488 00007f392a036443 00007f392a0356ec 00007f3928f5fa96
0709 13:09:22.409897 (+1102203us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54000c76d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:22.409974 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.410278 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4642,"prepare.queue_time_us":222125,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":6882,"raft.run_cpu_time_us":2581,"raft.run_wall_time_us":161662,"spinlock_wait_cycles":81793152,"thread_start_us":323302,"threads_started":2,"wal-append.queue_time_us":156530,"wal-append.run_cpu_time_us":1376,"wal-append.run_wall_time_us":1042854}
I20260709 13:09:22.587924 25090 raft_consensus.cc:2764] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:22.514573 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 420) took 1859 ms. Trace:
I20260709 13:09:22.613642 23001 rpcz_store.cc:276] 0709 13:09:20.654881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.654994 (+   113us) service_pool.cc:224] Handling call
0709 13:09:20.655289 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.779951 (+124662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.779984 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.780030 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:20.780065 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.513880 (+1733815us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002e36d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:22.513997 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.514329 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251034496}
I20260709 13:09:22.487583 23075 rpcz_store.cc:276] 0709 13:09:21.385014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.037009 (+651995us) service_pool.cc:224] Handling call
0709 13:09:22.487026 (+450017us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b5400267354. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:22.487178 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164580096}
I20260709 13:09:22.526111 24938 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.555234 22970 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:22.616559 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 61484.1us
I20260709 13:09:22.616694 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:22.617400 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:22.618299 24972 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:22.618718 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:22.619391 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.619027 24972 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:22.567400 23654 rpcz_store.cc:269] 0709 13:09:20.813996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.565604 (+1751608us) service_pool.cc:224] Handling call
0709 13:09:22.566902 (+  1298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.621732 24972 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:22.578891 23072 rpcz_store.cc:269] 0709 13:09:19.696215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.714059 (+ 17844us) service_pool.cc:224] Handling call
0709 13:09:20.164649 (+450590us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:22.411960 (+2247311us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400034154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:22.412266 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442329856}
I20260709 13:09:22.579435 25072 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.622653 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.624078 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:22.624671 25072 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.624536 25067 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.581995 23005 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:22.625362 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.582427 24890 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:22.582880 25052 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.919s	user 0.013s	sys 0.014s
I20260709 13:09:22.626770 25067 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.583671 25081 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.583547 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 511) took 1769 ms. Trace:
I20260709 13:09:22.626886 25029 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:22.627477 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 73283.1us
I20260709 13:09:22.627977 23650 rpcz_store.cc:276] 0709 13:09:20.814278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.475116 (+1660838us) service_pool.cc:224] Handling call
0709 13:09:22.493432 (+ 18316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.583028 (+ 89596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.583069 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.583129 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.583208 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.583287 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.583438 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.629307 25081 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.629666 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 1870) took 1993 ms. Trace:
I20260709 13:09:22.630054 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:22.585444 23074 rpcz_store.cc:269] 0709 13:09:20.309117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.706978 (+397861us) service_pool.cc:224] Handling call
0709 13:09:22.409745 (+1702767us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5400276854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:22.409969 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40334592}
I20260709 13:09:22.597661 24825 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:22.598609 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 521) took 1758 ms. Trace:
I20260709 13:09:22.631794 24936 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:22.631745 23657 rpcz_store.cc:276] 0709 13:09:20.840418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.597369 (+1756951us) service_pool.cc:224] Handling call
0709 13:09:22.597869 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.598238 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.598262 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.598330 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.598394 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.598453 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.598549 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.632853 24936 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:22.599740 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:22.600656 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:22.630098 23071 rpcz_store.cc:276] 0709 13:09:20.636370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.628457 (+1992087us) service_pool.cc:224] Handling call
0709 13:09:22.628889 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.629230 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.629261 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.629327 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.629364 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.629427 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.629554 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:22.601022 23653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 700) took 1614 ms (client timeout 1885 ms). Trace:
I20260709 13:09:22.636617 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:22.637061 23653 rpcz_store.cc:269] 0709 13:09:20.986679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.353023 (+366344us) service_pool.cc:224] Handling call
0709 13:09:22.600761 (+1247738us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54004de254. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:22.600941 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1758699392}
I20260709 13:09:22.638304 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 383) took 1752 ms. Trace:
I20260709 13:09:22.638314 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:22.638657 23653 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:22.632077 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1916) took 1963 ms. Trace:
I20260709 13:09:22.639249 23074 rpcz_store.cc:276] 0709 13:09:20.668823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.631146 (+1962323us) service_pool.cc:224] Handling call
0709 13:09:22.631490 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.631747 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.631780 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.631819 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.631852 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.631906 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.632013 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.640080 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.636708 22998 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:22.641337 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.641479 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 384) took 1755 ms. Trace:
I20260709 13:09:22.641950 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1914) took 2377 ms. Trace:
I20260709 13:09:22.642355 23079 rpcz_store.cc:276] 0709 13:09:20.264668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.264785 (+   117us) service_pool.cc:224] Handling call
0709 13:09:22.413745 (+2148960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.578764 (+165019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.641760 (+ 62996us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400034150. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:22.641904 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4940590464}
I20260709 13:09:22.644251 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1917) took 1320 ms. Trace:
I20260709 13:09:22.644590 23079 rpcz_store.cc:276] 0709 13:09:21.324224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.643257 (+1319033us) service_pool.cc:224] Handling call
0709 13:09:22.643598 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.643940 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.643969 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.644026 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.644052 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.644108 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.644197 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.646463 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1919) took 1300 ms. Trace:
I20260709 13:09:22.634232 23657 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:22.646792 23079 rpcz_store.cc:276] 0709 13:09:21.345785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.645526 (+1299741us) service_pool.cc:224] Handling call
0709 13:09:22.645832 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.646137 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.646159 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.646197 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:22.646247 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.646304 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.646414 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.514118 22931 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:22.612948 23077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 1922) took 1209 ms. Trace:
I20260709 13:09:22.647830 23077 rpcz_store.cc:276] 0709 13:09:21.398509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.575109 (+1176600us) service_pool.cc:224] Handling call
0709 13:09:22.607824 (+ 32715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.626134 23080 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:22.630276 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1915) took 2362 ms. Trace:
I20260709 13:09:22.563242 25082 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:22.630995 25088 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:22.601562 25003 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:22.641124 24993 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.650794 24972 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:22.638747 24818 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:22.651288 24972 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:22.651839 24972 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.652196 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:22.653223 23002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 1876) took 1518 ms (client timeout 1930 ms). Trace:
I20260709 13:09:22.653322 23080 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:22.653604 23002 rpcz_store.cc:269] 0709 13:09:21.134955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.139587 (+  4632us) service_pool.cc:224] Handling call
0709 13:09:22.651888 (+1512301us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:22.653137 (+  1249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4736256}
I20260709 13:09:22.648694 23078 rpcz_store.cc:276] 0709 13:09:20.268147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.268263 (+   116us) service_pool.cc:224] Handling call
0709 13:09:20.305612 (+ 37349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.305956 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.305983 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.312348 (+  6365us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.506721 (+194373us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:20.506780 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.514862 (+  8082us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.581755 (+2066893us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:22.629808 (+ 48053us) raft_consensus.cc:1685] finished
0709 13:09:22.629825 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.630086 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":24670,"spinlock_wait_cycles":22002944,"thread_start_us":194071,"threads_started":1,"wal-append.queue_time_us":350663}
I20260709 13:09:22.660795 23077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1924) took 1204 ms. Trace:
I20260709 13:09:22.641945 23074 rpcz_store.cc:276] 0709 13:09:20.886456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.640457 (+1754001us) service_pool.cc:224] Handling call
0709 13:09:22.640821 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.641028 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.641061 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.641121 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.641148 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.641209 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.641432 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.661266 23077 rpcz_store.cc:276] 0709 13:09:21.456440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.659722 (+1203282us) service_pool.cc:224] Handling call
0709 13:09:22.660101 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.660458 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.660488 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.660523 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:22.660552 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.660617 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.660716 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.663949 24793 raft_consensus.cc:3055] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:22.376430 22825 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 256) took 6413 ms. Trace:
I20260709 13:09:22.650000 25082 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.639334 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 655) took 1668 ms. Trace:
W20260709 13:09:22.601819 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 153505us
I20260709 13:09:22.665681 22998 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:22.586649 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 516) took 1771 ms. Trace:
I20260709 13:09:22.666509 24804 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.643477 25018 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.638759 23071 rpcz_store.cc:276] 0709 13:09:20.885418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.636956 (+1751538us) service_pool.cc:224] Handling call
0709 13:09:22.637622 (+   666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.637881 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.637911 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.637980 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.638027 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.638118 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.638243 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:22.683537 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.663391 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1923) took 1233 ms. Trace:
I20260709 13:09:22.694728 23079 rpcz_store.cc:276] 0709 13:09:21.430225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.662464 (+1232239us) service_pool.cc:224] Handling call
0709 13:09:22.662819 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.663059 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.663079 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.663127 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.663169 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.663229 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.663330 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.696393 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.670171 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:22.706702 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:22.694908 25088 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:22.697752 25090 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.692461 24793 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:22.726244 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 94604.6us
I20260709 13:09:22.697592 25072 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:22.732993 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 525) took 1873 ms. Trace:
I20260709 13:09:22.690335 23653 rpcz_store.cc:276] 0709 13:09:20.971137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.638059 (+1666922us) service_pool.cc:224] Handling call
0709 13:09:22.638452 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.639097 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.639289 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.734604 23657 rpcz_store.cc:276] 0709 13:09:20.859589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.633116 (+1773527us) service_pool.cc:224] Handling call
0709 13:09:22.633539 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.634009 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:22.693710 (+ 59701us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.732537 (+ 38827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.732606 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.732672 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.732763 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.732921 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":249,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":182,"thread_start_us":10131,"threads_started":1}
W20260709 13:09:22.740844 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 110998us
I20260709 13:09:22.741612 23002 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.742667 22930 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
W20260709 13:09:22.740193 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49581.8us
W20260709 13:09:22.748091 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.750579 24965 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:22.750984 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 515) took 1935 ms. Trace:
I20260709 13:09:22.751428 23652 rpcz_store.cc:276] 0709 13:09:20.815304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.479159 (+1663855us) service_pool.cc:224] Handling call
0709 13:09:22.532154 (+ 52995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.533092 (+   938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.533134 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.534940 (+  1806us) log.cc:844] Serialized 564 byte log entry
0709 13:09:22.613021 (+ 78081us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.649339 (+ 36318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.691337 (+ 41998us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.750632 (+ 59295us) raft_consensus.cc:1685] finished
0709 13:09:22.750665 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.750804 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":69321,"threads_started":1,"wal-append.queue_time_us":213503}
I20260709 13:09:22.752938 22970 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:22.753512 23003 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:22.755239 25072 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.756126 24936 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.756209 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.757007 23071 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:22.758144 25072 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.759235 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:22.759552 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:22.760109 23653 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:22.760805 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:22.761248 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:22.762145 25029 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.763707 22972 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:22.763999 24957 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:22.764529 24957 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.764971 24957 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.767215 24890 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:22.767871 24825 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:22.768368 24825 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.768761 24825 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.753082 23656 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.730990 25003 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.763386 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 689) took 1791 ms. Trace:
I20260709 13:09:22.693439 23649 rpcz_store.cc:276] 0709 13:09:20.815533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.585543 (+1770010us) service_pool.cc:224] Handling call
0709 13:09:22.585903 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.586227 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.586273 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.586334 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:22.586371 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.586448 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.586572 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.778486 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 517) took 1954 ms. Trace:
I20260709 13:09:22.744194 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:22.781350 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:22.781913 23655 rpcz_store.cc:276] 0709 13:09:20.819543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.586233 (+1766690us) service_pool.cc:224] Handling call
0709 13:09:22.586648 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.589518 (+  2870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.589561 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.593393 (+  3832us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.697739 (+104346us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:22.697764 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.697808 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.773319 (+ 75511us) raft_consensus.cc:1685] finished
0709 13:09:22.773346 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.773481 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1813,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":8318,"thread_start_us":100177,"threads_started":1,"wal-append.queue_time_us":145952}
I20260709 13:09:22.779088 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1878) took 1643 ms. Trace:
I20260709 13:09:22.787703 23003 rpcz_store.cc:276] 0709 13:09:21.135717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.137134 (+  1417us) service_pool.cc:224] Handling call
0709 13:09:22.407012 (+1269878us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:22.407551 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.753990 (+346439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.772594 (+ 18604us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400012554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:22.779011 (+  6417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707022976}
I20260709 13:09:22.734074 25071 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.792632 23656 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:22.793378 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:22.686190 22825 rpcz_store.cc:276] 0709 13:09:15.962417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.970151 (+  7734us) service_pool.cc:224] Handling call
0709 13:09:22.376113 (+6405962us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:16.889114 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:17.056629 (+167515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:17.062348 (+  5719us) write_op.cc:435] Acquired schema lock
0709 13:09:17.065341 (+  2993us) tablet.cc:662] Decoding operations
0709 13:09:17.155933 (+ 90592us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:17.156006 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:17.156031 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:17.156391 (+   360us) tablet.cc:701] Row locks acquired
0709 13:09:17.156411 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:09:17.156543 (+   132us) write_op.cc:270] Start()
0709 13:09:17.156654 (+   111us) write_op.cc:276] Timestamp: P: 1783602557156498 usec, L: 0
0709 13:09:17.156675 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:09:17.157283 (+   608us) log.cc:844] Serialized 1302 byte log entry
0709 13:09:18.572544 (+1415261us) op_driver.cc:464] REPLICATION: finished
0709 13:09:18.832350 (+259806us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3921f000ac 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3928a40ef0
0709 13:09:19.272364 (+440014us) write_op.cc:301] APPLY: starting
0709 13:09:19.272462 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:19.272598 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:19.272618 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:19.324620 (+ 52002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:19.324813 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:09:19.324862 (+    49us) write_op.cc:312] APPLY: finished
0709 13:09:19.325088 (+   226us) log.cc:844] Serialized 35 byte log entry
0709 13:09:19.325280 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:19.325370 (+    90us) write_op.cc:454] Released schema lock
0709 13:09:19.325437 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:19.353062 (+ 27625us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:19.358103 (+  5041us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243268,"reported_tablets":12,"spinlock_wait_cycles":253696,"child_traces":[["op",{"apply.queue_time_us":656499,"apply.run_cpu_time_us":2177,"apply.run_wall_time_us":53467,"num_ops":3,"prepare.queue_time_us":344746,"prepare.run_cpu_time_us":61818,"prepare.run_wall_time_us":689649,"raft.queue_time_us":1773134,"raft.run_cpu_time_us":36478,"raft.run_wall_time_us":1007968,"replication_time_us":1384810,"spinlock_wait_cycles":6893440,"thread_start_us":1773344,"threads_started":4,"wal-append.queue_time_us":424398,"wal-append.run_cpu_time_us":39322,"wal-append.run_wall_time_us":2981379}]]}
I20260709 13:09:22.773857 25003 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.801306 23002 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
W20260709 13:09:22.803617 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 526) took 1921 ms (client timeout 1737 ms). Trace:
I20260709 13:09:22.780800 25090 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:22.810536 24973 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.811144 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.812619 23079 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:22.813735 24963 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.814291 24963 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.810675 24948 raft_consensus.cc:3055] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:22.804265 23656 rpcz_store.cc:269] 0709 13:09:20.882614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.051864 (+169250us) service_pool.cc:224] Handling call
0709 13:09:22.599287 (+1547423us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b58001622d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f660aa 00007f3924fe8447 00007f3925000fe7 00007f39250027de 00007f392500e27c 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c
0709 13:09:22.803523 (+204236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445574400}
I20260709 13:09:22.802819 25003 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.829088 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:22.832214 24786 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.832856 24786 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.835250 25029 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.840000 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.840407 25029 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.841321 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.835973 24900 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.802670 25067 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:22.836397 24963 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:22.836848 22931 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:22.837378 25018 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.838656 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.839334 25032 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.839795 25072 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:22.900035 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:22.910950 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 72169us
I20260709 13:09:22.888573 23656 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:22.842888 22930 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:22.882776 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 523) took 2037 ms. Trace:
I20260709 13:09:22.921083 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:22.825404 24948 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:22.922528 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:22.921875 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 75281.3us
I20260709 13:09:22.926959 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.928236 25082 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:22.920665 25104 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:09:22.913170 23045 leader_election.cc:336] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.637s (SENT)
I20260709 13:09:22.842473 25029 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.842410 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.901425 24972 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.903942 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 524) took 2054 ms. Trace:
I20260709 13:09:22.951894 23650 rpcz_store.cc:276] 0709 13:09:20.850026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.629555 (+1779529us) service_pool.cc:224] Handling call
0709 13:09:22.629980 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.659753 (+ 29773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.659800 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.660493 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.743049 (+ 82556us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.759215 (+ 16166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.759306 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.903539 (+144233us) raft_consensus.cc:1685] finished
0709 13:09:22.903564 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.903826 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20123,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":69211,"threads_started":1,"wal-append.queue_time_us":167174}
I20260709 13:09:22.941789 22924 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:22.942528 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:22.913120 25090 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.941926 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:22.776091 23653 rpcz_store.cc:276] 0709 13:09:20.972051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.762286 (+1790235us) service_pool.cc:224] Handling call
0709 13:09:22.762679 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.762990 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.763020 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.763067 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.763131 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.763220 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.763336 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.913041 24895 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:22.939980 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:22.947479 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:22.947885 23004 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:22.948505 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:22.948406 24930 consensus_queue.cc:1059] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:22.949312 25082 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.949769 24963 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:22.958302 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:22.844580 24936 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:22.933313 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:22.960500 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:22.929314 24957 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:22.935395 25105 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.098s	user 0.004s	sys 0.000s
I20260709 13:09:22.971174 22931 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.971987 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:22.971424 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:22.917106 23654 rpcz_store.cc:276] 0709 13:09:20.845154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.621165 (+1776011us) service_pool.cc:224] Handling call
0709 13:09:22.621564 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.621902 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:22.724920 (+103018us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.876247 (+151327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.876324 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:22.882519 (+  6195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.882588 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.882722 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5681,"prepare.queue_time_us":128475,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":58754,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":1013,"thread_start_us":168491,"threads_started":2,"wal-append.queue_time_us":166559}
W20260709 13:09:22.977399 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 207089us
I20260709 13:09:22.846246 25071 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.842911 24973 consensus_queue.cc:1059] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.127s
I20260709 13:09:22.844417 25000 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:09:22.979439 22927 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 1.
I20260709 13:09:22.977522 23002 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.979053 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 373) took 2636 ms. Trace:
I20260709 13:09:22.978715 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1920) took 1626 ms. Trace:
I20260709 13:09:22.969192 24895 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.984088 25072 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.985219 24972 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:22.985543 24895 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.986143 25072 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:22.986621 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 156807us
I20260709 13:09:22.988329 22929 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 1.
I20260709 13:09:22.990151 25061 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:22.963613 24900 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:23.034919 24991 consensus_meta.cc:287] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.597s	user 0.004s	sys 0.011s
I20260709 13:09:23.035506 23006 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
W20260709 13:09:22.993594 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 116673us
I20260709 13:09:23.036267 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:23.036656 23045 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.769s (SENT)
I20260709 13:09:23.040441 24900 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.982388 23076 rpcz_store.cc:276] 0709 13:09:20.308378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.273379 (+965001us) service_pool.cc:224] Handling call
0709 13:09:22.807320 (+1533941us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:22.824482 (+ 17162us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5e9c 00007f3921ee5a5b 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:22.870939 (+ 46457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.913925 (+ 42986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.913954 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.932631 (+ 18677us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.944622 (+ 11991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.944680 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.944783 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140988672}
I20260709 13:09:23.008385 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.023730 22930 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.042214 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.024026 23079 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:23.025152 24825 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.044999 25071 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.991770 22998 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:23.025544 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.046157 22931 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 1.
I20260709 13:09:23.047252 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.047784 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.048146 23076 raft_consensus.cc:2410] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:09:23.026175 23648 consensus_meta.cc:287] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.002s
I20260709 13:09:23.048769 24957 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:23.048995 23648 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
W20260709 13:09:23.049576 23648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 519) took 2224 ms (client timeout 2207 ms). Trace:
I20260709 13:09:22.964046 25032 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.050103 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:23.049957 23648 rpcz_store.cc:269] 0709 13:09:20.824808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.413171 (+588363us) service_pool.cc:224] Handling call
0709 13:09:23.049475 (+1636304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.051074 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:23.052212 25032 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:22.971777 24793 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:23.034076 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 53770.4us
I20260709 13:09:23.052722 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.053335 24793 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.053474 23076 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:23.053629 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.053959 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 696) took 2080 ms. Trace:
I20260709 13:09:23.054354 23649 rpcz_store.cc:276] 0709 13:09:20.974063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.052913 (+2078850us) service_pool.cc:224] Handling call
0709 13:09:23.053331 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.053623 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.053650 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.053692 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.053728 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.053812 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.053909 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.055828 25072 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:23.055898 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 695) took 2082 ms. Trace:
I20260709 13:09:23.056301 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 527) took 1932 ms. Trace:
I20260709 13:09:23.056437 25072 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.056813 23649 rpcz_store.cc:276] 0709 13:09:21.124366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.055378 (+1931012us) service_pool.cc:224] Handling call
0709 13:09:23.055715 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.055973 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.055998 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.056041 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:23.056070 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.056127 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.056230 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.057708 25072 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.058341 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.059247 23649 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.060000 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 528) took 1915 ms. Trace:
I20260709 13:09:23.035321 24991 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.065042 25090 raft_consensus.cc:3055] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:23.065485 25090 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.065665 22999 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:23.066471 25090 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:22.945657 25067 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.067739 25090 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.069460 25067 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:22.999212 24963 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.050225 24818 raft_consensus.cc:2764] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:23.050931 23079 raft_consensus.cc:2368] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5.
I20260709 13:09:23.033604 23652 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.060413 24930 consensus_queue.cc:1059] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:23.034574 23651 consensus_meta.cc:287] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:09:22.970484 24786 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.085368 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.029037 24948 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.072408 23655 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:23.063627 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 692) took 2090 ms. Trace:
I20260709 13:09:23.090967 23656 rpcz_store.cc:276] 0709 13:09:20.972894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.062791 (+2089897us) service_pool.cc:224] Handling call
0709 13:09:23.063114 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.063332 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.063356 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.063393 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:23.063442 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.063495 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.063580 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14720}
I20260709 13:09:23.055541 22896 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.073189 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.061429 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.085306 24963 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.085765 25066 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.093863 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:23.063004 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:23.045156 24825 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:23.056484 23648 rpcz_store.cc:276] 0709 13:09:20.973771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.051561 (+2077790us) service_pool.cc:224] Handling call
0709 13:09:23.051966 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.052272 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.052299 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.052360 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.052402 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.052468 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.055825 (+  3357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.086086 24991 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.126865 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.129807 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:23.131280 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 693) took 2158 ms. Trace:
I20260709 13:09:23.131377 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.131717 23654 rpcz_store.cc:276] 0709 13:09:20.973198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.983528 (+2010330us) service_pool.cc:224] Handling call
0709 13:09:23.105072 (+121544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.130992 (+ 25920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.131017 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.131054 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.131086 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.131139 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.131231 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.134123 23654 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:23.135262 24938 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.094487 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:23.135643 24963 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.136125 24963 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.136428 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.104619 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.137598 22971 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:23.137790 22922 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:23.138206 24963 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.090569 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.139055 24991 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.139793 24991 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:23.139825 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:23.140245 24991 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.135638 24938 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.140631 24991 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.140944 24938 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.144093 24972 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:23.144497 25107 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.100147 22999 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:23.103713 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 53949us
I20260709 13:09:23.089344 23002 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:23.148151 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.149034 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.149688 25066 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:23.150056 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.150803 23003 raft_consensus.cc:2393] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:23.151755 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.094110 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.152379 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.152665 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.107388 25067 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:23.153306 23003 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:23.108457 24936 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.154420 24936 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:23.154822 24936 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.983179 23075 rpcz_store.cc:276] 0709 13:09:21.348951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.822642 (+1473691us) service_pool.cc:224] Handling call
0709 13:09:22.876709 (+ 54067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.905976 (+ 29267us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:22.944541 (+ 38565us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.974835 (+ 30294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.974881 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:22.974918 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.974972 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.975079 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26270,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":8818,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4663,"thread_start_us":21355,"threads_started":1,"wal-append.queue_time_us":54039}
I20260709 13:09:23.112126 23071 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:23.149708 22999 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:23.113699 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.115603 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.116338 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.157944 24825 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:23.116580 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 691) took 2144 ms. Trace:
I20260709 13:09:23.158365 24825 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:23.158640 23653 rpcz_store.cc:276] 0709 13:09:20.972599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.075342 (+2102743us) service_pool.cc:224] Handling call
0709 13:09:23.115434 (+ 40092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.115615 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.115650 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.116235 (+   585us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.116291 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.116371 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.116510 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.111985 23005 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:23.071491 23649 rpcz_store.cc:276] 0709 13:09:21.144900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.058465 (+1913565us) service_pool.cc:224] Handling call
0709 13:09:23.058951 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.059723 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.059937 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.160539 23653 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.086585 23651 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:23.117985 25033 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:23.161502 23651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 522) took 2318 ms (client timeout 2049 ms). Trace:
I20260709 13:09:23.161580 25033 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:23.162039 23651 rpcz_store.cc:269] 0709 13:09:20.842808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.355638 (+512830us) service_pool.cc:224] Handling call
0709 13:09:23.161414 (+1805776us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.120874 24895 raft_consensus.cc:3055] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.163072 24895 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:23.162752 25033 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.126602 25011 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.135035 24965 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:23.168524 25011 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:23.144544 24972 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:23.169711 24972 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.169536 25011 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.170823 25011 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.176036 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.170697 23652 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
W20260709 13:09:23.105305 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 115529us
I20260709 13:09:23.177594 24972 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.179067 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.180032 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:23.106528 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.164011 24895 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.167415 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.176705 22927 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
W20260709 13:09:23.177234 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 70129.9us
W20260709 13:09:23.124284 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 60341.6us
I20260709 13:09:23.164139 25033 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.106868 24948 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.187008 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.106989 24900 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.196225 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.197139 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 529) took 1862 ms. Trace:
W20260709 13:09:23.197494 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.198688 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.183859 25076 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.180971 22998 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
W20260709 13:09:23.212859 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.119369 25003 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.213933 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.215445 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 530) took 1415 ms. Trace:
I20260709 13:09:23.215934 23657 rpcz_store.cc:276] 0709 13:09:21.800230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.102761 (+1302531us) service_pool.cc:224] Handling call
0709 13:09:23.196571 (+ 93810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.215139 (+ 18568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.215170 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.215207 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:23.215235 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.215296 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.215398 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.159212 24825 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.222784 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.223639 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:23.236123 22922 raft_consensus.cc:2393] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:23.235957 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:23.239094 24936 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.239920 23075 raft_consensus.cc:2368] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5.
I20260709 13:09:23.241058 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.241377 24936 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.242388 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:23.241403 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 43709.7us
I20260709 13:09:23.243682 22896 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.246063 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.247032 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.200223 23655 rpcz_store.cc:276] 0709 13:09:21.335163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.097154 (+1761991us) service_pool.cc:224] Handling call
0709 13:09:23.127620 (+ 30466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.127987 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:23.128317 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.196762 (+ 68445us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.196818 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:23.196873 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.196951 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.197079 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5144,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":3221,"thread_start_us":66607,"threads_started":1,"wal-append.queue_time_us":66987}
I20260709 13:09:23.239811 24972 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.252266 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.252269 24972 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.253845 23073 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:23.253733 24972 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.254482 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.255050 22923 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.257121 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.257812 23001 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:23.247079 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:23.258880 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:23.259970 22970 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.260569 24890 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:23.261042 24890 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:23.261467 24890 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.262136 22970 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.262838 23076 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.262995 25003 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:23.259982 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.193085 24991 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.264061 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:23.264432 24903 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.265309 23079 raft_consensus.cc:2410] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:23.265249 24903 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:23.265592 24991 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:23.266255 24991 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.221285 25076 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.214246 24900 raft_consensus.cc:697] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.267792 25088 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:23.266305 25061 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:23.259449 23075 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.268678 25061 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:23.269170 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:23.269778 25061 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.270714 23648 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:23.213212 24895 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.274389 24965 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:23.274955 24965 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:23.276015 24965 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.278986 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:23.270282 24972 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:23.280426 24972 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:23.280834 24972 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.281208 24972 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.267606 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:23.282387 25107 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:23.231781 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:23.282949 25107 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:23.284401 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 381) took 2399 ms. Trace:
I20260709 13:09:23.283982 25107 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.293998 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.280170 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:23.294703 22923 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:23.296680 23006 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
W20260709 13:09:23.298158 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 149730us
I20260709 13:09:23.268539 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:23.316476 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 108522us
W20260709 13:09:23.317000 25115 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.003s
I20260709 13:09:23.320473 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.322227 24943 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.322634 25018 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:23.323181 25018 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:23.325232 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 81701.9us
I20260709 13:09:23.326016 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:23.331985 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 109727us
I20260709 13:09:23.332238 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 661) took 1533 ms. Trace:
I20260709 13:09:23.320026 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.332595 23656 rpcz_store.cc:276] 0709 13:09:21.798713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.104211 (+1305498us) service_pool.cc:224] Handling call
0709 13:09:23.113444 (+  9233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.113935 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.113964 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.115008 (+  1044us) log.cc:844] Serialized 564 byte log entry
0709 13:09:23.297833 (+182825us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.297886 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.297979 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.332056 (+ 34077us) raft_consensus.cc:1685] finished
0709 13:09:23.332074 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.332188 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":182422,"threads_started":1,"wal-append.queue_time_us":191197}
I20260709 13:09:23.333186 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.349905 23075 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:23.351293 23621 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.318300 24825 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.354012 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.362787 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:23.332118 25061 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:23.368196 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 181284us
I20260709 13:09:23.369989 22970 leader_election.cc:400] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5.
I20260709 13:09:23.370736 24786 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.370584 24938 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.372051 22970 leader_election.cc:400] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5.
I20260709 13:09:23.372339 22970 leader_election.cc:403] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:23.373132 23006 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:23.373425 25088 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.374166 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.374861 23077 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:23.376070 25076 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:23.284780 23072 rpcz_store.cc:276] 0709 13:09:20.884618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.635431 (+1750813us) service_pool.cc:224] Handling call
0709 13:09:22.635845 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.652915 (+ 17070us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:22.774312 (+121397us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.193277 (+418965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.200046 (+  6769us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:23.206351 (+  6305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.284083 (+ 77732us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5400267d54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:23.284148 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.284317 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140074,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":6694,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5414,"spinlock_wait_cycles":38363008,"thread_start_us":438999,"threads_started":2}
I20260709 13:09:23.377612 25029 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.378157 25029 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.378419 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.380223 23074 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.381016 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.382889 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.348978 24930 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.268581 24900 consensus_queue.cc:237] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.384364 25119 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:23.384943 25119 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:23.385361 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:23.385845 25119 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:23.386793 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 46662.8us
W20260709 13:09:23.394919 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 152601us
I20260709 13:09:23.395117 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.395334 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:23.409554 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.383226 24972 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.411176 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.412003 23077 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:23.413251 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.414805 23076 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:23.379125 25029 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.415807 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.416404 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.418094 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:23.417230 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:23.421151 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 58444.6us
I20260709 13:09:23.422220 22924 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.397256 23651 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:23.410362 24963 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.413503 24895 raft_consensus.cc:2764] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:23.381026 24804 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:09:23.425745 24963 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:23.427938 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.431169 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.432631 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.433637 22896 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:23.434218 24930 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.449667 24930 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.450076 24930 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.450208 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.451829 25076 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.452873 25032 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.452960 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.453363 25032 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.453776 25032 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.437022 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 531) took 1636 ms. Trace:
I20260709 13:09:23.443925 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:23.446610 23075 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:23.461308 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:23.461427 23073 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:23.461973 23077 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:23.455832 24963 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.484025 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:23.460672 23072 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:23.468016 25072 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.494066 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:23.497092 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.424904 25018 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.465782 25071 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:09:23.514269 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 80697.7us
I20260709 13:09:23.515509 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:23.525379 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.490211 24825 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:23.533372 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.456604 23648 rpcz_store.cc:276] 0709 13:09:21.800515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.115109 (+1314594us) service_pool.cc:224] Handling call
0709 13:09:23.185346 (+ 70237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.271157 (+ 85811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.410477 (+139320us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54005c1cd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:23.436777 (+ 26300us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b54005c1cd0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:23.436958 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351524992}
I20260709 13:09:23.539373 25019 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:23.539774 25121 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:09:23.540594 25120 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:09:23.541487 25116 log.cc:927] Time spent T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.250s	user 0.000s	sys 0.008s
I20260709 13:09:23.519676 24890 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.542601 25011 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:23.544317 24818 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.525530 24938 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:23.526659 24895 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.546805 24793 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:23.510964 25072 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:23.553921 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.494259 25117 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:23.510771 25000 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.575587 25000 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.576066 25000 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.555631 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.526407 25066 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.579252 25135 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.570855 25072 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.580067 25072 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.581218 25033 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:23.581575 25033 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.582410 25033 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.584144 24973 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:23.584553 24973 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:23.585095 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.585512 24973 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.586684 24973 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.586869 25066 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.588279 25088 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5.
I20260709 13:09:23.590416 22829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 370) took 7005 ms. Trace:
I20260709 13:09:23.564579 25011 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.591971 25011 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.592326 25032 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.596036 24965 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.595397 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.599083 22925 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:23.554662 25019 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:23.614317 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 49232.9us
I20260709 13:09:23.616560 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.596028 22825 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 4 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.601205 23620 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.569993 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.572641 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.586706 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:23.561808 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:23.622088 23005 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:23.623310 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50734.9us
W20260709 13:09:23.604128 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.620610 22825 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 3, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.566241 24793 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:23.628170 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:23.632726 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 658) took 2387 ms. Trace:
I20260709 13:09:23.633101 23650 rpcz_store.cc:276] 0709 13:09:21.245217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.059105 (+1813888us) service_pool.cc:224] Handling call
0709 13:09:23.059508 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.135740 (+ 76232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.135796 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.136432 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.352307 (+215875us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:23.362610 (+ 10303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.386818 (+ 24208us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.417670 (+ 30852us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:23.632435 (+214765us) raft_consensus.cc:1685] finished
0709 13:09:23.632458 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.632650 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30257,"raft.queue_time_us":65130,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":94,"spinlock_wait_cycles":6453632,"thread_start_us":163627,"threads_started":1,"wal-append.queue_time_us":154311}
I20260709 13:09:23.590765 22829 rpcz_store.cc:276] 0709 13:09:16.584551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.584670 (+   119us) service_pool.cc:224] Handling call
0709 13:09:23.590352 (+7005682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:22.647022 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:22.666818 (+ 19796us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:22.666879 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:09:22.666925 (+    46us) tablet.cc:662] Decoding operations
0709 13:09:22.667428 (+   503us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:22.667550 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:22.667593 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:22.667979 (+   386us) tablet.cc:701] Row locks acquired
0709 13:09:22.668026 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:09:22.668196 (+   170us) write_op.cc:270] Start()
0709 13:09:22.668367 (+   171us) write_op.cc:276] Timestamp: P: 1783602562668132 usec, L: 0
0709 13:09:22.668390 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:22.702513 (+ 34123us) log.cc:844] Serialized 536 byte log entry
0709 13:09:22.934461 (+231948us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:23.228366 (+293905us) op_driver.cc:464] REPLICATION: finished
0709 13:09:23.271950 (+ 43584us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3921f000ac 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3928a40ef0
0709 13:09:23.437903 (+165953us) write_op.cc:301] APPLY: starting
0709 13:09:23.437994 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:23.438093 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:23.438127 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:23.438431 (+   304us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:23.438662 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:23.438703 (+    41us) write_op.cc:312] APPLY: finished
0709 13:09:23.438956 (+   253us) log.cc:844] Serialized 23 byte log entry
0709 13:09:23.439146 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:23.439222 (+    76us) write_op.cc:454] Released schema lock
0709 13:09:23.439287 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:23.485713 (+ 46426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:23.488131 (+  2418us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":203413,"apply.run_cpu_time_us":1889,"apply.run_wall_time_us":18599,"num_ops":1,"prepare.queue_time_us":121486,"prepare.run_cpu_time_us":23820,"prepare.run_wall_time_us":219775,"raft.queue_time_us":207939,"raft.run_cpu_time_us":16859,"raft.run_wall_time_us":208292,"replication_time_us":527472,"spinlock_wait_cycles":105531008,"thread_start_us":505991,"threads_started":4,"wal-append.queue_time_us":133830}]]}
W20260709 13:09:23.636087 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 66215.5us
I20260709 13:09:23.612392 25118 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.619930 25019 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.636754 23622 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.624673 23004 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:23.624681 25082 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.621976 24972 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.626422 24895 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:23.650221 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 49074.9us
I20260709 13:09:23.657050 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.658406 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.659759 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.627003 22825 catalog_manager.cc:5697] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.643102 24818 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.645442 25119 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.645468 25032 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:23.645829 25033 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.646346 25117 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:23.670855 22825 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 4, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:23.639612 25088 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:09:23.679427 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.680033 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.661967 24895 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:23.680716 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:23.683332 25078 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:23.669973 25067 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:23.685106 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68646.4us
I20260709 13:09:23.677488 22825 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 4, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:23.652312 25018 consensus_queue.cc:1059] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:09:23.667807 25119 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.673365 25118 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.674853 24938 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.744820 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:23.731271 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51315.6us
I20260709 13:09:23.730938 22972 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:23.675881 25117 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:23.745597 25076 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.734587 25133 raft_consensus.cc:1064] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:09:23.734733 25132 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:23.735735 25128 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:09:23.736109 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 79151.4us
I20260709 13:09:23.705521 25119 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.685655 24895 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.693025 23072 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.687944 22825 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:23.730312 24957 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.763584 24991 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:23.773023 24793 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.748008 25078 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.781839 24793 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.782778 25078 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.785223 25066 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.752143 24890 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:23.789243 25135 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:23.789613 25135 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:23.790479 25135 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.826473 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:23.828220 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 67207.2us
I20260709 13:09:23.832234 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:23.834064 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.834290 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 318849us
I20260709 13:09:23.828886 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:23.836915 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.760089 25132 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.751986 25117 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.871505 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.875232 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.877933 22922 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:23.875491 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.798550 24991 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:23.875646 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.791628 25135 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.875260 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:23.886144 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.799906 24890 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:23.889963 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:23.892763 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:23.844003 24957 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.900463 22923 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:23.791841 25072 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.823551 24963 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.878608 25118 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.878798 25067 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.907215 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:23.877146 25132 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.893013 24948 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:23.914193 25131 consensus_queue.cc:1059] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.147s
W20260709 13:09:23.915580 25112 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:23.833453 25019 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.916636 22922 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:23.903555 24943 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:23.937784 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 168900us
I20260709 13:09:23.904692 25018 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:23.916070 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:23.949534 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:23.945554 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 59455.2us
I20260709 13:09:23.910029 25118 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:23.960354 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 158054us
I20260709 13:09:23.781884 25133 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.928373 25141 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:23.966050 24936 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:23.966612 24936 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:23.967587 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:23.968428 23045 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:23.948316 24943 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.907317 24890 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:23.947016 25029 raft_consensus.cc:3055] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:23.941740 24948 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.955593 25118 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.954191 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:23.942234 25067 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:23.989027 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:23.994062 22922 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.962996 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:23.972214 24930 consensus_meta.cc:287] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.003s
I20260709 13:09:23.973726 24943 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.969338 25141 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:23.969105 24963 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:23.962719 24957 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:09:23.980718 25029 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:23.993589 25066 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:24.013002 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 69637.5us
I20260709 13:09:24.018285 23005 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:24.000753 24818 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:23.962670 25018 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:24.001657 24930 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:24.024950 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 56606.7us
I20260709 13:09:24.004606 25141 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.009019 25134 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:24.019168 23650 raft_consensus.cc:2368] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6.
I20260709 13:09:24.018962 25066 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:24.033756 24973 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:24.065138 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:24.000237 24991 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.068303 25029 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.070592 22922 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:24.071046 22926 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:24.070685 25138 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:09:24.075927 25149 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:24.077844 22930 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:24.077497 25072 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.056454 24895 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.089540 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:24.090174 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:24.063934 24965 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:24.064158 25066 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:24.107111 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.093636 25149 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.107339 25152 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:24.107746 25149 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.107937 25152 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:24.032582 24818 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.111766 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:24.112692 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.070528 24948 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.101531 24957 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:24.082762 25011 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:24.118449 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.109520 25019 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:24.132102 25146 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:09:24.132375 25142 consensus_queue.cc:1059] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:09:24.116534 25029 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.116729 24973 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:24.143325 25144 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:09:24.144217 25159 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:24.127061 24957 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:24.147887 23078 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:24.155287 23074 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:24.155366 24818 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:24.156406 25151 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:24.154444 25159 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:24.159606 25119 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.166332 23651 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:24.159991 25150 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:09:24.166380 25159 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.167989 24930 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:24.162681 25157 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:24.173498 25157 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.176214 25118 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.148973 25152 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.183771 24957 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:24.184952 24957 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.160732 24895 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.137089 25132 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.177908 25119 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:24.195948 23656 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:24.185796 24793 consensus_queue.cc:1059] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:09:24.197988 25132 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:24.163010 24973 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:24.202191 24804 raft_consensus.cc:3055] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:24.202582 24804 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:24.211998 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:24.212677 23072 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.212791 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:24.213428 25156 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:24.213887 25156 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:24.214720 25156 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:24.217800 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 46431.6us
I20260709 13:09:24.218492 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:24.220248 23072 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:24.222193 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:24.222910 23076 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:24.223301 25018 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:24.192063 24890 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:24.189467 25067 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.180114 25157 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.251417 23079 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:24.250520 25155 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:24.256933 24895 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:24.256693 25141 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:24.258921 25141 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:24.258240 24957 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:24.259888 25117 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.262415 23073 raft_consensus.cc:1240] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:24.280627 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:24.279176 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.263808 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:24.286235 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:24.292524 25118 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:24.295816 23079 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:24.261969 25117 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.264272 25156 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.300091 23074 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:24.298018 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 92724.9us
I20260709 13:09:24.306475 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:24.308465 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:24.314860 23005 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:24.317533 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:24.318064 23654 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:24.322990 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.324338 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:24.324894 23654 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:24.325156 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.293727 23071 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:24.325482 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:24.337456 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.347756 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.388204 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:24.388367 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:24.388357 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:24.224695 24804 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.390002 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:24.390954 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:24.391952 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:24.392235 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:24.394481 23001 raft_consensus.cc:2410] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:09:24.393054 22895 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:24.396562 23074 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:24.401013 22999 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:24.402091 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:24.401573 25167 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:24.404443 25167 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.406756 25167 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.407413 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.389969 23072 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:24.419858 25164 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:09:24.421730 24943 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.422260 25019 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:24.422636 25019 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:24.423014 25019 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.416083 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:24.393112 25011 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:24.424352 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:24.398041 24930 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:24.461122 22999 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:24.479365 23076 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:24.412267 25155 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:24.527220 23006 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:24.529469 25149 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.530649 23074 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:24.532907 25000 consensus_meta.cc:287] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.001s
I20260709 13:09:24.533353 25000 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:24.534372 23080 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:24.550402 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.548259 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:24.548723 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:24.540534 23077 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:24.548641 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:24.569557 23003 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:24.582489 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:24.463728 24930 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:24.536029 25000 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:24.593053 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.593935 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:24.594245 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.596585 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.597352 23657 raft_consensus.cc:2376] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3. Re-sending same reply.
I20260709 13:09:24.548772 25143 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.599514 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:24.602200 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.603904 23657 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:24.548862 25155 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:24.590524 24804 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.608271 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.608539 23652 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:24.595691 24930 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.608882 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.618022 23656 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:24.800993 23074 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:24.608388 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:24.799146 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 1894) took 1225 ms. Trace:
I20260709 13:09:24.825067 23080 rpcz_store.cc:276] 0709 13:09:23.574069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.574291 (+   222us) service_pool.cc:224] Handling call
0709 13:09:23.574653 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.534683 (+960030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.798858 (+264175us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54000898d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:24.799071 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206765440}
I20260709 13:09:24.808136 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 1895) took 1179 ms. Trace:
W20260709 13:09:24.624768 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.826689 23078 rpcz_store.cc:276] 0709 13:09:23.628368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.639688 (+ 11320us) service_pool.cc:224] Handling call
0709 13:09:23.654892 (+ 15204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.149193 (+494301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.807886 (+658693us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400267354. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:24.808073 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131493760}
I20260709 13:09:24.807457 23079 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:24.731307 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.807497 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.609508 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.621421 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:24.864032 23655 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 2: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:24.602880 24943 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:24.634640 25066 consensus_meta.cc:287] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.002s
I20260709 13:09:24.609999 24903 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.605521 25000 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:24.613643 23071 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:24.807901 25160 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:24.873210 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:24.872380 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 131379us
I20260709 13:09:24.609309 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:24.609175 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:24.874658 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:24.797653 24936 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:24.807648 24948 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.989907 24936 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.989969 24948 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.990595 24936 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.807128 25131 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:24.991940 25131 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.992887 24936 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.993942 23074 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:24.994148 25131 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.874379 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:24.995059 23078 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:24.995157 23074 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.624157 25061 raft_consensus.cc:3055] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:24.996217 25061 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:24.997180 25061 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:24.998358 25061 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.858877 24786 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.999924 24786 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.002187 24786 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:24.891332 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:25.003053 23073 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 2: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:25.004287 23073 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:24.609544 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:25.005522 23649 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:25.005769 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:24.893061 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:24.893697 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:25.008141 23656 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 2: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:09:24.903234 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.913079 25072 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.012370 25011 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.012923 25011 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.015180 25011 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:24.913105 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:24.609010 25146 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.016984 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:25.017766 23080 raft_consensus.cc:2376] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2. Re-sending same reply.
I20260709 13:09:25.017457 25146 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:25.018042 25019 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.000s
I20260709 13:09:25.018534 25019 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:24.904016 25156 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.019737 25094 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.020148 25094 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:25.019917 25156 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.020913 25094 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.022451 25156 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:25.022588 25082 consensus_queue.cc:1059] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.023564 25082 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.023892 25082 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:25.024016 23648 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:24.888630 25133 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:24.908751 25162 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:24.608907 25143 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.941143 25066 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.968716 25018 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.945035 24903 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.928025 25121 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.969549 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:24.971869 25149 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:24.974396 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.976460 23657 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:24.956681 25160 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:24.984692 25142 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:24.985992 25155 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:24.988010 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:25.042325 25131 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:24.988884 25166 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:25.024940 23654 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:25.007413 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 114488us
I20260709 13:09:25.065852 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:25.011524 22825 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35510 (request call id 349) took 1943 ms. Trace:
I20260709 13:09:25.026566 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.068744 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.069391 23073 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:24.959836 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:25.027561 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.025995 23656 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:25.031262 25162 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.032344 25143 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.033025 22999 raft_consensus.cc:2410] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:25.033198 24943 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:25.077541 24943 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.052505 25160 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.030483 23622 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:25.026077 23651 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:25.047485 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:25.054454 25146 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.082095 22926 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:25.082588 24948 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.082955 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.048240 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:25.084052 22923 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:25.084259 24903 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.083786 22924 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:25.084765 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.085085 23005 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:25.051012 25121 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.086062 22923 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:25.087293 25121 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.051565 23075 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:25.053893 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:25.055768 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.987927 24930 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.060304 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:25.060355 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 213962us
I20260709 13:09:25.071993 22930 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:25.072348 22925 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.028784 25082 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.071192 23653 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:25.080637 25066 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.051105 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.088328 24786 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.112340 22922 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 2: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:25.058017 25142 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.089023 25162 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.043642 25018 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.089907 24943 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.083510 22926 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:25.061832 25131 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:25.052816 25029 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.092260 25120 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:25.092518 22923 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:25.094511 25156 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:25.094935 25166 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:25.095896 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 136160us
I20260709 13:09:25.097337 25067 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:25.184449 23045 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:25.097412 25019 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.066874 22825 rpcz_store.cc:276] 0709 13:09:23.068557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.068769 (+   212us) service_pool.cc:224] Handling call
0709 13:09:25.011441 (+1942672us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:23.988858 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:23.999423 (+ 10565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:23.999456 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:09:23.999475 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:24.116375 (+116900us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:24.125039 (+  8664us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:24.126921 (+  1882us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:09:24.136223 (+  9302us) tablet.cc:701] Row locks acquired
0709 13:09:24.136244 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:09:24.136386 (+   142us) write_op.cc:270] Start()
0709 13:09:24.136496 (+   110us) write_op.cc:276] Timestamp: P: 1783602564136340 usec, L: 0
0709 13:09:24.136517 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:09:24.143593 (+  7076us) log.cc:844] Serialized 2462 byte log entry
0709 13:09:24.206481 (+ 62888us) op_driver.cc:464] REPLICATION: finished
0709 13:09:24.207868 (+  1387us) write_op.cc:301] APPLY: starting
0709 13:09:24.207942 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:24.208111 (+   169us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:24.208229 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:24.209262 (+  1033us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:24.209441 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:09:24.209502 (+    61us) write_op.cc:312] APPLY: finished
0709 13:09:24.209746 (+   244us) log.cc:844] Serialized 53 byte log entry
0709 13:09:24.210620 (+   874us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:24.210737 (+   117us) write_op.cc:454] Released schema lock
0709 13:09:24.210779 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:24.211136 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:24.211167 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":1151,"apply.run_cpu_time_us":2358,"apply.run_wall_time_us":3235,"num_ops":6,"prepare.queue_time_us":163559,"prepare.run_cpu_time_us":5228,"prepare.run_wall_time_us":171470,"replication_time_us":69801,"thread_start_us":99706,"threads_started":2}]]}
I20260709 13:09:25.132458 25082 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.133258 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.134418 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.136283 24948 consensus_queue.cc:1059] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:25.139333 23654 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:25.108669 24804 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:09:25.223497 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 348442us
I20260709 13:09:25.148550 24890 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:09:25.162993 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.186510 25067 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.164606 25133 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:25.189327 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:09:25.285555 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 96304.2us
I20260709 13:09:25.286509 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:25.189846 25162 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:25.288156 25162 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:25.230791 25131 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.197479 25142 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.198246 25019 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:25.199892 25066 consensus_queue.cc:1059] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:09:25.199225 25120 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:25.191141 24895 consensus_queue.cc:1059] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:25.184916 25029 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.212821 25156 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:25.292992 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 59551.1us
I20260709 13:09:25.158705 22925 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.289158 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:25.339681 25173 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:25.350580 25173 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:25.348804 25156 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.299817 24936 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:09:25.352497 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:25.360713 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 71618.7us
I20260709 13:09:25.331243 24948 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.301578 25162 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:25.364261 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:25.366636 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:25.347846 25131 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.293884 25000 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:25.366832 24825 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:25.351832 25173 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.362975 25011 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:25.376375 25173 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.365185 24948 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:25.303042 25185 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:09:25.437057 25162 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.439165 25029 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.440148 24895 raft_consensus.cc:3055] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:25.444510 23076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.002s	sys 0.030s
W20260709 13:09:25.444864 23076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.002s	sys 0.030s
I20260709 13:09:25.446131 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 1942) took 1151 ms. Trace:
W20260709 13:09:25.446622 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 307725us
I20260709 13:09:25.433315 25019 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:25.434249 24930 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.432873 25066 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:25.444341 24895 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:25.446482 25149 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:25.446729 25018 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.446499 23076 rpcz_store.cc:276] 0709 13:09:24.295218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.522166 (+226948us) service_pool.cc:224] Handling call
0709 13:09:24.522464 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.582737 (+ 60273us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:24.597439 (+ 14702us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.445230 (+847791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.445434 (+   204us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:25.445494 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.445631 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.446057 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33009,"prepare.queue_time_us":21974,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":36,"raft.queue_time_us":273,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2110,"thread_start_us":609610,"threads_started":1}
W20260709 13:09:25.469857 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.470763 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.471479 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.473021 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 442600us
I20260709 13:09:25.473696 23078 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:25.463074 23650 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:25.451679 25019 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:25.479322 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 413500us
W20260709 13:09:25.481895 23652 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.015s	sys 0.022s
W20260709 13:09:25.482179 23652 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.015s	sys 0.022s
I20260709 13:09:25.448451 25120 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.472918 25067 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:25.486933 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 347293us
I20260709 13:09:25.490715 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:25.491602 22926 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:25.453537 24948 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:25.493533 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 344124us
I20260709 13:09:25.492952 22926 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:25.497247 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.497749 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:25.498014 22929 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:25.498271 22925 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.497179 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:25.502525 22972 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:25.500768 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:25.505632 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.506247 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.478682 24895 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.506686 25072 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.500732 25018 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:25.531340 25018 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:25.532002 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.531847 25072 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.533618 25018 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.533736 25072 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.534180 25018 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.501010 24786 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:25.534714 25018 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.534840 24786 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.524788 25019 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.523097 25160 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:25.536772 24786 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.537647 24895 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.537968 25160 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.509747 25188 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:25.538702 25188 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.523707 24948 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.541658 25166 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.539043 25188 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.543124 22925 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:25.525660 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.545894 22931 raft_consensus.cc:2393] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:25.511773 22926 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.548883 22926 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.516651 25142 raft_consensus.cc:3055] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.571974 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:25.555260 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 73874.8us
I20260709 13:09:25.593442 22970 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:25.594919 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:25.596915 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:25.571352 25142 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:25.517560 25184 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:09:25.601022 25160 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.578162 25187 consensus_queue.cc:1059] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:25.615224 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.616012 23077 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:25.599560 24991 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:25.617022 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.621491 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.601173 24903 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.592514 25121 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:09:25.623410 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:25.625418 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.625967 23073 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:25.604068 25160 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.626379 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:25.626961 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.627904 23076 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:25.629151 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.606974 24943 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.631465 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.632289 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.630774 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:25.629204 25173 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:09:25.621999 25166 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.636595 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.642015 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:25.641883 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.647342 23073 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:25.629923 25160 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.629522 25061 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:25.632050 24804 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.654953 22969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.012s
W20260709 13:09:25.691886 22969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.023s	sys 0.016s
W20260709 13:09:25.639947 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 287492us
I20260709 13:09:25.659250 22930 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:25.657555 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.659564 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:25.658658 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.642673 24991 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:25.641662 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.713533 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.714690 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 681) took 1103 ms. Trace:
I20260709 13:09:25.703639 25061 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.721939 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:25.630149 25196 consensus_queue.cc:1059] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:09:25.656983 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:25.721480 23655 rpcz_store.cc:276] 0709 13:09:24.611276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.016232 (+404956us) service_pool.cc:224] Handling call
0709 13:09:25.016536 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.016758 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:25.476269 (+459511us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.714281 (+238012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.714347 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:25.714405 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.714488 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.714623 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2551,"prepare.queue_time_us":465529,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"thread_start_us":694199,"threads_started":2}
I20260709 13:09:25.728034 25121 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.688684 24890 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.735066 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 232322us
I20260709 13:09:25.735265 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:25.640599 24943 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.704082 25143 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:25.650063 25166 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.747171 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:09:25.754674 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 62094.1us
I20260709 13:09:25.713275 25133 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:25.751951 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 153353us
I20260709 13:09:25.705009 25198 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:25.723800 25018 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:25.698467 24804 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.725504 25094 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.759373 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.759881 22895 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:25.756799 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.760324 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.763376 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:25.654982 25193 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:09:25.745903 25162 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:25.773368 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 103824us
I20260709 13:09:25.749893 25155 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.773931 23079 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:25.785797 22971 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:25.762425 25173 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:25.797436 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.803465 23006 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:25.725169 24991 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.799695 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.805943 22999 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.806146 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.771384 24936 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:25.775561 25019 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.750435 25121 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.770381 25011 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:25.827837 25199 raft_consensus.cc:3055] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:25.770260 25061 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.828279 25199 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:25.829205 25199 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.829733 25000 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:25.830279 25000 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.830649 25199 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.830739 22998 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:25.832197 25194 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:09:25.832986 23005 raft_consensus.cc:1240] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:25.795487 25162 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.834059 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.835041 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.821240 24903 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:25.836017 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.836735 23006 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:25.837704 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:25.766124 25205 consensus_queue.cc:1059] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:09:25.839458 25205 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:25.752568 24890 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.839857 25205 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:25.840041 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.840763 25205 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.841912 24890 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.842314 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.842692 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.843147 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.834978 25142 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.844923 25142 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.818568 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.770680 25198 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.849385 23001 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:25.826115 24991 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.850513 25198 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.826584 24943 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:25.828297 25011 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.851636 24943 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:25.852598 22926 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:25.853569 25011 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.784036 25029 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:09:25.854133 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.834941 25162 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:25.858651 25181 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.723s	user 0.006s	sys 0.007s
I20260709 13:09:25.859985 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1596) took 1475 ms. Trace:
I20260709 13:09:25.859370 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:25.860728 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:25.860388 22997 rpcz_store.cc:276] 0709 13:09:24.384910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.385200 (+   290us) service_pool.cc:224] Handling call
0709 13:09:24.395572 (+ 10372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.430149 (+ 34577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.430177 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.599005 (+168828us) log.cc:844] Serialized 564 byte log entry
0709 13:09:24.930606 (+331601us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.930671 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.931065 (+   394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.857956 (+926891us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:25.859706 (+  1750us) raft_consensus.cc:1685] finished
0709 13:09:25.859726 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.859928 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26085120,"thread_start_us":325701,"threads_started":1,"wal-append.queue_time_us":533749}
I20260709 13:09:25.862977 22997 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.773552 25143 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.852988 22926 pending_rounds.cc:85] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 6
W20260709 13:09:25.822818 25195 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:25.870100 23005 raft_consensus.cc:1240] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:25.786916 25082 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:25.847152 22829 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 3 to 4, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:25.879020 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 132001us
W20260709 13:09:25.876262 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 90498.8us
I20260709 13:09:25.880873 23006 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:25.866842 22926 pending_rounds.cc:107] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:25.885020 22926 raft_consensus.cc:2889] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.881110 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:25.873678 25189 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:09:25.887907 22997 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:25.805621 25187 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:25.878140 25011 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.897014 23649 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:25.896900 25187 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:25.897027 25011 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:25.899298 25187 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.820519 25019 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.883249 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:25.899823 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.888584 22829 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.901540 22971 leader_election.cc:400] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6.
I20260709 13:09:25.877153 25162 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.878182 25209 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.925611 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.818517 25173 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:25.914507 22971 leader_election.cc:403] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.909293 23005 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:25.910547 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.916795 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.917745 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:25.921594 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:25.926467 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.934995 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.896476 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 137038us
I20260709 13:09:25.885236 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 545) took 1281 ms. Trace:
I20260709 13:09:25.911266 25019 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.932614 22926 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
W20260709 13:09:25.935889 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 148975us
I20260709 13:09:25.952693 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:25.910672 25193 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.982385 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.916381 22829 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), now has a pending config: VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194), VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195), VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:25.982992 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.983839 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:25.954788 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:25.983088 23006 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:25.986824 22829 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.928576 24895 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:25.925982 25209 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:25.994168 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:25.997340 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:25.929452 25162 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:26.008140 23006 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.991055 25121 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:25.989095 22829 catalog_manager.cc:5697] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.931519 25000 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:26.018481 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 82160.7us
W20260709 13:09:26.019404 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.010620 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:25.992223 25149 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.020345 23005 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:26.022588 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 113184us
I20260709 13:09:26.029667 25143 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:25.998958 25187 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:26.030813 25208 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:09:26.033605 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:26.030205 25206 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:09:26.000649 25184 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6.
I20260709 13:09:26.002653 24895 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.003311 25224 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:26.033926 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:26.197667 25204 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 13:09:26.228377 25224 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.229971 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.230757 23075 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:26.073035 23079 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:26.162443 23006 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:26.083036 23655 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:26.018509 22829 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 5, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 5 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.230636 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:26.243798 22829 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 4, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.045735 23000 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
W20260709 13:09:26.072456 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 190479us
I20260709 13:09:26.245679 22829 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 5 to 6, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 6 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.240763 23078 raft_consensus.cc:2393] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:26.128175 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 152742us
I20260709 13:09:26.002591 25011 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:26.272212 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.272936 23000 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:26.276656 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.277371 23657 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:26.263295 22829 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:09:26.186635 23005 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:26.274618 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:26.197526 25217 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 13:09:26.027518 25189 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:26.280598 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.284250 23005 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:26.285738 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:26.288407 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.005730 25221 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:26.288796 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.293277 23654 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:26.293474 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.294526 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.294806 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:26.169276 24804 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:26.290997 25188 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.000s
I20260709 13:09:26.005506 25215 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:26.291997 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.027253 25149 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.016515 25211 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.071815 25121 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:26.123374 25173 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.115510 25209 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.199081 25162 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:26.298326 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.298954 23653 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:26.298324 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.300595 25226 consensus_queue.cc:1059] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:26.203713 25230 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 13:09:26.304402 25019 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.376706 25188 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:26.423007 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.424062 25019 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.305807 22998 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:26.307471 23651 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:26.424499 25188 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.307797 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:26.309845 25160 consensus_meta.cc:287] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:09:26.315623 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.426167 23654 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:26.426410 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.288249 24973 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:26.280804 25066 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.938148 23652 rpcz_store.cc:276] 0709 13:09:24.602946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.944558 (+341612us) service_pool.cc:224] Handling call
0709 13:09:24.970573 (+ 26015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.970839 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:25.482463 (+511624us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.789682 (+307219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.802265 (+ 12583us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:25.805709 (+  3444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.818213 (+ 12504us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.883870 (+ 65657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16543,"prepare.queue_time_us":511152,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":60365,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3013,"spinlock_wait_cycles":30464,"thread_start_us":794394,"threads_started":3,"wal-append.queue_time_us":280023}
W20260709 13:09:26.325908 25094 consensus_meta.cc:287] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.000s
I20260709 13:09:26.271368 25187 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:26.412400 25121 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:26.412240 25205 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.328954 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 552) took 1718 ms. Trace:
I20260709 13:09:26.329852 25199 consensus_queue.cc:1059] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:26.331630 25225 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:26.332403 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.333279 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.333832 25212 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:26.334122 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:26.335636 25224 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.335781 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.336534 25232 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.336843 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.337157 25133 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.340301 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.439314 23655 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
W20260709 13:09:26.342715 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 48565.1us
I20260709 13:09:26.344579 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:26.429370 23648 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:26.001256 25193 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.352643 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.357614 25201 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.359917 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.361989 23001 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:26.198665 25227 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:26.169873 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.368922 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.337483 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.459686 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:26.364781 25219 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:26.383590 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:26.462406 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 78916.5us
I20260709 13:09:26.463502 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.464993 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.336737 25166 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:26.198043 25229 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 13:09:26.411557 23005 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:26.369666 25215 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.378106 25149 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.415028 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.473544 22999 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:26.415920 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.418329 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.409431 25159 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.409652 25000 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.318598 25200 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.497s	user 0.000s	sys 0.002s
I20260709 13:09:26.426798 22970 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:26.461917 25219 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:26.444909 25133 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.429586 23003 raft_consensus.cc:2368] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:26.410633 25067 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:26.427505 24973 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:26.425444 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.461580 25201 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.430721 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.495981 23654 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:26.432103 22922 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:26.328544 24895 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.437075 23006 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:26.432353 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.289314 25143 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.378213 25221 consensus_queue.cc:1059] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:09:26.509589 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.510169 23654 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:26.444540 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.454524 22925 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:26.457016 25019 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:26.459802 22926 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
W20260709 13:09:26.372921 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.460391 23655 raft_consensus.cc:2376] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3. Re-sending same reply.
I20260709 13:09:26.429242 25160 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.514250 25143 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:26.519197 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.519385 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:26.520062 23001 raft_consensus.cc:2376] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6. Re-sending same reply.
I20260709 13:09:26.520347 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:26.520975 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.521540 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.467407 23045 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:26.522359 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 55073.7us
I20260709 13:09:26.523136 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.387239 25211 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.524478 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.525096 22999 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:26.525283 25211 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.525861 24895 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.527150 25133 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.527767 25133 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:26.528031 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.528682 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.528756 23648 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:26.529378 23654 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
W20260709 13:09:26.505827 25235 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 13:09:26.529912 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.530230 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.531059 23654 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:26.531219 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.470942 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.539209 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.476668 22930 raft_consensus.cc:2368] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6.
I20260709 13:09:26.465570 25199 raft_consensus.cc:3055] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:26.454651 25131 consensus_queue.cc:1059] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:09:26.438859 25225 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.428422 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:26.489269 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 62544.6us
I20260709 13:09:26.550034 22970 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.557665 24895 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:26.558178 24895 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:26.560153 24895 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:26.455312 25202 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:09:26.468465 25011 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:26.564065 25011 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:26.564540 25011 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.566288 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:26.455099 25094 consensus_queue.cc:1059] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:09:26.469276 24957 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.433156 23649 rpcz_store.cc:276] 0709 13:09:24.610444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.006356 (+395912us) service_pool.cc:224] Handling call
0709 13:09:25.876452 (+870096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.897524 (+ 21072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.328654 (+431130us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b5400910350. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:26.328848 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1994143616}
I20260709 13:09:26.472916 25166 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.466521 23071 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:26.437867 25212 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.473026 25215 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.507486 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:26.443500 25232 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.475457 24786 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:26.505640 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.431030 25066 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.516055 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.515679 25209 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.516736 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.517289 25221 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.521548 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.536631 23621 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.537192 25120 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.537968 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:26.620764 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 176560us
I20260709 13:09:26.624655 25120 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.463856 23656 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:26.523245 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.626951 25120 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:26.627496 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 104343us
I20260709 13:09:26.629355 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:26.629056 23649 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:26.461835 25227 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.546415 23000 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:26.632879 23000 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:26.633343 25227 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:26.633955 25162 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:26.634204 23000 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:26.634666 25162 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:26.635141 25162 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:26.500876 24973 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.635967 23654 raft_consensus.cc:2393] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:26.636101 25162 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.637324 23651 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:26.638199 25212 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.638688 23651 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:26.639930 25066 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.640750 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:26.641435 25242 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:26.641856 25242 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.642108 25066 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.475798 25224 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:26.643093 25224 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.527865 25193 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:26.540733 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 130542us
I20260709 13:09:26.538502 25234 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:26.644358 25234 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:26.644685 25225 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.568040 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.645026 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.645516 23006 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:26.645195 25234 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.491719 25000 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.646255 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.646446 25234 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.547257 23653 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:26.541373 25199 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:26.645206 25224 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:26.573848 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 184070us
W20260709 13:09:26.609401 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 152185us
I20260709 13:09:26.569326 24957 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:26.764564 24957 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.597973 24786 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.767877 25234 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.768134 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.768401 25234 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.769447 24786 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:26.572885 25166 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:26.770234 25166 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.770385 25234 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.771076 23654 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:26.548695 23648 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:26.615476 22999 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.772234 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:26.619505 23005 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:26.772899 24957 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.773604 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.584125 25202 raft_consensus.cc:3055] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:26.619524 25221 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:26.623296 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 55953.2us
I20260709 13:09:26.623593 25230 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:26.777705 25230 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:26.778136 25230 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.614389 25243 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.617228 25133 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:26.621382 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 84831.4us
I20260709 13:09:26.778410 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:26.780334 23078 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.780454 23621 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:26.642189 25242 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.491292 25159 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.588254 25211 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:26.482223 25121 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.647965 25187 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.672021 25143 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:26.712604 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 71808.7us
W20260709 13:09:26.717741 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 92160.3us
I20260709 13:09:26.738929 25000 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.710940 25212 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.590664 25239 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:26.740586 23657 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:26.740937 23651 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:26.781335 25133 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:26.743892 23002 raft_consensus.cc:2410] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:26.818434 25239 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.819780 25133 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.821072 25133 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.743943 22998 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:26.744953 25201 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.744660 25199 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.583420 25219 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.822170 25211 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.822872 25219 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.781988 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:26.824294 25211 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.824795 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.825058 25211 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:26.825587 25224 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.825992 25224 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.826366 25224 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.745362 25198 raft_consensus.cc:3055] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:26.827265 25230 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.827899 25198 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:26.774920 25202 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:26.830147 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:26.803974 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.830641 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.832543 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.742767 24973 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.747143 25232 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.743793 25213 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:26.740984 23004 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:26.751492 23000 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:26.751739 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:26.754031 25160 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:26.756681 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 110502us
I20260709 13:09:26.843838 22972 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.757372 25011 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.760665 25149 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:26.851318 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:26.592743 25226 raft_consensus.cc:3055] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:26.773864 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.774770 23071 raft_consensus.cc:2410] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:26.776367 23652 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:26.776532 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.778932 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.781627 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.782694 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.817572 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.775099 25221 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.782344 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:26.831395 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 52395.9us
I20260709 13:09:26.802891 23078 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:26.745841 25215 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:26.876474 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.876714 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.877379 22931 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:26.877811 22997 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.834369 25241 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:26.841107 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.882427 23073 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:26.850728 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.839416 25159 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.850914 22972 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:26.852600 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 78828us
I20260709 13:09:26.853664 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:26.791832 24786 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.834205 24957 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.839828 24973 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.874253 25011 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.860469 25143 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.865392 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.866411 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.860558 24825 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:26.863843 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.864125 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.871083 23650 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:26.846218 25166 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.880381 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.842216 25209 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.852496 25201 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.881502 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.917096 22931 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:26.884013 23077 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:26.885025 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.918159 25188 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.885804 23046 leader_election.cc:400] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6.
I20260709 13:09:26.919080 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.919389 23046 leader_election.cc:403] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:26.920080 25166 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:26.920166 22971 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.852917 25226 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:26.920758 25166 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.921361 25226 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.922012 23046 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:26.922539 25226 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.922474 25256 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.923213 25256 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.836462 23621 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:26.928247 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 91841.3us
I20260709 13:09:26.929131 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:26.929255 23046 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:26.851357 25162 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:26.897517 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:26.898872 23079 raft_consensus.cc:2410] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:26.890182 25159 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:26.939424 25187 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.939643 25159 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:26.939824 25187 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.940199 25187 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.940647 25159 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.908445 23075 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:26.911285 23072 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:26.944805 25209 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.896016 25143 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.945668 25143 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.953220 25149 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:26.914435 25199 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.972276 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.972208 22825 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.974469 22825 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.842042 25000 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:26.930471 23080 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:26.899291 25142 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.981600 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:26.932225 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 78627.3us
I20260709 13:09:26.933851 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:26.934329 24957 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.985944 24957 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.986366 24957 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.987042 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:26.936012 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:26.890862 24786 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:26.996013 25261 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.996779 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 179298us
I20260709 13:09:26.997648 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:26.938194 23071 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 1.
I20260709 13:09:26.938968 25255 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.956751 25219 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:27.000458 25094 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.001652 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.002918 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.004051 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.967032 23006 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:27.005626 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:26.964401 25239 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:26.930572 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:26.979429 23076 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.982168 22922 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.983016 25227 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:26.980147 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 104155us
I20260709 13:09:26.984361 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:26.984536 23620 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:26.989404 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.990275 23074 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.968998 24973 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:26.898187 24825 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:27.004207 22896 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.965436 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:26.990403 23080 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:27.010097 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.011283 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:27.013685 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 83209.3us
I20260709 13:09:26.978436 25121 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:27.015787 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.016662 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.054090 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.054289 22997 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:27.018939 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:26.980547 25000 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:27.014762 25094 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.981154 25142 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.054158 23001 raft_consensus.cc:2393] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:27.020527 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.061297 22927 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 2: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:27.055567 23005 raft_consensus.cc:2393] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:26.996549 25211 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.053580 22971 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.057564 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.052699 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:26.996265 24786 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.064867 23002 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:27.059274 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:27.066973 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.069104 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 59107.7us
W20260709 13:09:27.073246 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 54371.5us
I20260709 13:09:27.074410 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:27.074576 24804 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:27.074666 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:27.076074 24804 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.076435 24804 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:27.076809 24804 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.989279 25232 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:09:27.053325 25213 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.022657 25197 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:27.052162 25011 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.057101 24825 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.081350 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:27.059779 25227 consensus_queue.cc:1243] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:27.059646 25000 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.020918 25149 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:27.085816 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.108091 23006 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:27.001196 25261 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.060102 25239 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:27.089102 22825 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.090013 22922 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:27.059969 25094 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:27.076999 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 59443us
I20260709 13:09:27.062674 25211 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.063302 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.007972 25193 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:09:27.063639 25142 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.071455 25255 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:27.077610 25066 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:27.088449 24957 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.080267 25219 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:27.096863 25213 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.082806 25121 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.112161 23621 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.101142 25067 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:09:27.151330 25211 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.120518 25232 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.122063 25221 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.112814 25197 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.125360 25246 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.125820 25266 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.113023 25149 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.181002 25213 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.131963 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:27.225181 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 93299.4us
I20260709 13:09:27.131847 25120 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:27.136036 25159 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:27.140990 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.145541 23075 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:27.146991 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.102375 25225 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.980705 25202 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:27.149417 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.150354 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 146209us
I20260709 13:09:27.130939 25224 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.088019 24973 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.102155 25011 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:27.182134 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 70078.8us
I20260709 13:09:27.114791 25261 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:27.184672 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 85102.2us
I20260709 13:09:27.235839 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.155107 25155 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.151175 25094 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.155283 25255 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:27.160493 25201 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.219102 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:27.128118 24786 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:27.203305 23072 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.228219 23003 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:27.229236 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 82340.4us
I20260709 13:09:27.230093 23078 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:27.231107 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.202101 25232 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.229867 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.236720 25159 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.256875 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.235550 24973 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.235972 25243 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:27.235846 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:27.219784 25227 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.098438 23650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "492dd607be6348c79999243a8383806d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:27.242388 25166 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6.
I20260709 13:09:27.244647 25155 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.247948 24786 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:27.270699 24786 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:27.271091 24786 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.272342 25256 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.272468 25155 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.272931 23650 raft_consensus.cc:606] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.272495 25143 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.248971 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.242743 25209 consensus_queue.cc:1059] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:09:27.248478 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:27.249585 25264 log.cc:927] Time spent T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:09:27.186102 24895 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:09:27.257218 25232 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.253774 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.233979 25219 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.298270 25187 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.232402 25225 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.299203 25225 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.302115 24804 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.255108 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.241153 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.281661 25011 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.304723 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.187932 25121 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.305172 24957 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.305593 25143 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.307322 24948 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:27.308115 24948 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:27.308404 24948 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:27.278158 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.309227 25142 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.309377 24948 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.310446 24948 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:27.264430 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.249881 25255 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.224501 25149 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:27.242491 25131 consensus_queue.cc:1175] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b655449a388a41e3a606c6ea794825ad" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:09:27.273324 23650 raft_consensus.cc:614] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:27.251333 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.316471 25197 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.318147 22929 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:27.319077 22926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49884
I20260709 13:09:27.320668 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.321190 22928 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:27.321396 22929 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:27.322135 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.322763 22927 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:27.323683 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.323875 25255 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.254805 25261 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:27.324604 25229 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.324926 25261 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:27.242560 25267 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:27.326153 23657 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:27.325868 25261 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.326584 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.280128 25273 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:27.328089 25273 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:27.328519 25273 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.328819 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.328480 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.222193 25246 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.282634 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 468) took 1247 ms. Trace:
I20260709 13:09:27.282920 24786 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.290427 25275 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:27.290592 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.291226 24825 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.292371 25221 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.294132 25000 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.308429 23653 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.269753 23078 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:27.325001 25229 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:27.247000 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.330722 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.281661 25159 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.331435 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:27.349761 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 113987us
I20260709 13:09:27.332211 23657 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:27.332270 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.327965 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.335630 23003 rpcz_store.cc:276] 0709 13:09:26.035080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.625086 (+590006us) service_pool.cc:224] Handling call
0709 13:09:26.625377 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.254920 (+629543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.282423 (+ 27503us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54003e7e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:27.282580 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385981696}
I20260709 13:09:27.337756 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.352890 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.341549 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:27.343925 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 53402.5us
I20260709 13:09:27.344717 23076 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:27.320694 25242 consensus_meta.cc:287] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.000s
I20260709 13:09:27.362870 23075 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:27.365200 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.363670 22928 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:27.343034 25246 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.367121 23005 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:27.338201 25227 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:27.372864 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.371881 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.373957 23001 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:27.371783 23073 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:27.374583 23657 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:27.346230 25275 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.348905 25267 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.386809 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.387692 22930 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.371838 25159 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.378274 25268 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.389139 25225 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.384347 25275 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.385638 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.383605 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.385751 25142 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.388108 24804 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.452579 23654 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:27.375584 25242 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.384032 25246 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:09:27.456671 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 67804.9us
I20260709 13:09:27.457810 22896 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.396101 23071 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:27.459491 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.385161 25094 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:27.461542 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 456164us
I20260709 13:09:27.462288 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.463506 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:27.391558 25197 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:09:27.467825 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.399053 25159 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.433792 24825 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.451700 25215 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.475451 22931 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:27.463980 25019 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.459251 25011 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.485500 25011 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.487135 25000 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.457226 25229 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.488727 25229 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.462736 25187 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.480484 25269 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:27.485098 25159 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.421070 25267 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:27.473727 23004 raft_consensus.cc:2368] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5.
I20260709 13:09:27.462214 25234 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.489216 25225 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.468041 25133 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.513490 25133 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:27.513995 25133 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:27.514843 25277 log.cc:927] Time spent T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:27.515102 23653 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:27.516753 23653 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:27.501679 25232 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.502156 25149 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.484284 24786 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.467406 25221 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:27.505641 23656 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:27.503736 25211 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.470126 24804 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:27.472544 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 683) took 1191 ms. Trace:
I20260709 13:09:27.473822 25142 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:27.521093 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.490360 25143 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.520131 25197 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:27.533401 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.467262 25283 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:27.524482 25232 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.546124 23002 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 2: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:27.537353 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.538668 25242 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.538734 25211 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.530716 23649 rpcz_store.cc:276] 0709 13:09:26.277057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.628447 (+351390us) service_pool.cc:224] Handling call
0709 13:09:26.628721 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.628940 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:27.105587 (+476647us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.457371 (+351784us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.460836 (+  3465us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:27.460914 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.461017 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.468836 (+  7819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10856,"raft.queue_time_us":87902,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":25001,"thread_start_us":294688,"threads_started":2,"wal-append.queue_time_us":287877}
I20260709 13:09:27.519685 25011 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.616276 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.616959 23077 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.553682 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.617753 22928 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.558835 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.561610 25149 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.562566 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.564356 25121 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.545097 25143 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.566833 25094 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.630400 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.568651 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.507128 24973 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.570943 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.570991 25162 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:27.571798 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.571941 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.633976 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.572606 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.579459 25198 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.556699 25197 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.582793 25255 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.553434 24804 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:27.556435 25273 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.597851 25239 raft_consensus.cc:3055] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.598488 25133 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.600425 25224 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:27.600951 25219 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.601320 23004 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:27.652854 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.653703 23004 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:27.654875 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.604530 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.656208 23005 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:27.657147 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.657377 22928 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:27.658066 23005 raft_consensus.cc:2393] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:27.658437 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.658624 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:27.608619 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.609731 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.612757 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.612908 22895 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:27.614148 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.659950 25255 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:27.660146 22922 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:27.660472 25255 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:27.660509 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.660998 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.661298 22925 raft_consensus.cc:2393] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:27.661584 25278 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.378s	user 0.002s	sys 0.000s
I20260709 13:09:27.661478 25255 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.615046 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:27.664158 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49203.5us
I20260709 13:09:27.665869 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:27.666481 25273 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.666697 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:27.626609 22930 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:27.667058 25273 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:27.659979 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47143.9us
I20260709 13:09:27.629251 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.669692 23077 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:27.671126 25202 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.671815 22927 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:27.567262 25230 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.631093 23002 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:27.673007 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.508237 25213 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.627971 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.674247 22999 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:27.674646 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 46755.8us
I20260709 13:09:27.674995 25213 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.630419 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:27.636046 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 293000us
I20260709 13:09:27.637970 23076 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.639457 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.640542 23079 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:27.699049 22999 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:27.640947 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.699744 23074 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.643564 23006 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:27.632907 25221 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.629449 25266 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:09:27.638765 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.640504 25162 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.659478 22929 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.659366 22924 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:27.666002 25011 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.627358 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.634496 22923 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:27.675855 23080 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.659004 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.686240 24973 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.686285 25224 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:27.688109 25133 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.689004 25211 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:27.714897 24973 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.690441 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.715867 25149 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:27.716264 25149 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:27.716791 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.717391 23654 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.717116 25149 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.718374 25149 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.719168 22926 raft_consensus.cc:606] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:09:27.719559 22926 raft_consensus.cc:614] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:27.690711 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.691239 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.722136 23656 raft_consensus.cc:2376] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4. Re-sending same reply.
I20260709 13:09:27.722046 23649 raft_consensus.cc:2376] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5. Re-sending same reply.
I20260709 13:09:27.708200 25173 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:27.723198 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.723989 25160 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.724444 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.691821 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.727181 25131 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:27.727538 23653 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 2: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:27.727612 25131 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:27.724484 25160 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.691407 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.691988 25230 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:27.728646 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.736662 23656 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:27.696497 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:27.636646 23072 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.642588 25239 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:27.697314 22922 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:27.641310 25242 consensus_queue.cc:1059] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:09:27.643043 25188 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:09:27.677016 24804 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.704288 22895 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:27.706801 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.706890 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.707939 23075 raft_consensus.cc:2393] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.710589 22997 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:27.696024 25269 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:27.709299 23655 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:27.713886 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:27.714110 24948 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:09:27.721472 25268 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:27.708156 25221 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:27.767139 25239 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:27.755347 25272 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.475s	user 0.000s	sys 0.003s
I20260709 13:09:27.768524 25239 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.769635 25221 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.773043 25225 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:27.773492 25225 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:27.774473 25225 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.723261 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.728641 25131 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.692646 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:27.751394 24895 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:27.734028 25230 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:27.800966 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.801489 22896 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.800966 22971 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:27.659009 22928 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
W20260709 13:09:27.733105 25292 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.196s	user 0.002s	sys 0.000s
I20260709 13:09:27.741904 23653 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:27.743748 22929 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:27.747007 23654 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:27.703755 25273 raft_consensus.cc:697] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:27.748766 22999 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:09:27.752374 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48183.3us
W20260709 13:09:27.760126 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53355.8us
I20260709 13:09:27.813772 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.814561 23654 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:27.754084 25269 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.759249 25202 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:27.766884 25213 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.756906 23622 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.730178 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:27.781154 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 88587.7us
W20260709 13:09:27.822309 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 65494.9us
I20260709 13:09:27.823366 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:27.789830 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 76022.4us
I20260709 13:09:27.823968 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.825693 22927 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.825590 23622 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.781366 23002 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:27.786597 25242 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:27.787858 25143 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.796185 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.788302 25160 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.789250 25197 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:27.749737 25261 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:27.818521 25268 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:27.809685 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:27.810545 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 62580.4us
W20260709 13:09:27.848923 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.810747 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:27.816828 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.816433 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.847985 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.852210 22925 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:27.818720 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.827018 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.821933 25133 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:27.779259 24948 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:27.852265 22999 raft_consensus.cc:2376] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3. Re-sending same reply.
I20260709 13:09:27.855010 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.828540 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.786526 25011 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:27.835083 25120 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:27.833253 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.832743 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.823976 22972 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.809291 25230 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.832859 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.819518 25202 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.841684 25242 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:27.840492 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:27.811223 25173 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:27.841425 23073 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:27.836572 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:27.837239 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.876783 23075 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:27.781211 25162 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:27.842929 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.809376 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.877864 23654 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.809026 25224 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:27.811523 25142 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:27.775929 25211 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:09:27.851332 25261 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:27.833796 25232 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:27.918435 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.918865 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.919648 23006 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:27.920526 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.921203 23006 raft_consensus.cc:2368] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:27.853408 22896 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:27.922247 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68954.9us
I20260709 13:09:27.853590 22930 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:27.776908 25131 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.924638 25225 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.782609 25275 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.851970 23074 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:27.835346 25234 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:27.857070 23622 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.855690 22927 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:27.869897 25229 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.872931 25202 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.840281 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.868134 22924 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.820685 25266 consensus_queue.cc:1059] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:09:27.870123 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.873180 23046 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:27.872493 25143 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.881114 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.944901 22928 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
W20260709 13:09:27.945466 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 88514.6us
I20260709 13:09:27.884532 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:27.948262 22925 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:27.871951 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.874752 24804 consensus_queue.cc:1059] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:09:27.897886 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.855355 24948 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:27.854341 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:27.901171 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:27.963150 22922 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.904727 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.871759 25219 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:27.818951 25269 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.861620 25209 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.854264 25268 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:27.977463 25268 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.916512 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.979991 23001 raft_consensus.cc:2376] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2. Re-sending same reply.
I20260709 13:09:27.875542 25173 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.918172 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.918293 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.928049 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.984969 23655 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:27.985076 23005 raft_consensus.cc:2376] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2. Re-sending same reply.
I20260709 13:09:27.928761 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.960047 25215 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.866140 23621 leader_election.cc:400] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5.
I20260709 13:09:27.937332 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:28.029791 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:28.030318 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:28.031061 23000 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:28.027302 25230 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.033020 23000 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:27.938581 23652 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:27.861006 25291 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.036039 25291 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:28.037043 25291 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.041635 22825 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.044516 22825 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 6, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 6 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.045238 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:28.046048 23652 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:28.046886 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:27.943614 23649 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:28.048533 23649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:28.049147 23649 raft_consensus.cc:606] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:28.049520 23649 raft_consensus.cc:614] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:28.050602 23649 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.054316 25198 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.946965 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:28.056175 22999 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:27.948837 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:28.057367 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 108630us
I20260709 13:09:28.058293 25211 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:28.058579 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 203942us
I20260709 13:09:28.058691 23622 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:27.890323 23076 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
W20260709 13:09:27.951267 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 78212.7us
I20260709 13:09:28.063040 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:28.064575 22829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35496 (request call id 373) took 3087 ms. Trace:
I20260709 13:09:28.066123 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:28.068686 25219 consensus_queue.cc:1059] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:28.069665 25219 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:28.070032 25219 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:28.070834 25219 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:27.952077 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 82068.7us
I20260709 13:09:28.073132 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:27.952983 23657 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:27.956772 23654 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:27.950977 22972 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:28.074633 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 123739us
I20260709 13:09:28.075146 23654 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:27.884877 24973 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:28.075747 24973 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.076170 24973 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.961581 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:27.934990 25094 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.089243 23654 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:27.933966 25142 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:27.967941 23648 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:27.974172 23071 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:27.974738 24948 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:27.950739 25283 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:27.927361 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:28.000314 23651 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:28.001470 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:28.108139 23655 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:28.108604 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.002691 25261 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.003893 25242 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.005452 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:28.006877 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:27.971099 25209 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.012645 23072 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:27.889415 25273 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.014190 25173 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:28.016250 25274 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.725s	user 0.003s	sys 0.000s
W20260709 13:09:28.016983 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 166042us
I20260709 13:09:28.112249 25149 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:28.175639 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:27.915980 25224 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.020119 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:28.022363 25160 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.962532 25011 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.025206 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:28.026499 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:28.027783 25243 raft_consensus.cc:3055] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.030915 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:27.938086 25275 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:28.059978 23621 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.073877 25256 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.084653 23080 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:28.077988 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.098899 22922 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:28.065035 22829 rpcz_store.cc:276] 0709 13:09:24.974667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.974991 (+   324us) service_pool.cc:224] Handling call
0709 13:09:28.061827 (+3086836us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:26.533616 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:26.534250 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:26.534285 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:09:26.534299 (+    14us) tablet.cc:662] Decoding operations
0709 13:09:26.535299 (+  1000us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:26.535358 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:26.535395 (+    37us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:09:26.640003 (+104608us) tablet.cc:701] Row locks acquired
0709 13:09:26.640020 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:09:26.640154 (+   134us) write_op.cc:270] Start()
0709 13:09:26.640273 (+   119us) write_op.cc:276] Timestamp: P: 1783602566640111 usec, L: 0
0709 13:09:26.640298 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:26.640879 (+   581us) log.cc:844] Serialized 3993 byte log entry
0709 13:09:26.760341 (+119462us) op_driver.cc:464] REPLICATION: finished
0709 13:09:26.884224 (+123883us) write_op.cc:301] APPLY: starting
0709 13:09:26.889058 (+  4834us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:26.910188 (+ 21130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:26.910305 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:26.911358 (+  1053us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:26.911588 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:09:26.911635 (+    47us) write_op.cc:312] APPLY: finished
0709 13:09:26.911913 (+   278us) log.cc:844] Serialized 71 byte log entry
0709 13:09:26.912068 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.912173 (+   105us) write_op.cc:454] Released schema lock
0709 13:09:26.912222 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:26.912578 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.912604 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11856,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":99496,"apply.run_cpu_time_us":2880,"apply.run_wall_time_us":31752,"num_ops":9,"prepare.queue_time_us":233174,"prepare.run_cpu_time_us":11377,"prepare.run_wall_time_us":204603,"raft.queue_time_us":9343,"raft.run_cpu_time_us":2517,"raft.run_wall_time_us":81902,"replication_time_us":119878,"thread_start_us":319926,"threads_started":4,"wal-append.queue_time_us":107668,"wal-append.run_cpu_time_us":3359,"wal-append.run_wall_time_us":1171069}]]}
W20260709 13:09:28.204119 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 126474us
I20260709 13:09:28.205092 22930 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:28.205240 22971 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.106266 23075 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:28.107376 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 180091us
I20260709 13:09:28.207974 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:28.047465 23652 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:28.088752 25215 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:28.186286 25162 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:28.100767 25229 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.099769 25239 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.139312 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 63874.8us
I20260709 13:09:28.113101 23649 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:28.120254 25219 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.116942 24804 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:28.181519 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.183467 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.159224 25209 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.206630 23046 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:28.106326 22929 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.210963 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.186208 25160 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:28.192806 25243 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:28.230588 23655 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:28.204290 25011 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:28.216122 25143 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.212355 25215 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.273407 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 90069.2us
I20260709 13:09:28.216471 25256 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.225234 23648 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:28.276588 25011 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.269049 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:28.225423 25188 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.279112 23656 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:28.275385 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.238936 24804 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.284597 22896 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.288345 22896 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:09:28.248027 25019 consensus_queue.cc:1175] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b655449a388a41e3a606c6ea794825ad" responder_term: 2 status { last_received { term: 2 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 2 index: 4 } }
I20260709 13:09:28.298318 22896 leader_election.cc:400] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:28.233517 25239 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.257378 25166 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:28.275498 25255 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.209784 25142 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.286448 25226 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:28.282814 25067 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.314620 25131 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.280198 24895 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:09:28.332861 25160 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.333693 25243 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.334018 24973 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:28.278736 25215 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.278041 25162 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.280236 25188 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.283982 25230 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:28.281481 25143 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:28.289757 24804 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.323511 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:28.400046 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 76628us
I20260709 13:09:28.401027 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.293821 25256 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:28.416503 25256 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.255782 25094 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:09:28.242946 25202 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.339156 25166 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:28.420403 22931 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:28.420557 25166 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.421346 25202 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:28.358247 25226 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.352793 25255 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.406980 22926 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:28.398731 25131 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:28.408753 25160 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.409214 23004 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:28.384443 25224 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:28.399015 25188 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:28.412567 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 352659us
I20260709 13:09:28.435110 23621 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:28.436642 22896 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.437965 22896 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.412189 25143 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.413280 25275 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.383872 25197 consensus_queue.cc:1059] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:09:28.393313 25266 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:09:28.425134 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.426040 25226 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.439395 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.447747 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.443436 25305 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:28.429911 25133 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:28.451092 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 169363us
I20260709 13:09:28.451267 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.443177 25243 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.442255 25131 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:28.444746 25202 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.465579 23045 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:28.430369 25269 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.470835 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:28.491106 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51774.5us
I20260709 13:09:28.460933 25211 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:28.503461 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.506574 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:28.450673 25307 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.521173 23078 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:28.523262 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 52552.7us
I20260709 13:09:28.529009 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:28.529878 23005 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:28.466624 25283 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.541607 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:28.556423 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:28.557350 23075 raft_consensus.cc:2393] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:28.559136 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:28.559979 23000 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.488070 25094 raft_consensus.cc:3055] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:28.565037 23001 raft_consensus.cc:2393] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:28.466282 25162 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 13:09:28.570797 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 67422.1us
I20260709 13:09:28.472098 24895 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 13:09:28.574141 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 362905us
I20260709 13:09:28.516412 25224 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:28.510325 25304 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.541193 25229 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.556272 25202 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:28.596412 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:28.564195 25094 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:28.591171 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.589200 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:28.570070 25011 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:28.577744 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.608946 24895 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:28.575016 25307 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:28.579241 25268 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.623817 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:28.625357 25267 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:28.604621 25239 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:28.646425 23000 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:28.661522 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 188637us
I20260709 13:09:28.629237 24895 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:28.629032 25011 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:28.661104 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 207845us
I20260709 13:09:28.611176 25304 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:09:28.645185 25317 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:28.650794 25267 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:28.630173 25173 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:28.686951 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 112165us
I20260709 13:09:28.682793 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:28.676570 25225 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.684190 25261 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.721180 23006 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:09:28.717880 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 308338us
I20260709 13:09:28.677930 25255 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:28.686734 25011 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.729686 23000 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:28.727286 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 44631.4us
I20260709 13:09:28.718804 23002 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:28.730966 23621 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:28.621608 25131 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:28.735700 23656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:28.743881 23656 raft_consensus.cc:606] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:28.759349 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.746901 25213 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.801842 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 70967.7us
I20260709 13:09:28.803175 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.714139 25317 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:28.807305 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 71752us
I20260709 13:09:28.729527 24804 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:28.809993 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:28.798949 25312 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:09:28.734767 25225 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.719480 25202 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:28.733366 25261 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.794216 25291 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.832201 25291 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:28.834808 25291 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:28.817569 23075 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.797953 25256 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.823505 25310 log.cc:927] Time spent T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:09:28.836208 25256 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:28.838325 25256 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:28.804579 25209 consensus_meta.cc:287] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
W20260709 13:09:28.822999 25324 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:28.825767 22930 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:28.806500 25230 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:28.802657 25323 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:28.909499 25323 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.912536 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 720) took 1032 ms. Trace:
I20260709 13:09:28.912612 25347 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:28.826992 25335 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.827512 25311 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:09:28.763677 25267 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:28.828747 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.915274 25329 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:28.807973 25213 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.918037 25213 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:28.830084 25316 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:09:28.830197 25225 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:28.824298 25239 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:28.819078 25269 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:28.834889 25322 log.cc:927] Time spent T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:28.920141 25239 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:28.800769 25166 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.921131 25166 raft_consensus.cc:697] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:28.921268 25239 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.922189 25166 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.794734 24895 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.892549 25230 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.924631 25230 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.842979 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:28.925709 22929 raft_consensus.cc:2410] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:09:28.913007 23651 rpcz_store.cc:276] 0709 13:09:27.880246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.188326 (+308080us) service_pool.cc:224] Handling call
0709 13:09:28.233142 (+ 44816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.413853 (+180711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.413894 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.414507 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:09:28.654931 (+240424us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:28.658073 (+  3142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.675946 (+ 17873us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.912289 (+236343us) raft_consensus.cc:1685] finished
0709 13:09:28.912311 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.912481 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140051,"raft.queue_time_us":140291,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"thread_start_us":206175,"threads_started":1,"wal-append.queue_time_us":304593}
I20260709 13:09:28.926659 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 577) took 1232 ms. Trace:
I20260709 13:09:28.927035 23657 rpcz_store.cc:276] 0709 13:09:27.694489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.074891 (+380402us) service_pool.cc:224] Handling call
0709 13:09:28.075150 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.075517 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.075545 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.076071 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:09:28.464507 (+388436us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:28.502842 (+ 38335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.502912 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.926463 (+423551us) raft_consensus.cc:1685] finished
0709 13:09:28.926481 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.926606 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13341,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4607,"thread_start_us":384500,"threads_started":1,"wal-append.queue_time_us":539411}
W20260709 13:09:28.843111 25321 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:09:28.929080 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:28.929418 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:28.929703 22929 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
W20260709 13:09:28.888003 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 74443.8us
I20260709 13:09:28.900636 25261 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:28.901254 23656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:28.890949 25319 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:28.902077 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:28.906654 25219 consensus_meta.cc:287] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.000s
I20260709 13:09:28.908175 25336 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.819509 25331 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:09:28.889496 23072 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:28.901727 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.930655 23656 raft_consensus.cc:606] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:28.931061 25160 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
W20260709 13:09:28.934037 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 357432us
I20260709 13:09:28.924679 24895 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.808418 25341 consensus_queue.cc:1059] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:09:28.939500 22972 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:28.921079 25317 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:28.930819 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.952083 25261 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:28.952018 25345 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:28.952804 25261 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:28.954097 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.957150 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.958714 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:28.888700 25209 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.961441 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:28.955353 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:28.976825 23653 raft_consensus.cc:2410] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:28.977633 25331 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:28.978061 25331 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.978386 25331 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.962954 25305 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.801312 25307 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:28.966529 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:28.964473 25188 consensus_meta.cc:287] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:09:28.961522 25261 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.960374 25160 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:28.992028 25305 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:28.993548 25344 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:09:28.993996 25342 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:28.940721 25336 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:28.996138 25269 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:28.998761 25215 consensus_meta.cc:287] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.000s
I20260709 13:09:28.999817 24804 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:29.038028 22877 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0db2f61e34a24096a5baf0de9a32d4f7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:09:29.038494 22877 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:09:29.038769 22877 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:09:29.011956 25160 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.040277 25160 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.981647 25345 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:29.044286 25345 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.009487 25209 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:28.988391 25173 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:29.010560 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:29.013506 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.021350 25317 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:29.048772 25317 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.050019 25266 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.050472 25266 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.050817 25317 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:28.914388 25335 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.052392 25266 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.053131 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:29.053723 25335 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.054493 22998 raft_consensus.cc:2410] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:28.984083 25341 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:29.027546 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.057339 23006 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:28.986181 25323 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.030368 23002 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:29.031730 23001 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:29.032974 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.034566 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.068063 23000 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:29.010775 25188 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.036932 25215 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.068226 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:29.073305 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:29.022282 24948 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.030123 25342 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:29.055346 25341 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.076715 25347 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:29.088203 25219 raft_consensus.cc:3055] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:29.083070 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:29.117698 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.091396 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:29.126719 22931 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:29.086696 25343 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 13:09:29.126987 25275 consensus_meta.cc:287] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 13:09:29.134121 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.079847 25188 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.078423 25323 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:29.080504 25273 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:29.082641 25215 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.125666 25219 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:29.139012 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 162620us
W20260709 13:09:29.143510 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.130441 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.146260 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:29.133467 25307 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:29.127460 25342 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.083436 25011 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.117650 25347 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.176033 25323 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:29.137838 25149 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.140422 25275 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.179150 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:29.126792 25197 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:09:29.145908 25226 consensus_meta.cc:287] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.004s
I20260709 13:09:29.177340 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.195268 23075 raft_consensus.cc:2410] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:29.142139 25333 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:29.199143 25341 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:29.200105 22926 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:29.134611 25019 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:09:29.201681 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.178795 22998 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:29.207917 25219 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.179694 25067 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.146674 25283 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.145678 25336 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:29.143208 25273 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:29.215583 23005 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:29.200686 25333 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:29.209475 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 716) took 1330 ms. Trace:
I20260709 13:09:29.175132 25000 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:29.228869 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.181109 25266 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:29.201126 25149 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.232651 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:29.237772 25350 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:29.177567 25307 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.215490 25305 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:29.216678 25357 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:29.245028 23072 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:29.245275 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:29.354046 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 108893us
I20260709 13:09:29.212415 25226 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.316944 25000 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.242393 25273 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.351552 22931 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:09:29.314991 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 82412.2us
I20260709 13:09:29.231551 25219 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.355710 25188 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.244045 25067 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:29.362668 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:29.364004 23003 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:09:29.314698 25307 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.336642 25333 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.366732 25188 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.367180 25243 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:29.352350 25019 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.358279 25225 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:29.358525 25335 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:29.368028 25244 raft_consensus.cc:3055] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:29.358784 25359 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.002s
I20260709 13:09:29.347896 25221 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:29.234493 25230 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.372871 25019 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.387894 25226 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.387977 25067 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.375725 25335 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.388986 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:29.390439 25335 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.390519 23077 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:29.374584 25225 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:29.391947 25225 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.392304 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:29.393465 25188 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.393694 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:29.311924 25266 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.396369 25266 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.374743 25244 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:29.398715 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:29.378196 25243 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:29.400446 25243 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.402288 25347 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.406366 23073 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:29.399591 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:29.408324 23074 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.412581 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.412142 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.415688 23078 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:29.364459 25160 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.416795 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:29.387794 25019 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.412142 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.375131 25333 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:29.419049 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 178887us
I20260709 13:09:29.430089 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:29.401194 25331 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.431531 22924 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:29.435025 23001 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:29.354744 25342 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.244071 23653 rpcz_store.cc:276] 0709 13:09:27.878848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.005176 (+126328us) service_pool.cc:224] Handling call
0709 13:09:29.209197 (+1204021us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54006301d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:29.209392 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842964352}
I20260709 13:09:29.435385 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.234386 25283 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.364216 25261 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.397890 25244 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.353137 25357 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.434762 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:29.442301 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.448714 23079 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.431244 25293 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:29.441169 22931 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:29.356151 25323 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.447387 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.416011 25000 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:29.338222 25305 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.449231 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:29.451133 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:29.451711 22927 raft_consensus.cc:2368] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6.
I20260709 13:09:29.457357 23006 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:29.460872 22929 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.462663 23001 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.386133 25221 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.468533 22924 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:29.473016 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:29.483542 22929 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:29.490406 25305 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.491783 23071 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.493940 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:29.513235 25357 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.527326 25244 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.527473 25348 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:29.514362 23004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 1925) took 1661 ms (client timeout 2083 ms). Trace:
W20260709 13:09:29.530629 23004 rpcz_store.cc:269] 0709 13:09:27.808121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.019765 (+211644us) service_pool.cc:224] Handling call
0709 13:09:29.453107 (+1433342us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54002e5754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:29.469931 (+ 16824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511367040}
I20260709 13:09:29.505465 25094 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.509037 25160 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.656111 25094 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.660003 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:29.660794 22931 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:29.665858 25331 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.667836 23074 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:29.668881 25261 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.669044 25143 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:29.671386 25149 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:29.510962 25221 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.672854 23076 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:29.516378 23075 raft_consensus.cc:2410] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:09:29.517055 22970 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:29.675050 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 158063us
W20260709 13:09:29.675949 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 123383us
W20260709 13:09:29.537381 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.538399 23079 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:29.551781 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:09:29.679143 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 127429us
I20260709 13:09:29.563274 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:29.681137 22927 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.456002 25142 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:29.655496 25198 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.120s
W20260709 13:09:29.525643 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.700518 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:29.701524 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:29.702009 23001 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:29.702225 23074 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:29.704460 22970 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:29.456154 25360 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.231s
I20260709 13:09:29.703018 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:29.718367 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:29.722131 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 269178us
I20260709 13:09:29.687971 25305 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:29.682523 25304 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.682678 25232 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.462980 25293 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.684455 25268 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:29.541530 25188 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.178s
I20260709 13:09:29.693214 25142 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:29.755882 23073 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:29.692103 25341 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.818356 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 93774.1us
I20260709 13:09:29.695096 25347 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:29.975961 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.300806 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 596356us
I20260709 13:09:30.168820 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:30.272307 23045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.012s	sys 0.014s
W20260709 13:09:30.276573 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.698616 25336 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:30.367807 23045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.014s	sys 0.014s
W20260709 13:09:30.358278 22926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 538) took 1680 ms (client timeout 1675 ms). Trace:
W20260709 13:09:30.368185 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 919461us
I20260709 13:09:30.369493 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:30.370285 25269 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:30.370941 25269 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:30.372668 25269 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:30.374168 25173 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:30.375954 25243 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:30.376000 25173 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.376641 25243 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.379091 25173 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:30.375265 25319 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:30.379346 25243 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:30.379949 25319 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.374732 25166 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:29.988400 25131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.018s	sys 0.024s
W20260709 13:09:30.368203 22926 rpcz_store.cc:269] 0709 13:09:28.623352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.623487 (+   135us) service_pool.cc:224] Handling call
0709 13:09:30.303695 (+1680208us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54003935d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:30.303843 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274188160}
W20260709 13:09:29.951964 25320 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:09:30.121352 25225 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.729s	user 0.005s	sys 0.005s
I20260709 13:09:29.718333 25067 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:29.750919 25221 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.722586 25317 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.750149 25261 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:29.816422 25305 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:30.388600 22997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.006s	sys 0.039s
W20260709 13:09:30.428879 22997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.006s	sys 0.039s
I20260709 13:09:30.017755 25348 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.171905 25000 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.271925 25198 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:30.435310 25000 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.435474 25198 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:30.437376 25198 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.905695 25202 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:30.438267 25202 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:30.368635 25304 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.203281 25219 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:30.202250 25230 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:29.698114 25160 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.687s
I20260709 13:09:29.697978 25226 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.687s
I20260709 13:09:30.102231 25360 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:29.845292 25331 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.587s
I20260709 13:09:30.390594 25336 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:30.391680 25131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.483s	user 0.022s	sys 0.027s
I20260709 13:09:30.397399 25149 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:30.365898 25215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.021s
I20260709 13:09:30.398207 25166 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.440838 25202 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:30.446789 22927 consensus_meta.cc:287] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.000s
I20260709 13:09:30.441901 25221 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:30.437347 25000 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:29.870826 25357 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.547s
W20260709 13:09:30.449117 22971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.018s	sys 0.020s
I20260709 13:09:30.424053 25283 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:30.361853 25268 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.367401 25341 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.431411 25305 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.549646 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:30.550202 23001 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.550601 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:30.367671 25232 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.496505 22927 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:30.554102 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2042) took 1021 ms. Trace:
I20260709 13:09:30.431216 25317 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.431526 25366 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.734s
I20260709 13:09:30.433944 25261 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:30.469324 25215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.000s	sys 0.022s
W20260709 13:09:30.513307 22972 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.501s (SENT) [suppressed 35 similar messages]
I20260709 13:09:30.452055 25219 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.537811 25378 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.442796 25348 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.428335 25067 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.544515 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:30.546613 22971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.020s	sys 0.028s
I20260709 13:09:30.548952 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:30.550282 25143 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.426122 25225 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.562052 23001 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:30.565555 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:30.554415 22927 rpcz_store.cc:276] 0709 13:09:29.532969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.533254 (+   285us) service_pool.cc:224] Handling call
0709 13:09:30.554045 (+1020791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:30.568643 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:30.499601 25230 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.648272 25379 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.663084 23622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.008s	sys 0.031s
W20260709 13:09:30.663543 23622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.008s	sys 0.031s
I20260709 13:09:30.622705 25378 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.648911 25389 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:30.619402 25234 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:30.652956 25347 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.649016 25319 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:30.549961 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:30.651917 23005 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:30.659497 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:30.690094 23001 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:30.660231 23000 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:30.660552 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:30.693565 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:30.661460 22997 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:30.459736 25360 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:30.660616 25333 consensus_meta.cc:287] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 1.221s	user 0.010s	sys 0.005s
I20260709 13:09:30.658051 25149 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.689065 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 175783us
I20260709 13:09:30.668032 25230 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.563203 25381 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:30.669677 25143 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.668612 25221 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:30.705667 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.939802 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 395370us
I20260709 13:09:30.976002 23657 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:09:30.942121 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.976781 23654 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:30.946659 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:31.001456 23656 raft_consensus.cc:2410] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:09:30.688349 25094 consensus_meta.cc:287] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.032s	user 0.009s	sys 0.000s
W20260709 13:09:30.936072 25374 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
W20260709 13:09:30.814160 25244 consensus_meta.cc:287] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.286s	user 0.003s	sys 0.007s
I20260709 13:09:30.706897 25391 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.004446 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:31.005101 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:30.720775 25348 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:30.848162 25376 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 13:09:30.761961 25382 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:09:31.009459 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:30.686136 25379 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.733676 25357 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:30.708585 25390 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.701884 25347 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:30.741369 25331 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.672380 25385 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:30.708518 25388 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.015458 25067 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:30.720374 24973 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.009811 25142 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:30.720293 25386 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:31.016963 23654 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:09:30.827291 25328 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 2.109s	user 0.005s	sys 0.019s
I20260709 13:09:31.017426 23657 raft_consensus.cc:2410] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:31.001274 25345 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.995812 25398 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.058028 25317 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.068362 25094 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:31.125136 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 124807us
I20260709 13:09:31.063580 25244 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:31.015362 25378 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.013093 25336 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.051724 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1647) took 2313 ms. Trace:
I20260709 13:09:30.698553 25234 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.027456 25305 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:30.764391 25019 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.324s	user 0.009s	sys 0.001s
W20260709 13:09:31.057859 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.017910 25387 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:31.061441 25393 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.055976 25197 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:31.018330 25307 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.645s	user 0.009s	sys 0.002s
W20260709 13:09:31.052330 25370 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:09:31.007273 25215 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:31.073733 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.023336 25372 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.145293 22927 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:31.074946 22928 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:31.075043 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.016109 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:31.076645 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.080252 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:30.993763 25384 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:31.081897 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.053722 25341 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:30.995687 25399 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:31.023738 25224 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:30.735607 25389 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.125989 25345 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:31.060052 25232 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:30.995222 25395 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.007064 25149 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.025444 25266 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.125934 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:31.015913 25166 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:30.825210 25268 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.063345 25331 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.068518 25225 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.064790 25304 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.064287 25357 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:31.116071 25142 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:31.132392 22972 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:31.213845 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 81528.8us
I20260709 13:09:31.130401 23003 rpcz_store.cc:276] 0709 13:09:28.715057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.715170 (+   113us) service_pool.cc:224] Handling call
0709 13:09:28.732848 (+ 17678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.366668 (+633820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.027722 (+1661054us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54003e7454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:31.027938 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450792320}
I20260709 13:09:31.065092 25391 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.075932 25385 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.085366 25390 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.151522 22926 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:31.152050 22924 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:31.152272 22930 raft_consensus.cc:2410] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:31.208089 25392 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:09:31.206418 25331 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.139176 24973 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.122229 25397 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:31.208415 25268 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.140048 25366 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.183008 25224 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:31.122509 25261 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.142145 25019 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:31.194149 25149 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.150408 25197 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:31.196481 25358 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.886s	user 0.008s	sys 0.022s
I20260709 13:09:31.130667 25094 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.132388 25244 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.208133 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:31.124176 25388 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.150492 25307 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:31.127948 25386 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.144389 25000 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:31.151348 25230 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.253065 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:31.254347 23654 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.191058 25341 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.762375 25383 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.146888 25319 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:09:31.198705 25384 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:31.142563 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:31.262622 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 120164us
I20260709 13:09:31.153908 25215 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.228860 22972 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:31.232110 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.237816 23655 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.204377 25395 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.266175 23654 raft_consensus.cc:2410] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:09:31.226157 25369 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:09:31.214920 25011 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.240574 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.215674 25360 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.227288 25142 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:31.228675 25255 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:31.128254 25398 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.242604 25234 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.206272 25266 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.248842 22925 raft_consensus.cc:2368] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8.
W20260709 13:09:31.251334 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.181058 25393 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.247172 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:31.259923 22922 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.256675 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:31.268874 25000 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.239123 25268 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.263780 25341 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.290866 23650 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:31.266902 23657 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:09:31.273880 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 58630.3us
I20260709 13:09:31.240445 25366 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.191496 25399 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.286080 25409 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.287340 23003 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:31.239475 24973 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:31.244890 25397 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.290856 25405 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.186324 25372 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.275913 25379 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.153199 25387 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:31.280073 25317 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:31.303350 25244 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.303794 25385 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.305550 25215 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.305787 25393 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.283850 25255 raft_consensus.cc:697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:31.288003 25390 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.284822 25305 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.308681 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.310299 23002 raft_consensus.cc:1813] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Handling vote request from an unknown peer b655449a388a41e3a606c6ea794825ad
I20260709 13:09:31.258522 25383 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.316689 23655 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:31.284951 25347 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.271976 25357 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:31.320996 23002 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:09:31.320382 22924 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:31.323138 25384 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.313496 25317 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:31.323634 25307 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.319990 25000 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:31.321810 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:31.312477 25409 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:31.326177 25273 consensus_meta.cc:287] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.952s	user 0.013s	sys 0.000s
W20260709 13:09:31.643461 23006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 512) took 2437 ms (client timeout 2983 ms). Trace:
W20260709 13:09:31.454998 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.667868 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.340744 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.760643 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.762208 23006 rpcz_store.cc:269] 0709 13:09:29.145008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.145153 (+   145us) service_pool.cc:224] Handling call
0709 13:09:31.561691 (+2416538us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54000f1ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:31.582562 (+ 20871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596614400}
W20260709 13:09:31.521373 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 113145us
I20260709 13:09:31.328913 25405 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.768625 25405 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.769526 25390 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.656198 25381 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.645s	user 0.002s	sys 0.009s
W20260709 13:09:31.531863 25402 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:09:31.335253 25317 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.331746 25391 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:31.752519 25224 consensus_meta.cc:287] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:09:31.368022 25268 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.343598 25345 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.357054 25408 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.350603 22998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1947) took 1668 ms. Trace:
I20260709 13:09:31.663121 24973 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.572556 25341 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.579820 25142 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.350461 25266 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.336043 25389 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.357807 25197 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.748806 25000 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:31.367110 25395 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.513160 25318 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:31.658948 25387 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.578900 25366 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.531705 25383 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.549717 25398 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.555639 25397 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.771767 25273 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.576045 25386 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.572276 25388 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:31.798645 23045 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.016s	sys 0.019s
I20260709 13:09:31.367524 25255 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:31.802351 23045 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.016s	sys 0.019s
W20260709 13:09:31.802997 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 539180us
I20260709 13:09:31.780423 25408 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.775890 25390 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.806790 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:31.807425 22999 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:31.785168 25224 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.808405 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:31.786998 25269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.008s	sys 0.004s
I20260709 13:09:31.812919 22923 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
W20260709 13:09:31.816926 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.011s
W20260709 13:09:31.817276 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.013s	sys 0.011s
I20260709 13:09:31.808813 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:31.800827 25318 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.812800 25399 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.818926 25266 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:31.818439 22895 connection.cc:256] RPC call timeout handler was delayed by -1.6656573320000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:09:31.817622 25331 consensus_meta.cc:287] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
W20260709 13:09:31.835114 23620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.004s	sys 0.033s
W20260709 13:09:31.838282 23620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.004s	sys 0.033s
I20260709 13:09:31.784060 22998 rpcz_store.cc:276] 0709 13:09:29.682138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.684237 (+  2099us) service_pool.cc:224] Handling call
0709 13:09:31.349628 (+1665391us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:31.349850 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.350119 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.350166 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:31.350231 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:31.350294 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.350374 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.350529 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75642752}
I20260709 13:09:31.839772 22895 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:31.817714 25269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.008s	sys 0.004s
I20260709 13:09:31.841866 25388 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.842387 25386 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:31.839071 25268 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.827987 23650 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.853137 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.854143 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.856232 22930 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:31.856050 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:31.859566 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.860636 22924 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:31.861624 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.812211 25000 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.865810 22930 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:31.900374 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:31.901295 25414 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:31.901464 22926 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:31.901757 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.906618 25390 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:31.852006 25405 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:31.865423 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:31.844904 25398 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.925103 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:31.931080 22927 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:31.837476 25266 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.843842 25331 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.857210 25307 consensus_queue.cc:1059] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:09:31.863037 25244 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
I20260709 13:09:31.858373 25388 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:31.947487 22924 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:32.324275 25408 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:32.321344 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.276631 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.310704 25224 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:31.863291 25386 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.204588 25415 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.219203 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.164750 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.960844 25000 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:32.205361 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 57839.7us
I20260709 13:09:31.947875 25405 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:32.286085 25273 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.946934 25266 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.933094 25409 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.435179 25405 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:32.424034 25209 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.438867 25209 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.362447 25388 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:32.358506 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:32.424850 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.367432 25318 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:32.428965 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.429286 23000 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:32.487836 25209 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:32.431871 25415 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:32.505483 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.506577 23000 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:32.495412 25307 consensus_queue.cc:1243] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer b655449a388a41e3a606c6ea794825ad log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:32.536516 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:32.504295 23650 consensus_meta.cc:287] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
W20260709 13:09:31.899762 25239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.936s	user 0.017s	sys 0.103s
I20260709 13:09:32.039369 25317 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.590911 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.591472 25406 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:32.591837 22924 raft_consensus.cc:2410] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:32.592085 25406 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.593405 25349 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.593916 25349 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:32.594221 25406 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.596187 25415 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:32.599303 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:32.584847 25239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.655s	user 0.017s	sys 0.104s
I20260709 13:09:31.863190 25268 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.595988 25317 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:32.608397 25418 log.cc:927] Time spent T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:32.617177 25386 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:32.601195 25273 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:32.625062 25331 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.584612 23650 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:31.945015 25398 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.600701 25224 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.596098 25349 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:32.641027 22926 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:32.627501 25268 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.696105 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:32.696952 23649 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.697805 25398 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:32.700238 22925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 1674) took 3259 ms (client timeout 2031 ms). Trace:
W20260709 13:09:32.700651 22925 rpcz_store.cc:269] 0709 13:09:29.440393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.445917 (+  5524us) service_pool.cc:224] Handling call
0709 13:09:32.700018 (+3254101us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54003930d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:32.700147 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4108322048}
I20260709 13:09:32.705654 25406 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:32.706274 25406 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:32.733016 25149 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:32.733458 25149 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:32.733505 25406 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:32.726822 25415 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.734300 25149 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.735690 25149 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.735316 25415 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.738322 25415 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.738628 22927 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:32.739171 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.727134 25405 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.740438 25405 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.742365 25405 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:32.692610 23650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 765) took 1618 ms (client timeout 1806 ms). Trace:
I20260709 13:09:32.677918 25317 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.731321 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 144609us
W20260709 13:09:32.753048 23654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 762) took 1681 ms (client timeout 1589 ms). Trace:
W20260709 13:09:32.777731 23654 rpcz_store.cc:269] 0709 13:09:31.071945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.079989 (+  8044us) service_pool.cc:224] Handling call
0709 13:09:32.752781 (+1672792us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b54006a09d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:32.752978 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167732480}
I20260709 13:09:32.778918 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:32.779507 23654 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:09:32.779989 23654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 769) took 1706 ms (client timeout 1920 ms). Trace:
W20260709 13:09:32.780328 23654 rpcz_store.cc:269] 0709 13:09:31.073982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.778722 (+1704740us) service_pool.cc:224] Handling call
0709 13:09:32.779950 (+  1228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.781119 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:32.781688 23654 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:32.781905 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:32.782203 23654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 759) took 1711 ms (client timeout 1934 ms). Trace:
I20260709 13:09:32.782569 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:32.692925 25224 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.674199 25273 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.788336 25224 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:32.788635 25273 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:32.788957 25375 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 2.128s	user 0.010s	sys 0.028s
I20260709 13:09:32.790622 23648 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:32.791296 23620 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:47786 dropped due to backpressure: service queue is full with 50 items
W20260709 13:09:32.792642 25371 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 2.366s	user 0.019s	sys 0.020s
I20260709 13:09:32.755316 25317 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.796166 25317 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:32.760773 23655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 722) took 1818 ms (client timeout 1938 ms). Trace:
I20260709 13:09:32.791360 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 728) took 1815 ms. Trace:
W20260709 13:09:32.796736 23655 rpcz_store.cc:269] 0709 13:09:30.942509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.942624 (+   115us) service_pool.cc:224] Handling call
0709 13:09:32.760561 (+1817937us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54004763d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:32.760701 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421436416}
I20260709 13:09:32.796833 23648 rpcz_store.cc:276] 0709 13:09:30.976146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.996526 (+ 20380us) service_pool.cc:224] Handling call
0709 13:09:32.790166 (+1793640us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:32.790347 (+   181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.791082 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.791302 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7114496}
W20260709 13:09:32.775595 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.776016 23657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 763) took 1703 ms (client timeout 1646 ms). Trace:
W20260709 13:09:32.798306 23657 rpcz_store.cc:269] 0709 13:09:31.072251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.125670 (+ 53419us) service_pool.cc:224] Handling call
0709 13:09:32.775825 (+1650155us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b540044cd54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:32.775952 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157938432}
W20260709 13:09:32.782548 23654 rpcz_store.cc:269] 0709 13:09:31.071003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.780919 (+1709916us) service_pool.cc:224] Handling call
0709 13:09:32.782155 (+  1236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.799274 25094 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.800482 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 1954) took 3411 ms. Trace:
I20260709 13:09:32.781704 25331 consensus_queue.cc:1059] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:09:32.778107 25349 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.743767 23650 rpcz_store.cc:269] 0709 13:09:31.072840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.797276 (+724436us) service_pool.cc:224] Handling call
0709 13:09:32.690838 (+893562us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:32.779223 25275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.570s	user 0.013s	sys 0.055s
I20260709 13:09:32.756105 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:32.793179 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 721) took 1851 ms. Trace:
I20260709 13:09:32.797824 25342 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:32.753862 25318 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:32.804853 25275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.602s	user 0.014s	sys 0.055s
I20260709 13:09:32.806249 25318 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.802946 24895 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:32.804713 23656 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:09:32.809190 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 584) took 1806 ms (client timeout 1519 ms). Trace:
W20260709 13:09:32.809597 23656 rpcz_store.cc:269] 0709 13:09:31.002769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.006777 (+  4008us) service_pool.cc:224] Handling call
0709 13:09:32.755984 (+1749207us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:32.809123 (+ 53139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22132608}
I20260709 13:09:32.806645 25267 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.803714 25424 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:32.807890 25422 raft_consensus.cc:3055] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:32.816318 25422 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:32.817193 25422 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.818370 25422 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:32.803296 25349 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.821386 25304 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.821921 25304 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:32.822724 25349 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.823545 25318 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:32.811789 25424 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:32.824674 25424 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:32.824894 25304 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:31.663784 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:32.867350 22923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2035) took 3809 ms (client timeout 1934 ms). Trace:
I20260709 13:09:32.868149 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1669) took 3457 ms. Trace:
I20260709 13:09:32.868808 22922 rpcz_store.cc:276] 0709 13:09:29.410843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.413261 (+  2418us) service_pool.cc:224] Handling call
0709 13:09:29.413436 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.287156 (+1873720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.867263 (+1580107us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54003c9bd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:32.867862 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4246153472}
I20260709 13:09:32.750560 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:32.748234 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:32.872660 22929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2033) took 3859 ms (client timeout 1501 ms). Trace:
W20260709 13:09:32.873229 22929 rpcz_store.cc:269] 0709 13:09:29.013048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.013219 (+   171us) service_pool.cc:224] Handling call
0709 13:09:32.872220 (+3859001us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54003c91d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:32.872427 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948363648}
I20260709 13:09:32.876175 22930 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
W20260709 13:09:32.869128 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.868321 22923 rpcz_store.cc:269] 0709 13:09:29.057632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.058188 (+   556us) service_pool.cc:224] Handling call
0709 13:09:32.866709 (+3808521us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b540033de54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:32.867036 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6179812224}
I20260709 13:09:32.888657 22998 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:32.879176 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 552) took 1003 ms. Trace:
I20260709 13:09:32.889252 22930 rpcz_store.cc:276] 0709 13:09:31.875413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.901523 (+ 26110us) service_pool.cc:224] Handling call
0709 13:09:32.878857 (+977334us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540033e354. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:32.879091 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238831488}
I20260709 13:09:32.890561 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.890610 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:32.880889 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.775295 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.892299 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.894142 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.892339 22997 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:32.897341 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.898486 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:32.801051 23071 rpcz_store.cc:276] 0709 13:09:29.389210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.416512 (+ 27302us) service_pool.cc:224] Handling call
0709 13:09:29.441633 (+ 25121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.526129 (+ 84496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.800133 (+3274004us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b540021b454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:32.800390 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34209536}
I20260709 13:09:32.901024 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.902426 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.902997 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.904381 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.905362 23080 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:32.906405 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.907094 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:32.895519 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.907522 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.805382 23653 rpcz_store.cc:276] 0709 13:09:30.942160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.996004 (+ 53844us) service_pool.cc:224] Handling call
0709 13:09:32.792182 (+1796178us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:32.792398 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.792748 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.792784 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.792837 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:32.792893 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.792980 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.793110 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12407552}
I20260709 13:09:32.912252 23080 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:32.899545 22925 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:32.881839 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.883440 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.754820 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:32.808770 24895 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.884830 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:32.886758 22971 leader_election.cc:336] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.589s (SENT)
I20260709 13:09:32.887238 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.887516 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.916399 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.884439 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.910602 23077 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:32.913673 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.910816 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.913621 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.888886 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.903548 23071 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:32.923236 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.923507 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.924950 23071 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:32.925088 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.926679 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.928403 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:32.937762 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:32.945363 25366 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:32.946080 23004 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:32.946578 25366 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:32.932384 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.932564 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.936160 22926 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:32.936405 25133 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:32.937098 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:32.937234 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:32.923251 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:32.891597 22998 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:33.025782 23002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1666) took 1774 ms (client timeout 2136 ms). Trace:
I20260709 13:09:33.003543 23073 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:33.001209 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.005589 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:33.036309 23076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 1955) took 3646 ms (client timeout 1501 ms). Trace:
I20260709 13:09:33.006258 22928 raft_consensus.cc:2410] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:33.028066 23000 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
W20260709 13:09:32.888702 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 106027us
W20260709 13:09:33.051329 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 164866us
I20260709 13:09:33.002514 23071 raft_consensus.cc:2410] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:33.060583 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:33.053176 23002 rpcz_store.cc:269] 0709 13:09:31.251220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.251364 (+   144us) service_pool.cc:224] Handling call
0709 13:09:33.025131 (+1773767us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b540030f2d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:33.025501 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130241792}
I20260709 13:09:33.029662 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:33.054484 23076 rpcz_store.cc:269] 0709 13:09:29.389486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.405529 (+ 16043us) service_pool.cc:224] Handling call
0709 13:09:33.035728 (+3630199us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400033c54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:33.036010 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555942656}
I20260709 13:09:33.065443 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:33.070961 23649 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:33.071748 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:32.994419 24895 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.079226 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.080826 23076 raft_consensus.cc:2393] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:33.081923 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.082206 25318 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:33.083120 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 62319.4us
I20260709 13:09:33.083372 22929 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:33.083868 22929 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:33.085165 22929 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:33.086203 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 56958.7us
I20260709 13:09:33.086668 25413 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:33.086869 23005 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:33.087249 25413 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:33.087780 25413 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.087888 22930 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:33.088030 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.089747 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 730) took 2112 ms. Trace:
I20260709 13:09:33.089869 25267 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:33.090355 23649 rpcz_store.cc:276] 0709 13:09:30.976733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.996817 (+ 20084us) service_pool.cc:224] Handling call
0709 13:09:32.695895 (+1699078us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:33.089561 (+393666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6410624}
I20260709 13:09:33.090679 25267 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:33.089564 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:33.090031 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.062556 25224 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:33.085506 25366 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:33.083372 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.086709 22929 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.092985 23080 raft_consensus.cc:2410] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:33.100860 25372 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:33.089567 22896 connection.cc:256] RPC call timeout handler was delayed by -2.3152360149999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:09:33.106361 25349 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.107249 25349 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:33.108568 25224 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:33.108987 25224 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:33.110141 25224 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.107895 23075 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:33.105170 25413 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.114249 25413 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:33.108580 23077 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:33.119278 22997 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:33.115574 23076 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:33.107288 23652 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 3 LEARNER]: Advancing to term 4
W20260709 13:09:33.125937 23046 connection.cc:256] RPC call timeout handler was delayed by -2.1084812159999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:09:33.130347 23046 connection.cc:256] RPC call timeout handler was delayed by -1.6674812159999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:09:33.126289 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.127539 25267 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:33.128150 22896 connection.cc:256] RPC call timeout handler was delayed by -2.1172360150000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 13:09:33.128775 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:33.129174 25293 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:33.129335 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.129797 25433 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.133590 22896 connection.cc:256] RPC call timeout handler was delayed by -1.4338533100000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 13:09:33.133764 23046 connection.cc:256] RPC call timeout handler was delayed by -1.0937801719999243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:09:33.134212 23046 connection.cc:256] RPC call timeout handler was delayed by -1.0181801719999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:09:33.134049 25433 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.134590 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:33.136515 23621 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:33.136830 25433 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:33.110165 25349 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:33.139124 23072 raft_consensus.cc:2410] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:33.130182 25133 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.137748 25409 raft_consensus.cc:3055] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:33.133081 22971 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.654s (SENT)
I20260709 13:09:33.148036 23006 raft_consensus.cc:2368] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:33.131209 23074 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 1.
I20260709 13:09:33.146936 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.152035 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:33.138672 25372 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:33.143721 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:33.158456 25224 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.165625 25331 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:33.166227 25331 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.169878 25331 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:33.171934 25143 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:33.174350 25349 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:33.180456 23005 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.147708 25409 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:33.155527 25433 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:33.184435 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50042.5us
I20260709 13:09:33.186038 22922 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:33.156731 25366 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:33.189262 25413 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:33.189157 25366 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:33.189749 25413 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:33.190192 25413 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:33.191938 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 55575.1us
I20260709 13:09:33.191444 25366 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:33.195008 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:32.791767 23620 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:47786 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 734)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 732)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 739)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 587)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 760)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 766)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 737)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 741)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 743)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 588)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 593)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 598)
I20260709 13:09:33.196218 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.191838 25317 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:33.191578 25219 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:33.198673 23002 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:33.198877 25408 consensus_queue.cc:1059] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:33.200008 25408 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:33.200376 25408 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:33.201438 25408 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.203207 25408 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.203994 25424 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.204442 25409 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.205718 25409 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:33.206351 25424 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:33.198786 23651 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:33.209750 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 726) took 2234 ms. Trace:
I20260709 13:09:33.210204 23651 rpcz_store.cc:276] 0709 13:09:30.975588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.996192 (+ 20604us) service_pool.cc:224] Handling call
0709 13:09:32.739507 (+1743315us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:32.739693 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.207223 (+467530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.209317 (+  2094us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54005e01d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:33.209615 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051442688}
I20260709 13:09:33.212646 25143 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.213212 25143 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:33.214946 23622 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:33.215695 25133 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:33.216351 25219 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:33.216817 25219 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.217244 25219 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:33.217849 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.219810 25143 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:33.198982 23621 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:33.224531 23075 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:33.229028 23005 raft_consensus.cc:2410] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:33.230924 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.229791 23003 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:33.164284 25372 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:33.233816 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1660) took 2569 ms. Trace:
I20260709 13:09:33.250401 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.232437 23080 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:33.227885 23004 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.254945 23003 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:33.256107 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.256801 23003 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:33.260013 23006 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:09:33.263157 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.264048 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.263927 25377 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:33.264938 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 142052us
I20260709 13:09:33.265590 25424 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.266180 25424 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:33.266613 22971 leader_election.cc:336] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.814s (SENT)
I20260709 13:09:33.266990 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:33.268179 25143 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:33.269953 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:33.278225 23657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 764) took 2205 ms (client timeout 2004 ms). Trace:
I20260709 13:09:33.278995 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.280930 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.281733 23074 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:33.283037 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:33.279075 23657 rpcz_store.cc:269] 0709 13:09:31.072541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.277770 (+2205229us) service_pool.cc:211] Skipping call since client already timed out
0709 13:09:33.277950 (+   180us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:09:33.284641 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:33.284927 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 734) took 2306 ms (client timeout 2189 ms). Trace:
W20260709 13:09:33.285302 23656 rpcz_store.cc:269] 0709 13:09:30.978014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.284595 (+2306581us) service_pool.cc:211] Skipping call since client already timed out
0709 13:09:33.284736 (+   141us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:09:33.284162 23074 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:33.286336 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.287123 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 735) took 1442 ms. Trace:
I20260709 13:09:33.289232 22931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2044) took 3603 ms. Trace:
I20260709 13:09:33.289650 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.289570 22931 rpcz_store.cc:276] 0709 13:09:29.685390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.694962 (+  9572us) service_pool.cc:224] Handling call
0709 13:09:29.699647 (+  4685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.462920 (+763273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.462950 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.463432 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.755297 (+2291865us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b18002a2800. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa0d1 00007f3924fc5a0f
0709 13:09:32.874988 (+119691us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:32.875081 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.288790 (+413709us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54002387d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:33.288841 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.288920 (+    79us) raft_consensus.cc:1685] finished
0709 13:09:33.288935 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.289067 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3011,"raft.queue_time_us":9341,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":28572,"spinlock_wait_cycles":1763044480,"thread_start_us":119161,"threads_started":1,"wal-append.queue_time_us":2315255}
I20260709 13:09:33.291865 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:33.292261 23650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 732) took 2314 ms (client timeout 2204 ms). Trace:
W20260709 13:09:33.292688 23650 rpcz_store.cc:269] 0709 13:09:30.977455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.291953 (+2314498us) service_pool.cc:211] Skipping call since client already timed out
0709 13:09:33.292088 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:09:33.288108 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 89231.8us
I20260709 13:09:33.293804 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.293921 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:33.294252 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.294813 23650 raft_consensus.cc:2410] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:33.294872 25377 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:33.295039 23621 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:33.295205 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.295486 25377 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.295580 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.295938 25377 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.295890 23071 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:33.296517 23076 raft_consensus.cc:2410] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:33.297094 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:33.297299 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.297851 23071 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:33.297946 23076 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:33.298313 25219 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.298753 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.298834 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.294821 23074 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:09:33.300414 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.303206 23074 raft_consensus.cc:1275] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:33.303252 23079 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:33.287400 23656 rpcz_store.cc:276] 0709 13:09:31.844516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.286039 (+1441523us) service_pool.cc:224] Handling call
0709 13:09:33.287051 (+  1012us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:33.292725 23651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 772) took 1448 ms (client timeout 1814 ms). Trace:
W20260709 13:09:33.306977 23651 rpcz_store.cc:269] 0709 13:09:31.843825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.211606 (+1367781us) service_pool.cc:224] Handling call
0709 13:09:33.292643 (+ 81037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.308357 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.309209 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.309221 22999 raft_consensus.cc:2393] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:33.285413 23657 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
W20260709 13:09:33.311246 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 48632us
W20260709 13:09:33.311798 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 97434.7us
I20260709 13:09:33.317437 23002 raft_consensus.cc:2410] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:33.318034 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:33.319247 23657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 768) took 2237 ms (client timeout 2715 ms). Trace:
W20260709 13:09:33.319963 23657 rpcz_store.cc:269] 0709 13:09:31.073703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.284285 (+2210582us) service_pool.cc:224] Handling call
0709 13:09:33.311567 (+ 27282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.343991 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.343161 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.283072 25413 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.315991 25372 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:33.343241 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 81634.7us
W20260709 13:09:33.396162 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 54640.6us
I20260709 13:09:33.353091 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.385953 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:33.352432 22999 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:33.251767 23001 rpcz_store.cc:276] 0709 13:09:30.551102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.690790 (+139688us) service_pool.cc:224] Handling call
0709 13:09:30.691170 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.739111 (+ 47941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.739157 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.884026 (+2144869us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b2c000af478. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3923903a11 00007f3923913372 00007f3925045a01 00007f392500a43a 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2
0709 13:09:32.884929 (+   903us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.053151 (+168222us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:33.058602 (+  5451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.074161 (+ 15559us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.098206 (+ 24045us) raft_consensus.cc:1685] finished
0709 13:09:33.118351 (+ 20145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.120366 (+  2015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28149,"raft.queue_time_us":179656,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":68872,"spinlock_wait_cycles":5448064,"thread_start_us":167631,"threads_started":1,"wal-append.queue_time_us":182470}
W20260709 13:09:33.482369 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.463832 23004 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:09:33.496351 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.352468 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.360387 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.501340 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.318675 25408 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.389259 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.367333 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.550640 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:33.481115 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.421556 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.420416 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.385665 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:33.554682 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.555358 22928 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.367884 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:33.419313 23655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 586) took 2415 ms (client timeout 2071 ms). Trace:
I20260709 13:09:33.567917 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:33.562453 23655 rpcz_store.cc:269] 0709 13:09:31.003971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.418950 (+2414979us) service_pool.cc:211] Skipping call since client already timed out
0709 13:09:33.419125 (+   175us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:09:33.570763 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:33.389178 25381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.594s	user 0.045s	sys 0.047s
I20260709 13:09:33.570372 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.414816 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.389336 25239 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:33.419134 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:33.366971 25275 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.574924 22927 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:33.420744 23652 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:33.410987 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:33.368156 23650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 770) took 2287 ms (client timeout 2848 ms). Trace:
I20260709 13:09:33.580137 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.580181 23005 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:33.578351 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.579802 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:33.586347 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.579370 22925 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:33.409854 25019 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:33.577620 25381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.785s	user 0.049s	sys 0.055s
I20260709 13:09:33.596946 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.597123 22997 raft_consensus.cc:2410] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:33.591429 23656 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:33.599215 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.599530 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.581673 25239 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:33.589453 22998 consensus_meta.cc:287] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
I20260709 13:09:33.603597 23002 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:33.596504 22926 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:33.606812 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.563505 25408 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:33.402357 25377 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.429320 24895 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:33.602206 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 736) took 1745 ms (client timeout 2136 ms). Trace:
I20260709 13:09:33.613353 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:33.613619 23656 rpcz_store.cc:269] 0709 13:09:31.852536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.318263 (+1465727us) service_pool.cc:224] Handling call
0709 13:09:33.598325 (+280062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.603076 22998 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:33.608579 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:33.613354 23004 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:33.608318 22999 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:33.608385 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.593415 25219 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:33.594759 23652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 731) took 2614 ms (client timeout 1815 ms). Trace:
I20260709 13:09:33.616989 23001 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:33.621098 22925 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
W20260709 13:09:33.623605 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 312896us
I20260709 13:09:33.627283 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.618398 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:33.635124 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.636132 23656 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:33.635133 22997 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:33.637260 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.638566 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.641120 22998 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.641311 24895 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:33.603542 25239 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.644165 23657 raft_consensus.cc:2368] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3.
I20260709 13:09:33.644984 23071 raft_consensus.cc:2368] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:33.639195 23656 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:33.645845 22896 leader_election.cc:400] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:33.647356 22896 leader_election.cc:403] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:33.648006 22970 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:33.648578 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:33.649467 25409 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:33.649569 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:33.650183 25409 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:33.650488 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:33.650733 25409 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:33.632048 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.651829 25317 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:33.651952 22999 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:33.652280 25317 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:33.652657 25317 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.653203 22999 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.654654 23004 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:33.656077 23649 raft_consensus.cc:2410] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:33.656102 25226 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:33.656661 25226 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:33.656688 23649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 773) took 1812 ms (client timeout 1589 ms). Trace:
I20260709 13:09:33.657174 25226 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:33.657223 23649 rpcz_store.cc:269] 0709 13:09:31.844095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.418758 (+1574663us) service_pool.cc:224] Handling call
0709 13:09:33.656611 (+237853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.658609 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.646191 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:33.623266 23652 rpcz_store.cc:269] 0709 13:09:30.977120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.996232 (+ 19112us) service_pool.cc:224] Handling call
0709 13:09:33.046442 (+2050210us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:33.591194 (+544752us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12781952}
I20260709 13:09:33.660360 22926 raft_consensus.cc:2410] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:33.660790 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.661156 25409 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.663343 23079 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:33.664069 23077 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:33.665673 25408 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:33.666635 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 51501us
I20260709 13:09:33.669632 23001 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:33.670814 23001 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:33.672104 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.672120 22925 raft_consensus.cc:3055] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:33.673794 22925 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:33.634992 25336 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:33.591291 23650 rpcz_store.cc:269] 0709 13:09:31.074307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.293465 (+2219158us) service_pool.cc:224] Handling call
0709 13:09:33.361512 (+ 68047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.629442 23655 raft_consensus.cc:2376] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4. Re-sending same reply.
I20260709 13:09:33.677722 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 746) took 1087 ms. Trace:
I20260709 13:09:33.678143 23655 rpcz_store.cc:276] 0709 13:09:32.590281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.584207 (+993926us) service_pool.cc:224] Handling call
0709 13:09:33.677650 (+ 93443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.679113 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 740) took 1092 ms. Trace:
I20260709 13:09:33.679258 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.679486 23656 rpcz_store.cc:276] 0709 13:09:32.582986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.638255 (+1055269us) service_pool.cc:224] Handling call
0709 13:09:33.674896 (+ 36641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.675742 23003 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:33.673346 23653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 774) took 1828 ms (client timeout 1602 ms). Trace:
W20260709 13:09:33.681895 23653 rpcz_store.cc:269] 0709 13:09:31.844307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.673033 (+1828726us) service_pool.cc:211] Skipping call since client already timed out
0709 13:09:33.673193 (+   160us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:09:33.607468 23648 raft_consensus.cc:2376] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3. Re-sending same reply.
I20260709 13:09:33.659377 23649 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
W20260709 13:09:33.684563 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.666208 25408 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:33.699693 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.698891 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:33.769632 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:33.712615 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 60992.3us
I20260709 13:09:33.599769 25275 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:33.774475 22927 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
W20260709 13:09:33.799582 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.802932 23076 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:09:33.804551 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 103002us
I20260709 13:09:33.801673 22926 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:33.810141 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.807724 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.767876 25408 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.815304 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.814721 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:33.814930 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:33.768497 23648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 771) took 1921 ms (client timeout 1654 ms). Trace:
I20260709 13:09:33.773041 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 742) took 1183 ms. Trace:
I20260709 13:09:33.819731 23073 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:33.818295 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 135712us
I20260709 13:09:33.764146 25381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49884 (request call id 87) took 5603 ms. Trace:
I20260709 13:09:33.800889 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 601) took 1041 ms. Trace:
I20260709 13:09:33.790989 25336 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:33.823482 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.825733 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:33.830142 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.826558 23652 rpcz_store.cc:276] 0709 13:09:32.759541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.660511 (+900970us) service_pool.cc:224] Handling call
0709 13:09:33.791462 (+130951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.817711 25408 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.838372 23656 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:33.848007 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 600) took 1088 ms. Trace:
I20260709 13:09:33.848376 23656 rpcz_store.cc:276] 0709 13:09:32.759215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.688204 (+928989us) service_pool.cc:224] Handling call
0709 13:09:33.847943 (+159739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.838917 23655 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:33.851306 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:33.854846 22972 connection.cc:256] RPC call timeout handler was delayed by -1.4471268239999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:09:33.846601 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.859048 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 602) took 1082 ms. Trace:
I20260709 13:09:33.859686 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.859409 23655 rpcz_store.cc:276] 0709 13:09:32.776463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.689678 (+913215us) service_pool.cc:224] Handling call
0709 13:09:33.858997 (+169319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.827488 22925 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:33.826973 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.868474 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:33.828572 23651 raft_consensus.cc:2376] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5. Re-sending same reply.
I20260709 13:09:33.825269 23649 rpcz_store.cc:276] 0709 13:09:32.583672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.658274 (+1074602us) service_pool.cc:224] Handling call
0709 13:09:33.767444 (+109170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:33.821700 23648 rpcz_store.cc:269] 0709 13:09:31.843465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.410477 (+1567012us) service_pool.cc:224] Handling call
0709 13:09:33.764475 (+353998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.869127 22999 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:33.870417 22929 raft_consensus.cc:2410] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:34.064150 22928 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:34.064028 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 539) took 1118 ms. Trace:
I20260709 13:09:33.888131 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:34.157725 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 363898us
I20260709 13:09:33.941671 22925 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.893069 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.886534 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:34.135574 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.162729 23657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 592) took 1384 ms (client timeout 1548 ms). Trace:
W20260709 13:09:34.139179 25443 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.301s	user 0.003s	sys 0.000s
I20260709 13:09:33.869946 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.946827 23656 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
W20260709 13:09:33.895118 25439 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:09:33.899066 23654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 767) took 2825 ms (client timeout 2040 ms). Trace:
I20260709 13:09:34.174714 23073 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:34.088510 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.137642 22825 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 257) took 7642 ms. Trace:
I20260709 13:09:34.065678 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1957) took 1160 ms. Trace:
I20260709 13:09:34.143615 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.885957 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:33.890556 25413 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:34.167629 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:34.164988 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:34.175158 23657 rpcz_store.cc:269] 0709 13:09:32.756424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.378673 (+622249us) service_pool.cc:224] Handling call
0709 13:09:34.140643 (+761970us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b54005703d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:34.140820 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187922688}
I20260709 13:09:34.175391 23002 rpcz_store.cc:276] 0709 13:09:32.878059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.614345 (+736286us) service_pool.cc:224] Handling call
0709 13:09:33.653141 (+ 38796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.653405 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.653434 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.653896 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.847150 (+193254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:33.847228 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.847405 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.995814 (+148409us) raft_consensus.cc:1685] finished
0709 13:09:33.995832 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.995954 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":192713,"threads_started":1,"wal-append.queue_time_us":339418}
I20260709 13:09:34.196091 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:33.885627 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:34.177520 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:34.177760 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:34.177898 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.178050 22927 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:34.196694 22929 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:34.178077 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:34.171352 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 103690us
W20260709 13:09:34.197957 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.198318 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.181820 22998 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:34.185137 25424 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:33.895450 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.181131 22931 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:33.889822 25377 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:34.188374 22997 rpcz_store.cc:276] 0709 13:09:32.905673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.615201 (+709528us) service_pool.cc:224] Handling call
0709 13:09:33.631914 (+ 16713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.634915 (+  3001us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:33.648262 (+ 13347us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.065155 (+416893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.065238 (+    83us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:34.065329 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.065426 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.065602 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147399,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":221081,"threads_started":1}
W20260709 13:09:34.142745 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 274470us
I20260709 13:09:33.892407 23072 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:34.191138 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 328718us
I20260709 13:09:33.946509 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:34.187551 23654 rpcz_store.cc:269] 0709 13:09:31.073442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.875859 (+2802417us) service_pool.cc:211] Skipping call since client already timed out
0709 13:09:33.898874 (+ 23015us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:09:33.887478 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 738) took 1322 ms. Trace:
I20260709 13:09:34.191874 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:34.178249 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:34.195488 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 590) took 1451 ms. Trace:
I20260709 13:09:34.233071 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:34.233001 23655 rpcz_store.cc:276] 0709 13:09:32.744401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.867779 (+1123378us) service_pool.cc:224] Handling call
0709 13:09:34.195377 (+327598us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:34.143661 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.174296 23651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 745) took 1581 ms (client timeout 1938 ms). Trace:
I20260709 13:09:33.887987 23650 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:34.201622 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:34.234612 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.894320 25239 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:34.204382 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:34.204988 23006 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.204856 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:34.229072 23652 raft_consensus.cc:2393] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:34.204382 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.206146 25275 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:34.206499 22970 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:34.208334 23046 leader_election.cc:400] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6.
I20260709 13:09:34.208927 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.243434 23046 leader_election.cc:403] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:33.945838 25143 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.246s
I20260709 13:09:34.245249 23046 leader_election.cc:400] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8.
I20260709 13:09:34.245577 23046 leader_election.cc:403] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:34.212029 22923 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:34.212190 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:34.214511 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:34.215939 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:34.247062 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:34.188342 22825 rpcz_store.cc:276] 0709 13:09:26.495151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.495322 (+   171us) service_pool.cc:224] Handling call
0709 13:09:34.137311 (+7641989us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:28.270467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:28.271270 (+   803us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:28.271322 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:09:28.271350 (+    28us) tablet.cc:662] Decoding operations
0709 13:09:28.303737 (+ 32387us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:28.335454 (+ 31717us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:28.337653 (+  2199us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:09:28.454354 (+116701us) tablet.cc:701] Row locks acquired
0709 13:09:28.465341 (+ 10987us) write_op.cc:260] PREPARE: finished
0709 13:09:28.502746 (+ 37405us) write_op.cc:270] Start()
0709 13:09:28.556011 (+ 53265us) write_op.cc:276] Timestamp: P: 1783602568481987 usec, L: 0
0709 13:09:28.556058 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:09:28.646673 (+ 90615us) log.cc:844] Serialized 2069 byte log entry
0709 13:09:29.310001 (+663328us) op_driver.cc:464] REPLICATION: finished
0709 13:09:30.015760 (+705759us) write_op.cc:301] APPLY: starting
0709 13:09:30.101139 (+ 85379us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:30.201665 (+100526us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:30.208408 (+  6743us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:30.317438 (+109030us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:30.424378 (+106940us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:09:30.431907 (+  7529us) write_op.cc:312] APPLY: finished
0709 13:09:30.456510 (+ 24603us) log.cc:844] Serialized 47 byte log entry
0709 13:09:30.667855 (+211345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:30.684715 (+ 16860us) write_op.cc:454] Released schema lock
0709 13:09:30.688441 (+  3726us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:31.021606 (+333165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:31.053928 (+ 32322us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1040736,"reported_tablets":20,"spinlock_wait_cycles":984960,"child_traces":[["op",{"apply.queue_time_us":535617,"apply.run_cpu_time_us":45054,"apply.run_wall_time_us":1061545,"num_ops":5,"prepare.queue_time_us":166955,"prepare.run_cpu_time_us":30947,"prepare.run_wall_time_us":524652,"raft.queue_time_us":181723,"raft.run_cpu_time_us":29738,"raft.run_wall_time_us":212381,"replication_time_us":753801,"spinlock_wait_cycles":1767168,"thread_start_us":688427,"threads_started":5,"wal-append.queue_time_us":513973,"wal-append.run_cpu_time_us":41852,"wal-append.run_wall_time_us":2828810}]]}
I20260709 13:09:34.216876 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:34.217334 22922 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:09:34.247857 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 61004.4us
I20260709 13:09:34.217578 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:34.218307 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:34.218798 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.879792 25336 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:34.220158 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:34.222115 23000 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:34.225416 25424 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.884392 25317 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:34.260562 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:34.226863 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:33.890625 25226 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:34.199816 23078 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:34.261646 22924 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.235977 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:34.240525 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.237031 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:34.238231 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:33.946497 25380 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.284s
I20260709 13:09:34.242758 22926 raft_consensus.cc:2410] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:34.244675 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.247071 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 609) took 1045 ms. Trace:
I20260709 13:09:34.264477 23006 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:34.264891 23657 rpcz_store.cc:276] 0709 13:09:33.201461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.196219 (+994758us) service_pool.cc:224] Handling call
0709 13:09:34.247017 (+ 50798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.259611 23656 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:34.251305 22925 raft_consensus.cc:1275] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:34.239615 22972 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:34.266001 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 591) took 1513 ms. Trace:
W20260709 13:09:34.234542 22895 connection.cc:256] RPC call timeout handler was delayed by -1.2122706050000716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 13:09:34.266209 22925 pending_rounds.cc:85] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 1
I20260709 13:09:34.258778 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:34.266659 22895 connection.cc:256] RPC call timeout handler was delayed by -1.1816706050000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 13:09:34.251933 23071 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:34.316378 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:34.266521 23656 rpcz_store.cc:276] 0709 13:09:32.752200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.191216 (+1439016us) service_pool.cc:224] Handling call
0709 13:09:34.265933 (+ 74717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.316646 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:34.316164 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 48955.6us
W20260709 13:09:34.319370 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 112974us
I20260709 13:09:34.232928 25408 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:34.242750 23650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 599) took 1483 ms (client timeout 1962 ms). Trace:
W20260709 13:09:34.419549 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.354916 23001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.021s	sys 0.068s
W20260709 13:09:34.387339 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 147760us
W20260709 13:09:34.400261 23074 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.028s	sys 0.071s
I20260709 13:09:34.388968 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:34.355044 23005 raft_consensus.cc:1240] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:34.387473 23073 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:34.394593 22925 pending_rounds.cc:107] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:34.326627 25422 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.305s
I20260709 13:09:34.428045 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:34.232726 23653 rpcz_store.cc:276] 0709 13:09:32.554963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.808054 (+1253091us) service_pool.cc:224] Handling call
0709 13:09:33.876926 (+ 68872us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.343793 25366 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:34.634603 23074 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.049s	sys 0.120s
W20260709 13:09:34.428479 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.636487 25366 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:34.258538 22998 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.324116 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 594) took 1567 ms. Trace:
I20260709 13:09:34.636953 25366 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:34.637543 25366 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.637936 23649 rpcz_store.cc:276] 0709 13:09:32.757021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.175156 (+1418135us) service_pool.cc:224] Handling call
0709 13:09:34.324032 (+148876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.387741 25451 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:34.639951 23657 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:34.638882 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 1982) took 1346 ms. Trace:
I20260709 13:09:34.640154 25451 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:34.316813 22827 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 5, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.382124 25219 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.641544 23649 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:34.641734 23655 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
W20260709 13:09:34.635231 23650 rpcz_store.cc:269] 0709 13:09:32.758926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.701108 (+942182us) service_pool.cc:224] Handling call
0709 13:09:34.241698 (+540590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.579038 22970 leader_election.cc:400] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:34.643699 22827 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 5, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.645037 22970 leader_election.cc:403] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:34.645118 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 607) took 1444 ms. Trace:
I20260709 13:09:34.247859 24895 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6.
I20260709 13:09:34.645469 23653 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:34.328056 25424 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:34.646998 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 585) took 3644 ms. Trace:
I20260709 13:09:34.645826 25453 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:34.645591 23655 rpcz_store.cc:276] 0709 13:09:33.200850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.234069 (+1033219us) service_pool.cc:224] Handling call
0709 13:09:34.644952 (+410883us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400709ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:34.645067 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569173760}
I20260709 13:09:34.502665 23078 raft_consensus.cc:2368] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
W20260709 13:09:34.646895 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 69253.1us
I20260709 13:09:34.640489 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 739) took 2058 ms. Trace:
I20260709 13:09:34.621614 23656 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:34.259521 25409 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.628546 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1969) took 1403 ms. Trace:
I20260709 13:09:34.640513 23074 rpcz_store.cc:276] 0709 13:09:33.292068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.305985 (+ 13917us) service_pool.cc:224] Handling call
0709 13:09:33.343327 (+ 37342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.389942 (+ 46615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.389972 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.585505 (+195533us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.807106 (+221601us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:34.636433 (+829327us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.637604 (+  1171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.637691 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.637738 (+    47us) raft_consensus.cc:1685] finished
0709 13:09:34.637752 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.638785 (+  1033us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18398,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2098,"raft.queue_time_us":3227,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":184,"thread_start_us":1026025,"threads_started":2,"wal-append.queue_time_us":339628}
I20260709 13:09:34.647835 22925 raft_consensus.cc:2889] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:34.562374 25452 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.294s
W20260709 13:09:34.611591 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.656203 23004 rpcz_store.cc:276] 0709 13:09:33.225507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.655307 (+429800us) service_pool.cc:224] Handling call
0709 13:09:33.655559 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.655842 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:34.072420 (+416578us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.628163 (+555743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.628222 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:34.628273 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.628339 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.628482 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":506196,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":7221,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":141,"thread_start_us":861546,"threads_started":2}
W20260709 13:09:34.657656 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 229701us
I20260709 13:09:34.548357 23075 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:34.412216 25019 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.658823 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 582) took 3674 ms. Trace:
I20260709 13:09:34.670092 23656 rpcz_store.cc:276] 0709 13:09:30.980734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.512883 (+3532149us) service_pool.cc:224] Handling call
0709 13:09:34.579504 (+ 66621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.654614 (+ 75110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.654764 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:34.649685 23001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.026s	sys 0.092s
W20260709 13:09:34.428041 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 213661us
W20260709 13:09:34.634858 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 444412us
W20260709 13:09:34.645932 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.636981 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.393072 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:34.652577 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 415560us
I20260709 13:09:34.271411 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 604) took 1065 ms. Trace:
W20260709 13:09:34.632071 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 385134us
I20260709 13:09:34.654438 23657 rpcz_store.cc:276] 0709 13:09:32.582534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.265715 (+1683181us) service_pool.cc:224] Handling call
0709 13:09:34.640434 (+374719us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.825764 25381 rpcz_store.cc:276] 0709 13:09:28.079399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.079548 (+   149us) service_pool.cc:224] Handling call
0709 13:09:28.254106 (+174558us) log.cc:844] Serialized 501 byte log entry
0709 13:09:29.814580 (+1560474us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b180004dc80. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:31.783609 (+1969029us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.199449 (+1415840us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3921f000ac 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b
0709 13:09:33.682567 (+483118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106110,"raft.queue_time_us":163916,"raft.run_cpu_time_us":2025,"raft.run_wall_time_us":212639,"spinlock_wait_cycles":16751744,"thread_start_us":1954093,"threads_started":2,"wal-append.queue_time_us":2195509,"wal-append.run_cpu_time_us":16107,"wal-append.run_wall_time_us":1705183}
I20260709 13:09:34.657196 25459 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:34.657778 22925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2070) took 1028 ms. Trace:
I20260709 13:09:34.682934 22925 rpcz_store.cc:276] 0709 13:09:33.633761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.671718 (+ 37957us) service_pool.cc:224] Handling call
0709 13:09:33.671954 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.657511 (+985557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.657686 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.679116 25019 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:34.685362 25019 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:34.687842 25226 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:34.690083 25317 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:34.691079 25408 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:34.695339 24895 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:34.696741 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.697455 25422 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:34.697860 25422 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:34.698772 25422 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:34.267343 23654 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
W20260709 13:09:34.553049 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 317189us
W20260709 13:09:34.236295 23651 rpcz_store.cc:269] 0709 13:09:32.589952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.643566 (+1053614us) service_pool.cc:224] Handling call
0709 13:09:34.170810 (+527244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.511714 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:34.661482 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 1953) took 1757 ms. Trace:
I20260709 13:09:34.665722 25409 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.703152 23005 rpcz_store.cc:276] 0709 13:09:32.904093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.614978 (+710885us) service_pool.cc:224] Handling call
0709 13:09:33.662510 (+ 47532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.650555 (+988045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.661284 (+ 10729us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b540041f5d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:34.661421 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592275840}
I20260709 13:09:34.667714 22827 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 3, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.386996 25000 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.388006 25275 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:34.400053 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 606) took 1187 ms. Trace:
I20260709 13:09:34.646008 23650 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:34.640712 25451 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.682119 22924 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:34.705243 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 608) took 1500 ms. Trace:
I20260709 13:09:34.709983 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:34.720523 23654 rpcz_store.cc:276] 0709 13:09:33.201169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.232759 (+1031590us) service_pool.cc:224] Handling call
0709 13:09:34.701787 (+469028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.679065 25239 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:34.714239 23072 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:34.717798 23648 rpcz_store.cc:276] 0709 13:09:33.200516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.181461 (+980945us) service_pool.cc:224] Handling call
0709 13:09:34.387579 (+206118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.707993 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:34.653023 23649 rpcz_store.cc:276] 0709 13:09:31.003736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.639669 (+3635933us) service_pool.cc:224] Handling call
0709 13:09:34.640216 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.646687 (+  6471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.646919 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.723290 23046 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:34.723311 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 761) took 3651 ms. Trace:
I20260709 13:09:34.727342 23654 rpcz_store.cc:276] 0709 13:09:31.071625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.722171 (+3650546us) service_pool.cc:224] Handling call
0709 13:09:34.722586 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.722926 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.722969 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.723015 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:34.723060 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.723120 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.723238 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.725345 22972 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:34.723496 25462 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:34.701691 25459 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:34.730509 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0974115459999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:09:34.731065 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0637399040000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 13:09:34.731724 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.691591 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 583) took 3689 ms. Trace:
I20260709 13:09:34.732808 25459 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:34.712118 25409 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.735376 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 757) took 3665 ms. Trace:
I20260709 13:09:34.740163 23657 rpcz_store.cc:276] 0709 13:09:31.070344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.682514 (+3612170us) service_pool.cc:224] Handling call
0709 13:09:34.733169 (+ 50655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.735024 (+  1855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.735057 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.735096 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:34.735164 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.735226 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.735324 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.675129 23652 rpcz_store.cc:276] 0709 13:09:33.199765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.886262 (+686497us) service_pool.cc:224] Handling call
0709 13:09:34.264684 (+378422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.742283 25019 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:34.742762 23046 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:34.742894 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:34.715732 25424 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:34.750175 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.700222 25366 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:34.714010 25275 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:34.760844 23656 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:34.759266 23621 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:34.749251 25453 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
W20260709 13:09:34.767148 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.748581 25019 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.751622 25317 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:34.761441 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 758) took 3690 ms. Trace:
I20260709 13:09:34.752650 25381 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.768690 23656 rpcz_store.cc:276] 0709 13:09:31.070696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.700992 (+3630296us) service_pool.cc:224] Handling call
0709 13:09:34.740568 (+ 39576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.761230 (+ 20662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.761392 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.754395 25275 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.753064 25219 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.754981 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 587) took 3744 ms. Trace:
I20260709 13:09:34.775005 23657 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:34.775753 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 743) took 2191 ms. Trace:
I20260709 13:09:34.775812 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:34.776567 23657 rpcz_store.cc:276] 0709 13:09:32.583964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.748702 (+2164738us) service_pool.cc:224] Handling call
0709 13:09:34.770681 (+ 21979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.775488 (+  4807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.775703 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.774907 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:34.782927 23654 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:34.783483 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 766) took 3710 ms. Trace:
I20260709 13:09:34.783823 23654 rpcz_store.cc:276] 0709 13:09:31.073146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.741680 (+3668534us) service_pool.cc:224] Handling call
0709 13:09:34.760875 (+ 19195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.783279 (+ 22404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.783437 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.769785 25019 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.770860 25424 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:34.769205 25143 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:34.781679 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 68508us
I20260709 13:09:34.790510 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:34.791901 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:34.773162 25381 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:34.796517 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:34.799830 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:34.733542 23653 rpcz_store.cc:276] 0709 13:09:31.002460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.635842 (+3633382us) service_pool.cc:224] Handling call
0709 13:09:34.645174 (+  9332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.646713 (+  1539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.691274 (+ 44561us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b5400709ed0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:34.691440 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20414336}
I20260709 13:09:34.804032 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:35.032044 22999 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
W20260709 13:09:34.861052 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 62057.5us
I20260709 13:09:35.033883 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:34.861143 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 755) took 3850 ms. Trace:
I20260709 13:09:35.034673 23655 rpcz_store.cc:276] 0709 13:09:31.013288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.649269 (+3635981us) service_pool.cc:224] Handling call
0709 13:09:34.701575 (+ 52306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.714419 (+ 12844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.714446 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.714490 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:34.714566 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.714624 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.860926 (+146302us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b54001b8850. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:34.861059 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62349568}
I20260709 13:09:35.036675 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 598) took 2278 ms. Trace:
I20260709 13:09:35.036999 23655 rpcz_store.cc:276] 0709 13:09:32.758655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.035720 (+2277065us) service_pool.cc:224] Handling call
0709 13:09:35.036072 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.036300 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.036326 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:35.036371 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:35.036419 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.036473 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.036579 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.800661 25381 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.893903 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:34.782444 25219 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.038445 23655 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:35.038991 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 605) took 1838 ms. Trace:
I20260709 13:09:35.039278 23655 rpcz_store.cc:276] 0709 13:09:33.200211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.037821 (+1837610us) service_pool.cc:224] Handling call
0709 13:09:35.038096 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.038783 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.038948 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:35.039978 25219 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:34.798986 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:34.894835 25461 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:09:34.967757 25456 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:09:35.018718 25441 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.215s	user 0.000s	sys 0.018s
I20260709 13:09:35.018924 23652 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.041567 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 744) took 2457 ms. Trace:
I20260709 13:09:35.041926 23652 rpcz_store.cc:276] 0709 13:09:32.584286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.759940 (+2175654us) service_pool.cc:224] Handling call
0709 13:09:35.018699 (+258759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.041287 (+ 22588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.041485 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:35.019228 23000 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:34.873492 23651 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:35.043243 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 760) took 3972 ms. Trace:
I20260709 13:09:35.043681 23651 rpcz_store.cc:276] 0709 13:09:31.071308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.714204 (+3642896us) service_pool.cc:224] Handling call
0709 13:09:34.769650 (+ 55446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.042928 (+273278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.043175 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:34.892477 25458 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:35.020661 22971 leader_election.cc:336] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.646s (SENT)
I20260709 13:09:34.872135 25336 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:35.018831 23654 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:35.025121 23648 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:35.028788 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:35.062927 23073 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.860654 25453 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.803807 23077 raft_consensus.cc:2393] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:35.042460 25422 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.044981 24895 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.045926 23656 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:35.081379 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 588) took 2356 ms. Trace:
I20260709 13:09:35.081835 23656 rpcz_store.cc:276] 0709 13:09:32.725436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.782608 (+2057172us) service_pool.cc:224] Handling call
0709 13:09:35.020275 (+237667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.081085 (+ 60810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.081316 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:35.046025 23078 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:34.797168 25317 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.046470 22997 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:34.775334 23650 rpcz_store.cc:276] 0709 13:09:31.004136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.644688 (+3640552us) service_pool.cc:224] Handling call
0709 13:09:34.645773 (+  1085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.724648 (+ 78875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.748972 (+ 24324us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:35.054724 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 252156us
W20260709 13:09:35.052958 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 258180us
I20260709 13:09:35.061304 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 593) took 2304 ms. Trace:
I20260709 13:09:35.031313 23003 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
W20260709 13:09:35.063745 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 262448us
I20260709 13:09:35.088397 25468 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:35.058856 25452 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.156806 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.174108 23655 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:35.113716 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 79919.7us
W20260709 13:09:35.110181 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 322172us
I20260709 13:09:35.090209 23654 rpcz_store.cc:276] 0709 13:09:32.756724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.793085 (+2036361us) service_pool.cc:224] Handling call
0709 13:09:34.880056 (+ 86971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.058872 (+178816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.061249 (+  2377us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:35.101140 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.098246 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.156179 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:35.148034 23045 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.815s (SENT)
I20260709 13:09:35.172757 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.184680 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:35.185464 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1683) took 1918 ms. Trace:
W20260709 13:09:35.192821 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.198340 22998 consensus_meta.cc:287] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.561s	user 0.003s	sys 0.011s
I20260709 13:09:35.176065 25000 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8.
I20260709 13:09:35.100430 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 737) took 3243 ms. Trace:
I20260709 13:09:35.065289 25453 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:35.198747 22998 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:35.198485 25451 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:35.201815 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 53823.4us
I20260709 13:09:35.199165 23046 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:35.203338 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 47246.3us
I20260709 13:09:35.146519 25366 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:35.191665 23001 rpcz_store.cc:276] 0709 13:09:33.258637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.765823 (+507186us) service_pool.cc:224] Handling call
0709 13:09:33.809487 (+ 43664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.671882 (+862395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.671927 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.680218 (+  8291us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.764190 (+ 83972us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:34.764223 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.764364 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.176551 (+412187us) raft_consensus.cc:1685] finished
0709 13:09:35.176568 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.176699 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119157,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":185,"thread_start_us":874643,"threads_started":2,"wal-append.queue_time_us":90486}
I20260709 13:09:35.173269 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:35.215862 23045 leader_election.cc:336] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.938s (SENT)
I20260709 13:09:35.216223 23653 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:35.216393 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:35.217640 23653 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:35.207448 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.219954 25000 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.224143 25451 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:35.225102 23005 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:35.045428 25381 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.174789 25275 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.227392 25381 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.228075 25275 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:35.228696 25381 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:35.229107 22998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 546) took 1055 ms. Trace:
I20260709 13:09:35.173019 25019 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.215866 25462 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.231360 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.232121 25019 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.232583 23656 raft_consensus.cc:2393] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 2: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:35.232863 25019 raft_consensus.cc:3055] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:35.233366 25019 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:35.234453 25019 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:35.236311 22816 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 590119d9a7e74f099c0a28550f4fb3f5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:09:35.237728 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 43615.2us
I20260709 13:09:35.241708 23046 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.242848 25366 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:35.243359 25366 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.243793 25366 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.206017 25452 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.246863 25452 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.229636 22998 rpcz_store.cc:276] 0709 13:09:34.173524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.204143 (+ 30619us) service_pool.cc:224] Handling call
0709 13:09:35.229025 (+1024882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:35.210983 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.210407 25453 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.088863 24895 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.103605 25336 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:35.090719 25317 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.202394 25455 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.281805 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:35.289955 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.298502 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:35.299906 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:35.200191 25219 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 13:09:35.298437 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 80942.8us
I20260709 13:09:35.307340 23004 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:35.304977 22972 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:35.309289 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 246630us
I20260709 13:09:35.316612 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:35.318153 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:35.319785 25469 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:35.320447 24895 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.323844 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.324016 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.324756 23071 raft_consensus.cc:2410] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:35.325709 23652 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:35.329130 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:35.309639 25409 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.007s
I20260709 13:09:35.330361 25409 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.330721 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.205974 23648 rpcz_store.cc:276] 0709 13:09:31.856814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.748657 (+2891843us) service_pool.cc:224] Handling call
0709 13:09:35.024677 (+276020us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:35.024885 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.065744 (+ 40859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.090516 (+ 24772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4146560}
I20260709 13:09:35.332000 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.332201 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.332456 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.332630 23653 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
W20260709 13:09:35.309850 25459 consensus_meta.cc:287] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.004s
I20260709 13:09:35.333401 23655 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:35.333575 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:35.333772 25459 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:35.334250 23653 raft_consensus.cc:2376] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4. Re-sending same reply.
I20260709 13:09:35.337050 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:35.342080 25366 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:35.343793 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 46827.5us
I20260709 13:09:35.343909 25451 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.344367 25451 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.344496 22972 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:35.344753 25451 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.344923 25317 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.345517 25469 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:35.346530 25474 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:35.346587 25476 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:35.347337 25459 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:35.349674 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:35.346520 25469 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.350100 23072 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:35.351730 25455 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.352149 25455 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:35.348335 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:35.348822 25460 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.349682 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.356408 23073 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
W20260709 13:09:35.369445 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 58477.6us
I20260709 13:09:35.369717 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.352507 25455 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.353376 22972 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:35.358421 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 48533.7us
W20260709 13:09:35.373448 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 352842us
I20260709 13:09:35.374560 25459 consensus_queue.cc:1059] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:35.370469 25460 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:35.381265 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 280614us
W20260709 13:09:35.381827 22971 leader_election.cc:336] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.602s (SENT)
I20260709 13:09:35.382588 22972 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:35.384131 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.352672 23651 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:35.345526 25317 raft_consensus.cc:2764] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:35.346673 25409 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:35.390609 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.391016 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:35.368682 25275 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.394662 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:35.396085 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 78154.2us
I20260709 13:09:35.395550 25409 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:09:35.399036 25226 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.399573 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:35.396370 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 741) took 2805 ms. Trace:
I20260709 13:09:35.383852 25472 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.381628 25468 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.404428 22925 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:35.406884 23622 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:35.383522 23071 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:35.407807 25366 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.408185 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:35.409011 23005 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:35.408900 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.409859 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.411108 25460 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.411804 25476 raft_consensus.cc:2764] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:35.411944 25422 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:35.412382 25422 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:35.412134 25336 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.412992 25476 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:35.413196 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:35.413738 22923 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.414359 25473 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.412777 25422 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.388635 25470 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.415884 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.417526 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:35.417760 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.423632 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:35.416646 22970 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.421948 22924 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:35.421993 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:35.426816 23657 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:35.420912 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:35.429121 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:35.432780 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:35.433034 22929 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:35.437196 22927 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:35.403672 25468 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:35.428694 22971 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.806s (SENT)
I20260709 13:09:35.437129 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:35.442771 22972 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:35.438684 22925 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:35.436777 25317 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:35.450296 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:35.442040 25489 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:35.421502 25472 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:35.449501 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.453516 25490 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.454008 25489 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.460430 25495 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:09:35.452580 25497 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:09:35.430053 25460 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:35.432297 22998 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.421295 25452 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:09:35.450748 25459 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:35.442397 23071 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:35.473104 25458 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:35.473132 25478 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:35.442663 25473 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:35.470914 25489 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:35.455236 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.506047 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:35.484726 25490 raft_consensus.cc:697] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:35.486799 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:35.487123 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:35.442703 25468 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.452294 25317 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:35.495023 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 66339.6us
I20260709 13:09:35.486831 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:35.517040 23000 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:35.463037 25470 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.500174 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:35.512722 22999 raft_consensus.cc:2376] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9. Re-sending same reply.
I20260709 13:09:35.521525 23006 raft_consensus.cc:2393] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:35.520182 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.522439 23077 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:35.523483 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.524595 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:35.524662 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.525969 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:35.518181 22971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.814s (SENT) [suppressed 76 similar messages]
I20260709 13:09:35.533566 23080 raft_consensus.cc:1240] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:35.515694 25492 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:09:35.536177 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:35.536703 25488 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.246s	user 0.002s	sys 0.001s
W20260709 13:09:35.536854 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 130101us
I20260709 13:09:35.537561 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:35.537701 25494 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:35.538519 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:35.538298 25494 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:35.539804 25239 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:35.540498 25239 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:35.540573 25494 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:35.540905 25239 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.541333 25239 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:35.541841 25486 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.248s	user 0.002s	sys 0.000s
I20260709 13:09:35.524828 25458 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:35.551111 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.539361 23622 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:35.564636 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.503202 25226 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:35.567443 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.521760 25317 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.570906 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:35.575798 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:35.541445 25494 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:09:35.502043 25459 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:35.521207 25470 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:35.575307 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 173263us
I20260709 13:09:35.576376 22929 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.543161 25455 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.576036 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:35.581209 25366 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:35.602451 25366 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.602874 25366 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.608491 25496 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.609023 25496 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:35.611083 25496 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:35.582127 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:35.612937 22928 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:35.576030 25473 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:35.578590 25408 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:35.583120 25470 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.621341 23075 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:35.595712 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:35.638585 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 59696.4us
I20260709 13:09:35.640466 25491 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.640829 25459 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:35.640981 25491 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:35.598212 25451 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.641889 25491 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.645984 25490 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.647886 25458 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:35.648604 25481 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.363s	user 0.003s	sys 0.001s
W20260709 13:09:35.663470 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 67846.3us
I20260709 13:09:35.637564 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:35.629541 25473 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.634603 25408 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.666774 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:35.673084 22971 leader_election.cc:336] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.920s (SENT)
I20260709 13:09:35.674491 22971 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:35.672420 25473 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.402318 23649 rpcz_store.cc:276] 0709 13:09:32.583309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.741647 (+2158338us) service_pool.cc:224] Handling call
0709 13:09:34.787883 (+ 46236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.066301 (+278418us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:35.074233 (+  7932us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.198072 (+123839us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.310025 (+111953us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:35.310789 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.369948 (+ 59159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.371718 (+  1770us) raft_consensus.cc:1685] finished
0709 13:09:35.382641 (+ 10923us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.388529 (+  5888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9285,"raft.queue_time_us":148456,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3753,"thread_start_us":102896,"threads_started":1,"wal-append.queue_time_us":113595}
I20260709 13:09:35.676048 25408 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:35.725973 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 46851.9us
I20260709 13:09:35.734890 22923 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:35.735549 22928 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:35.736464 22972 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:09:35.737514 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 64457.3us
W20260709 13:09:35.738469 22971 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.934s (SENT)
I20260709 13:09:35.738832 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:35.739917 25500 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:35.740475 25500 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:35.741430 25500 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:35.749377 22922 pending_rounds.cc:85] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 2
I20260709 13:09:35.749655 22922 pending_rounds.cc:107] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:35.749874 22922 raft_consensus.cc:2889] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:35.756322 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.673921 25459 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:09:35.764494 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 133320us
I20260709 13:09:35.765775 22929 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
W20260709 13:09:35.751600 23045 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.204s (SENT)
I20260709 13:09:35.768764 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:35.726619 25478 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.775332 23622 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:35.765158 25366 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.637140 25472 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.820029 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 589) took 3088 ms. Trace:
W20260709 13:09:35.824817 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 54412.9us
I20260709 13:09:35.820133 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 1992) took 1053 ms. Trace:
I20260709 13:09:35.825474 23074 rpcz_store.cc:276] 0709 13:09:34.766924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.767050 (+   126us) service_pool.cc:224] Handling call
0709 13:09:34.777005 (+  9955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.044458 (+267453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.044495 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.045070 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.182603 (+137533us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:35.182667 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.818765 (+636098us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54003bae54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:35.819814 (+  1049us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.819854 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:35.819865 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.820064 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68947,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":54324,"spinlock_wait_cycles":266618240,"thread_start_us":115805,"threads_started":1,"wal-append.queue_time_us":166646}
I20260709 13:09:35.824492 23657 rpcz_store.cc:276] 0709 13:09:32.731873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.781405 (+2049532us) service_pool.cc:224] Handling call
0709 13:09:35.029406 (+248001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.427202 (+397796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.812490 (+385288us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400646ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:35.819953 (+  7463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913550208}
W20260709 13:09:35.822222 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 83781.6us
I20260709 13:09:35.751940 25494 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:35.832957 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57741.3us
W20260709 13:09:35.835055 22895 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.513s (SENT)
I20260709 13:09:35.728395 25505 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:35.764693 25460 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.836078 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:35.842842 25502 log.cc:927] Time spent T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:09:35.842803 25480 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:35.851929 25510 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:09:35.852841 25460 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:35.773502 25496 consensus_queue.cc:1059] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:09:35.842501 25511 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:35.861013 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.680483 25226 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:35.831980 24895 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:35.872131 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 192225us
W20260709 13:09:35.882187 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 51523.1us
I20260709 13:09:35.948277 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1692) took 1151 ms. Trace:
I20260709 13:09:35.836810 25494 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:36.097349 23004 rpcz_store.cc:276] 0709 13:09:34.796890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.814729 (+ 17839us) service_pool.cc:224] Handling call
0709 13:09:35.948075 (+1133346us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54002e6154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:35.948204 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618642688}
I20260709 13:09:35.937707 22999 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:36.102588 22971 leader_election.cc:336] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.004s (SENT)
I20260709 13:09:36.136154 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:36.089198 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 319022us
I20260709 13:09:35.836299 25476 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:35.903903 25515 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:09:36.066845 23005 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:09:36.140829 22896 connection.cc:256] RPC call timeout handler was delayed by -1.9176687799999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:09:36.136370 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.155329 23079 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:36.137425 23620 connection.cc:256] RPC call timeout handler was delayed by -1.9198024779999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 13:09:35.925452 25453 consensus_meta.cc:287] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.002s
W20260709 13:09:36.112751 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 277707us
I20260709 13:09:35.958235 22998 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:36.168664 23002 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:36.130728 25019 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:36.129542 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 377945us
I20260709 13:09:35.872298 23650 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:36.157711 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 323948us
W20260709 13:09:36.160463 25519 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:09:35.902539 25487 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.584s	user 0.011s	sys 0.004s
I20260709 13:09:36.166687 23004 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:36.183090 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:35.902660 25366 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.927098 25409 raft_consensus.cc:3055] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:36.199873 25409 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:36.200253 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:35.920084 25317 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.200969 23002 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:36.200718 25409 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.201782 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:36.136888 25494 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.202561 25317 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:36.202854 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:36.203608 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:36.204291 23004 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:35.875303 25422 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.208499 25422 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:36.170975 25336 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:35.927373 25473 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.172340 25509 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.879709 25470 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:36.172720 25497 raft_consensus.cc:3055] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:36.172880 25408 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:36.174981 23620 connection.cc:256] RPC call timeout handler was delayed by -1.8928024780000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:09:36.231685 23620 connection.cc:256] RPC call timeout handler was delayed by -1.8703024779999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 13:09:36.100584 25455 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:35.902668 25501 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:35.899745 25460 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:36.235275 25501 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.220997 25462 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:09:36.236636 25462 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:36.236999 25462 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:36.176250 25451 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:36.177129 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 79398.6us
I20260709 13:09:36.176996 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:36.177798 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:36.180190 23621 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:36.188077 25514 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:36.179248 25453 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.168376 25377 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:36.201900 25409 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:36.154978 22896 connection.cc:256] RPC call timeout handler was delayed by -1.8924687799999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 13:09:36.140429 25476 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:36.203579 23002 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:35.903219 25239 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.220548 25366 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:09:36.215838 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:36.207506 25513 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.443s	user 0.005s	sys 0.000s
I20260709 13:09:35.930891 25489 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.004328 25468 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:36.223548 23045 leader_election.cc:336] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.189s (SENT)
I20260709 13:09:36.229663 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:36.232095 23620 connection.cc:256] RPC call timeout handler was delayed by -1.7371024779999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 13:09:36.238193 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:36.609603 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.645725 23078 raft_consensus.cc:2393] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:36.229633 25422 consensus_queue.cc:1059] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.417s
I20260709 13:09:36.647666 25422 consensus_queue.cc:1243] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:36.231592 25497 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:36.287352 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:36.700640 22999 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.424094 23000 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:36.300280 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 132741us
I20260709 13:09:36.649497 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:36.702225 23045 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:36.702425 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.286922 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:36.676497 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.701901 23072 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.246410 22924 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:09:36.238070 22971 leader_election.cc:336] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.040s (SENT)
I20260709 13:09:36.706063 22924 pending_rounds.cc:85] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 1
W20260709 13:09:36.701530 23620 connection.cc:256] RPC call timeout handler was delayed by -1.6714024780000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
I20260709 13:09:36.706461 22924 pending_rounds.cc:107] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:09:36.703274 22896 connection.cc:256] RPC call timeout handler was delayed by -1.8906687799999418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 13:09:36.706575 23620 connection.cc:256] RPC call timeout handler was delayed by -1.4968024779999496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:09:36.706804 22924 raft_consensus.cc:2889] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.658169 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:36.707238 23620 connection.cc:256] RPC call timeout handler was delayed by -1.3204024780000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2412s for a response
I20260709 13:09:36.650913 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.707710 22929 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:36.707748 23620 connection.cc:256] RPC call timeout handler was delayed by -1.3168024779999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2416s for a response
I20260709 13:09:36.650568 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.650259 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:36.708381 23620 connection.cc:256] RPC call timeout handler was delayed by -1.2862024779999501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24500000000000002s for a response
I20260709 13:09:36.671599 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:36.709095 23620 connection.cc:256] RPC call timeout handler was delayed by -1.2547024780000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2485s for a response
I20260709 13:09:36.286899 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.709510 23078 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:36.649427 23004 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:36.657086 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1711) took 1167 ms. Trace:
I20260709 13:09:36.711407 25239 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:36.712240 25377 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:36.724128 25377 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:36.725173 25377 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.726449 25377 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:36.713901 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.728039 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 504467us
W20260709 13:09:36.729786 22895 leader_election.cc:336] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.547s (SENT)
I20260709 13:09:36.730307 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:36.730670 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.731101 25019 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:36.732141 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.733073 25478 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.733517 23656 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:36.733541 25478 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:36.739589 25478 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:36.741909 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:36.699955 25408 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:36.703581 23079 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:36.715121 22922 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:09:36.709199 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.701591 25528 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.373s	user 0.001s	sys 0.001s
I20260709 13:09:36.719017 25336 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:36.719185 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.294142 25470 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:36.653445 25501 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:36.238735 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:36.720199 23654 raft_consensus.cc:2368] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8.
W20260709 13:09:36.720796 22896 connection.cc:256] RPC call timeout handler was delayed by -1.7052687799999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260709 13:09:36.295516 25473 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:36.230705 25491 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.482s
W20260709 13:09:36.714172 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 534182us
W20260709 13:09:36.765455 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.643788 23650 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:09:36.713883 22928 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:36.766770 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:36.766979 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.767195 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.767457 22928 raft_consensus.cc:2368] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4.
I20260709 13:09:36.711336 25489 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:36.727615 22924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1704) took 1295 ms. Trace:
I20260709 13:09:36.715384 22923 rpcz_store.cc:276] 0709 13:09:35.489377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.764340 (+274963us) service_pool.cc:224] Handling call
0709 13:09:35.821220 (+ 56880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.868164 (+ 46944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.868199 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.874769 (+  6570us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.130147 (+255378us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:36.130191 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.130266 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.656836 (+526570us) raft_consensus.cc:1685] finished
0709 13:09:36.656866 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.657017 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33113,"raft.queue_time_us":53894,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":24039,"thread_start_us":182934,"threads_started":1,"wal-append.queue_time_us":774086}
I20260709 13:09:36.747426 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:36.769279 22926 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:36.768513 22924 rpcz_store.cc:276] 0709 13:09:35.432044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.436908 (+  4864us) service_pool.cc:224] Handling call
0709 13:09:35.454928 (+ 18020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.718796 (+1263868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.727372 (+  8576us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54000ce9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:36.727536 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819412352}
W20260709 13:09:36.748265 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 510211us
I20260709 13:09:36.750571 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:36.226048 25494 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:36.770702 22925 raft_consensus.cc:2376] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3. Re-sending same reply.
I20260709 13:09:36.751194 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:36.709759 23073 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:36.771685 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2030) took 1204 ms. Trace:
I20260709 13:09:36.753304 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:36.754829 23001 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:36.697809 25422 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.756225 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.761111 25336 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:36.756680 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.774963 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.651305 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.775486 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:36.758354 22896 connection.cc:256] RPC call timeout handler was delayed by -1.695368779999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 13:09:36.762683 25458 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.760612 23657 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:36.784966 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:36.763630 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.764182 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:36.782382 22929 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:36.785781 23078 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.772035 23079 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:36.774224 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:36.774483 22925 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:36.772444 23075 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.231762 25509 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.778070 23622 leader_election.cc:400] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4.
I20260709 13:09:36.772042 23073 rpcz_store.cc:276] 0709 13:09:35.566871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.221072 (+654201us) service_pool.cc:224] Handling call
0709 13:09:36.771618 (+550546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:36.757460 22999 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:09:36.779132 22896 connection.cc:256] RPC call timeout handler was delayed by -1.6350687799999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 13:09:36.788200 22896 connection.cc:256] RPC call timeout handler was delayed by -1.6260687799999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:09:36.788564 22896 connection.cc:256] RPC call timeout handler was delayed by -1.5549687799999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 13:09:36.788906 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.765880 22998 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:36.789248 22896 connection.cc:256] RPC call timeout handler was delayed by -1.5177798250000478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:09:36.789680 22896 connection.cc:256] RPC call timeout handler was delayed by -1.4649687799999356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 13:09:36.789955 22896 connection.cc:256] RPC call timeout handler was delayed by -1.4163687799999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:09:36.790210 22896 connection.cc:256] RPC call timeout handler was delayed by -1.3440798249999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 13:09:36.790567 22927 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:36.721588 25468 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:36.783131 23655 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:36.786700 23656 raft_consensus.cc:2376] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3. Re-sending same reply.
I20260709 13:09:36.784257 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.787837 23077 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:36.767822 25490 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:36.791517 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:36.796432 22923 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.796698 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.787979 23622 leader_election.cc:403] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:36.797300 23657 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:36.797914 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:36.798797 22896 connection.cc:256] RPC call timeout handler was delayed by -1.2900798250000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:09:36.799281 22896 connection.cc:256] RPC call timeout handler was delayed by -1.1226798249999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:09:36.800535 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.773308 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.772143 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:36.801685 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.802611 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:36.804235 22930 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:36.805872 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.783833 25491 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:36.808421 23656 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:36.783967 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.811097 22929 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.809188 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:36.779183 23650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 747) took 1618 ms (client timeout 2044 ms). Trace:
I20260709 13:09:36.810470 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:36.817276 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.820295 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:36.821202 23073 raft_consensus.cc:2368] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:36.822016 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.856360 23075 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:36.773456 25422 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.819065 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:36.884806 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 84973.7us
W20260709 13:09:36.904987 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 127037us
I20260709 13:09:36.800853 25523 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.931383 23622 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:36.933265 25019 raft_consensus.cc:2764] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:36.939927 25019 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.940380 25019 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:36.944219 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.800482 25490 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.811544 25470 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.173s
I20260709 13:09:36.819525 25336 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.802243 25476 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:36.959107 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.098299 23657 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:36.944981 23656 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
W20260709 13:09:37.064210 23654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 757) took 1754 ms (client timeout 2189 ms). Trace:
W20260709 13:09:36.982844 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 44686.1us
W20260709 13:09:37.099861 23654 rpcz_store.cc:269] 0709 13:09:35.309493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.309647 (+   154us) service_pool.cc:224] Handling call
0709 13:09:37.063970 (+1754323us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54006ed054. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:37.064139 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3209411456}
I20260709 13:09:37.096791 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.102298 23655 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:37.095775 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:36.935501 25143 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.188s
I20260709 13:09:36.981909 23648 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:37.044358 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:36.983126 23002 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:37.110821 22998 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:36.954016 25523 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.116631 25523 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.018554 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:37.118970 25490 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:37.119549 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 101072us
I20260709 13:09:37.048753 25497 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:37.120451 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.130437 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.042430 24895 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:37.150416 24895 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:37.151506 24895 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.152460 23652 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:37.152850 24895 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.157199 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:37.158463 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:37.159024 23076 raft_consensus.cc:2376] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8. Re-sending same reply.
I20260709 13:09:36.868263 25491 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:36.923605 23649 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
W20260709 13:09:37.126986 23003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 550) took 1733 ms (client timeout 1568 ms). Trace:
I20260709 13:09:37.134387 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 549) took 1740 ms. Trace:
I20260709 13:09:37.163849 23001 rpcz_store.cc:276] 0709 13:09:35.393600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.393716 (+   116us) service_pool.cc:224] Handling call
0709 13:09:35.393992 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.772653 (+1378661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.134136 (+361483us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000ef1d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:37.134330 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3129210240}
I20260709 13:09:37.121196 25497 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.168116 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:37.140954 22895 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.638s (SENT)
I20260709 13:09:37.058282 25422 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.169880 25422 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:37.059549 25453 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.144280 25476 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.059190 25509 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.061232 25494 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:37.148307 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.148115 25462 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.149487 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.151978 23654 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:37.121717 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:37.163163 23003 rpcz_store.cc:269] 0709 13:09:35.393884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.394348 (+   464us) service_pool.cc:224] Handling call
0709 13:09:37.126807 (+1732459us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54000c80d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:37.126926 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3730900352}
I20260709 13:09:37.138437 23657 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.192840 25377 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:37.208361 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.198715 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.199488 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.199734 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.210129 23079 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:37.211032 23074 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:37.128816 25523 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:37.204129 22924 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:37.217007 22924 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:37.204965 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:37.211491 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 89860.5us
I20260709 13:09:37.218070 23076 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:37.213152 23656 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:36.814280 23650 rpcz_store.cc:269] 0709 13:09:35.154517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.179564 (+ 25047us) service_pool.cc:224] Handling call
0709 13:09:35.811808 (+632244us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:36.771357 (+959549us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4447616}
I20260709 13:09:37.166278 25473 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:37.202164 25451 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:37.226996 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:37.031970 25408 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.176s
I20260709 13:09:37.171774 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.238418 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 552) took 1329 ms. Trace:
I20260709 13:09:37.229949 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:37.231208 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.232668 23079 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:37.234637 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.200489 25478 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.229121 25143 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:37.240723 23654 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:37.256260 22929 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
W20260709 13:09:37.257675 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.222851 25523 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:37.241039 22924 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:37.250697 22827 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 371) took 10309 ms. Trace:
I20260709 13:09:37.260854 22924 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.261507 22923 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:37.241142 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 100245us
W20260709 13:09:37.262585 22895 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.666s (SENT)
W20260709 13:09:37.263685 22895 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.668s (SENT)
I20260709 13:09:37.264184 22895 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.266513 25409 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:36.937428 25539 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.238050 25470 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.233398 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.239910 23006 rpcz_store.cc:276] 0709 13:09:35.908844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.923082 (+ 14238us) service_pool.cc:224] Handling call
0709 13:09:35.924417 (+  1335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:35.924781 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.924807 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.730358 (+805551us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b2c000af478. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3923903a11 00007f3923913372 00007f3925045a01 00007f392500a43a 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2
0709 13:09:36.730718 (+   360us) log.cc:844] Serialized 52 byte log entry
0709 13:09:36.954379 (+223661us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:37.187347 (+232968us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.231220 (+ 43873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.231296 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.231338 (+    42us) raft_consensus.cc:1685] finished
0709 13:09:37.238221 (+  6883us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.238361 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42353,"prepare.queue_time_us":283905,"raft.queue_time_us":42819,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":11968,"spinlock_wait_cycles":17993984,"thread_start_us":420794,"threads_started":2,"wal-append.queue_time_us":385163}
I20260709 13:09:37.241609 25408 consensus_queue.cc:1243] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:37.238797 25462 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:37.268735 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 286593us
W20260709 13:09:37.281750 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 111221us
I20260709 13:09:37.256523 25455 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:37.254755 25422 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:37.261029 22827 rpcz_store.cc:276] 0709 13:09:26.925037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.925625 (+   588us) service_pool.cc:224] Handling call
0709 13:09:37.233987 (+10308362us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:34.789441 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:34.790150 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:34.790195 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:09:34.790213 (+    18us) tablet.cc:662] Decoding operations
0709 13:09:34.790797 (+   584us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:34.791805 (+  1008us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:34.791834 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:34.792256 (+   422us) tablet.cc:701] Row locks acquired
0709 13:09:34.792304 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:09:34.792450 (+   146us) write_op.cc:270] Start()
0709 13:09:34.792591 (+   141us) write_op.cc:276] Timestamp: P: 1783602574792390 usec, L: 0
0709 13:09:34.792613 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:34.893342 (+100729us) log.cc:844] Serialized 1307 byte log entry
0709 13:09:35.418800 (+525458us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b1800246160. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921eeb2a6 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db
0709 13:09:35.579530 (+160730us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:36.137373 (+557843us) op_driver.cc:464] REPLICATION: finished
0709 13:09:36.311993 (+174620us) write_op.cc:301] APPLY: starting
0709 13:09:36.312081 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:36.312233 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:36.312277 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:36.384246 (+ 71969us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:36.384565 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:09:36.384622 (+    57us) write_op.cc:312] APPLY: finished
0709 13:09:36.384937 (+   315us) log.cc:844] Serialized 35 byte log entry
0709 13:09:36.385148 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.385233 (+    85us) write_op.cc:454] Released schema lock
0709 13:09:36.385295 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:36.385739 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.385775 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28640,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":154388,"apply.run_cpu_time_us":2620,"apply.run_wall_time_us":73724,"num_ops":3,"prepare.queue_time_us":66128,"prepare.run_cpu_time_us":47952,"prepare.run_wall_time_us":521389,"raft.queue_time_us":312565,"raft.run_cpu_time_us":5330,"raft.run_wall_time_us":123041,"replication_time_us":1301660,"spinlock_wait_cycles":25305856,"thread_start_us":390908,"threads_started":4,"wal-append.queue_time_us":265597}]]}
I20260709 13:09:37.237828 25494 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:37.375739 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.376119 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:37.378013 23078 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:37.374063 23071 raft_consensus.cc:2368] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7.
I20260709 13:09:37.257050 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.255470 25548 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.269183 25523 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:37.401412 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 137764us
I20260709 13:09:37.268600 25509 raft_consensus.cc:2764] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:37.404621 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:37.252025 25473 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.435220 22924 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:09:37.436020 25366 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.418190 25422 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:37.436523 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.259615 25143 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:37.381181 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:37.440183 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.466957 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.467451 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.469832 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:37.470350 22895 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.549s (SENT)
I20260709 13:09:37.257345 25478 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.417986 25377 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.447992 22924 pending_rounds.cc:85] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 2
I20260709 13:09:37.417752 25336 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:37.416455 25540 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:37.272761 25451 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:37.447949 23620 connection.cc:256] RPC call timeout handler was delayed by -2.091001537000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3045s for a response
W20260709 13:09:37.453715 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 183706us
I20260709 13:09:37.471828 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:37.440788 25409 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:37.451071 23651 raft_consensus.cc:2410] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:37.478247 22924 pending_rounds.cc:107] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:37.482559 22924 raft_consensus.cc:2889] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:37.484112 22895 leader_election.cc:336] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.596s (SENT)
W20260709 13:09:37.496711 22895 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.802s (SENT)
I20260709 13:09:37.497169 22895 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.492268 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:37.503571 23657 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:37.507967 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:37.460628 25366 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:37.511085 25366 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:37.511925 25558 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:37.512290 25553 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:09:37.512423 24895 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:37.512571 25558 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:37.513105 24895 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:37.488024 25336 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.513721 25558 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.514185 24895 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.516675 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:37.517602 23072 consensus_meta.cc:287] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.803s	user 0.004s	sys 0.004s
I20260709 13:09:37.518119 23072 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:37.504532 23648 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:37.491291 25451 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:37.478227 25468 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:37.488886 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.483145 25409 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:37.530135 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:37.522967 23072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2012) took 1304 ms (client timeout 1720 ms). Trace:
I20260709 13:09:37.482753 25555 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:37.501282 25548 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:37.544235 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 93582.8us
I20260709 13:09:37.521142 23046 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:37.519481 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 356419us
I20260709 13:09:37.548023 23657 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:37.547379 23072 rpcz_store.cc:269] 0709 13:09:36.214408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.215074 (+   666us) service_pool.cc:224] Handling call
0709 13:09:37.518726 (+1303652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:37.512313 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.515434 25336 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:37.550058 22971 leader_election.cc:336] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.688s (SENT)
W20260709 13:09:37.550601 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0616356749999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:09:37.495827 25377 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:37.559494 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 89743.7us
I20260709 13:09:37.523873 25366 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:37.519230 25541 raft_consensus.cc:2764] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:37.562229 23657 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:09:37.570056 22971 leader_election.cc:336] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.695s (SENT)
I20260709 13:09:37.574138 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:37.574671 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.487965 25540 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.519132 25494 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:09:37.581141 22922 consensus_meta.cc:287] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.002s
I20260709 13:09:37.548658 25409 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.548830 25548 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:37.589020 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.592712 23657 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:37.565582 23650 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.589260 22922 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:37.590202 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 93514.3us
W20260709 13:09:37.599007 22895 leader_election.cc:336] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.885s (SENT)
I20260709 13:09:37.599507 22895 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:37.601660 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 126376us
W20260709 13:09:37.590384 22971 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.715s (SENT)
I20260709 13:09:37.605090 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:37.604550 25569 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:37.578670 25491 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.570938 25567 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:37.612653 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 71633.2us
I20260709 13:09:37.521136 25422 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.614670 25574 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.571754 25336 consensus_queue.cc:1059] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:09:37.597770 25548 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.574060 25366 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.562786 25555 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.612046 25567 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:37.629722 25552 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:09:37.631448 25562 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:37.619529 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:37.646389 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47414.8us
I20260709 13:09:37.619582 25568 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:09:37.636024 25572 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:09:37.664256 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 94590.4us
I20260709 13:09:37.656797 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.647928 25567 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.662262 25562 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:37.673341 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.680752 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.661386 25473 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:37.678557 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.683883 23657 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.682447 23650 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:37.686308 25453 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.686790 25453 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:37.692072 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.694938 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.695477 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.696327 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.697461 23650 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:37.671723 25143 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:37.635815 25574 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:09:37.694134 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:37.699512 25577 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.699836 25570 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:09:37.701435 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:37.666428 23648 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:37.683835 25562 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.710103 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.710980 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.714838 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:37.716382 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:37.717413 22997 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.717779 25336 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:37.718906 23005 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:09:37.720904 25560 log.cc:927] Time spent T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:09:37.723907 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:37.724133 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 133760us
W20260709 13:09:37.758517 22971 leader_election.cc:336] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.848s (SENT)
I20260709 13:09:37.758983 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.724648 25019 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:37.724601 25511 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:37.725770 25409 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.708266 23657 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:37.731904 25556 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.733213 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:37.710901 25472 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:09:37.740299 23653 consensus_meta.cc:287] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.822s	user 0.003s	sys 0.006s
I20260709 13:09:37.757023 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.735618 25539 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4.
I20260709 13:09:37.743722 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.788431 23656 raft_consensus.cc:2376] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5. Re-sending same reply.
I20260709 13:09:37.709299 25478 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.745460 22825 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 5 to 8, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:37.791846 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 270771us
I20260709 13:09:37.756748 25336 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:37.740877 25540 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:37.746906 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 52851.5us
I20260709 13:09:37.794893 22825 catalog_manager.cc:5697] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 3, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.799408 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.783522 25514 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:37.798861 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 65751.5us
I20260709 13:09:37.806447 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:37.800788 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.798523 22825 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 5, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 5 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.807540 23650 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
W20260709 13:09:37.808947 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50465.9us
I20260709 13:09:37.808611 22825 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 3, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:37.809773 22971 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.701s (SENT)
I20260709 13:09:37.811194 22825 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 3 to 5, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 5 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:37.814332 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 119759us
I20260709 13:09:37.787915 25019 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:37.788127 23653 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:37.818776 22825 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 6, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 6 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:37.821379 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:37.824896 22971 leader_election.cc:336] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.755s (SENT)
W20260709 13:09:37.825690 22971 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.779s (SENT)
I20260709 13:09:37.825016 22825 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 6 to 7, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 7 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.826087 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:37.805526 25451 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.796895 25581 raft_consensus.cc:2764] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:09:37.805285 25511 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.830914 22825 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.831569 25587 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.746714 25577 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:37.832074 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 122034us
I20260709 13:09:37.798445 23046 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:37.835208 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:37.840368 22925 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.820020 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:37.841370 23620 connection.cc:256] RPC call timeout handler was delayed by -1.4982944860000771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3024s for a response
I20260709 13:09:37.840579 22825 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 3, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.843359 23001 raft_consensus.cc:1240] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:37.824245 25574 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.845746 23656 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:37.819684 25514 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:37.856197 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:37.857110 23004 raft_consensus.cc:2410] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:09:37.858323 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 60229.3us
I20260709 13:09:37.859683 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:37.827828 25239 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:37.811168 25468 consensus_queue.cc:1059] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:09:37.860610 22895 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.800017 25455 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:37.864015 22931 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:37.814349 25576 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:37.868558 22999 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:09:37.866869 23045 leader_election.cc:336] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.960s (SENT)
W20260709 13:09:37.870249 23045 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.006s (SENT)
I20260709 13:09:37.871610 23046 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:37.873157 22970 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:37.832413 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 783) took 1078 ms. Trace:
I20260709 13:09:37.876736 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:37.865296 22825 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 3 to 4, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 4 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.830677 23650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:37.881175 25555 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.881367 23650 raft_consensus.cc:606] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.881770 23650 raft_consensus.cc:614] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:37.881737 25555 consensus_queue.cc:1059] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:37.882936 25555 raft_consensus.cc:3055] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:37.882963 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.883906 25588 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:37.884541 25409 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:37.841281 25451 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:37.890172 25451 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:37.891819 25574 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:37.875768 25336 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.892139 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.892694 25584 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:09:37.893178 25497 consensus_meta.cc:287] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.721s	user 0.004s	sys 0.006s
I20260709 13:09:37.893759 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 782) took 1143 ms. Trace:
I20260709 13:09:37.893905 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.867857 25557 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:37.883541 25476 consensus_meta.cc:287] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.000s
I20260709 13:09:37.894774 25557 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:37.894915 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.895222 25557 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.896027 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2050) took 1085 ms. Trace:
I20260709 13:09:37.896389 23080 rpcz_store.cc:276] 0709 13:09:36.810356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.144932 (+334576us) service_pool.cc:224] Handling call
0709 13:09:37.145345 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.167393 (+ 22048us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:37.335958 (+168565us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.498253 (+162295us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.508889 (+ 10636us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.517692 (+  8803us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:37.517732 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.517801 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.895842 (+378041us) raft_consensus.cc:1685] finished
0709 13:09:37.895860 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.895975 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33735,"prepare.queue_time_us":282289,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":106319,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":16391,"thread_start_us":228604,"threads_started":2,"wal-append.queue_time_us":141306}
I20260709 13:09:37.896890 25594 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:37.899519 23002 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:37.878294 25581 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.882061 25577 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:37.894150 23652 rpcz_store.cc:276] 0709 13:09:36.751122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.754524 (+  3402us) service_pool.cc:224] Handling call
0709 13:09:37.120334 (+365810us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:37.893591 (+773257us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b540044d9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:37.893707 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55447808}
I20260709 13:09:37.901063 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:37.901358 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.901960 25565 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:37.902343 25565 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:37.902458 25594 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:37.902644 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.902817 25523 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.903172 25565 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.883432 25555 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:37.903856 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:37.904412 25565 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.904650 25555 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:37.905397 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:37.905709 25555 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.905988 23002 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:09:37.906414 25458 consensus_meta.cc:287] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 1.117s	user 0.006s	sys 0.002s
I20260709 13:09:37.906875 25458 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.907755 23073 raft_consensus.cc:2410] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:37.903852 22927 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:37.908463 25455 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:37.903309 23652 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:37.909555 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:37.901175 25548 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.880402 25453 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:37.917572 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:37.918157 22931 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:37.912444 23650 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:37.910107 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:37.879315 23045 leader_election.cc:336] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.007s (SENT)
W20260709 13:09:37.921545 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44041.2us
I20260709 13:09:37.923414 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:37.924036 22895 leader_election.cc:400] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5.
I20260709 13:09:37.915843 23648 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:09:37.922065 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 65688.6us
I20260709 13:09:37.925113 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:37.922299 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 87818.8us
I20260709 13:09:37.925809 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:37.925987 22925 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:37.923985 23046 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:37.926390 22931 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:37.876678 23653 rpcz_store.cc:276] 0709 13:09:36.751459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.760865 (+  9406us) service_pool.cc:224] Handling call
0709 13:09:37.829766 (+1068901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22400}
I20260709 13:09:37.927258 23652 raft_consensus.cc:2368] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3.
I20260709 13:09:37.916162 25514 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.928032 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.928143 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.928591 23656 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:37.929332 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:37.930038 23652 raft_consensus.cc:2376] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9. Re-sending same reply.
I20260709 13:09:37.929414 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.931103 23656 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
W20260709 13:09:37.924152 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 44863.7us
W20260709 13:09:37.933315 23045 leader_election.cc:336] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.044s (SENT)
I20260709 13:09:37.933703 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:37.933956 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.934448 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.934974 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.879269 22825 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 3 to 5, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 5 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.936223 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.908411 25594 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:37.939554 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:37.938025 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:37.944083 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:37.948666 22930 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:37.947584 22972 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.949710 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.951100 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:37.951355 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.927533 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:37.952630 22896 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.953266 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.979342 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:38.007589 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.982074 22972 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.013252 23078 raft_consensus.cc:2410] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:37.963950 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:37.939247 25581 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:37.983676 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.014142 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:37.956836 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:38.014318 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50449.2us
I20260709 13:09:37.983296 22971 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.017923 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.006943 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.019140 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:37.939082 25019 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:37.987996 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.013388 23653 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
W20260709 13:09:38.023856 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 84373.1us
I20260709 13:09:37.951797 25574 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:38.029567 22971 leader_election.cc:336] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.814s (SENT)
I20260709 13:09:38.029793 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.029980 22971 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:38.030889 22971 leader_election.cc:336] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.912s (SENT)
I20260709 13:09:38.031252 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:38.031615 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:37.984333 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.015027 25576 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:38.041841 23656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:37.936823 25469 consensus_queue.cc:1059] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:09:37.956113 25409 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.016484 25478 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:38.016646 25587 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:38.031627 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.043123 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.042603 23656 raft_consensus.cc:606] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.045243 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.022774 25562 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.046795 23650 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:37.941735 25509 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:09:38.056675 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.032677 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.061527 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.075987 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.031725 25574 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.956009 25501 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:09:38.047374 25478 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:38.099431 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:38.105265 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 152657us
I20260709 13:09:38.105405 23078 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:38.045770 25019 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:38.043116 25472 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.044831 25576 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:38.108642 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47186.1us
I20260709 13:09:38.109858 25548 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.110046 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.110250 25523 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.023953 25584 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:09:38.110359 23071 raft_consensus.cc:2368] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5.
I20260709 13:09:38.049399 25497 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.050680 23652 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:38.061643 25587 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:38.043236 25577 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:09:38.110699 25592 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:38.124229 25592 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:38.124650 25592 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.125541 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.125886 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.107194 25019 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.033879 25226 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:09:38.096484 25462 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.106462 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:38.173095 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 66701us
I20260709 13:09:38.098202 25574 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.157856 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.108304 25478 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.097046 25511 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.176512 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.182957 23078 raft_consensus.cc:2410] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:09:38.111289 25576 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.095103 25567 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.125921 23071 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:38.184065 22896 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.519s (SENT)
I20260709 13:09:38.100168 25458 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:09:38.187258 25559 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.231s
I20260709 13:09:38.187858 25564 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.188344 25586 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.061215 25599 consensus_queue.cc:1059] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.234s
I20260709 13:09:38.168793 25019 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.133829 25587 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.205485 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.227415 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.181785 25497 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:38.224287 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 184298us
I20260709 13:09:38.235546 22931 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:09:38.224838 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 205755us
I20260709 13:09:38.231228 22923 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.179672 25380 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.233924 22926 raft_consensus.cc:2410] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:09:38.235904 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:38.237591 22895 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:38.172490 25577 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:09:38.238431 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 80698.7us
I20260709 13:09:38.204468 25589 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:38.242470 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 65746.3us
I20260709 13:09:38.240864 22926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:48020
I20260709 13:09:38.242146 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.243593 22926 raft_consensus.cc:606] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.243995 22926 raft_consensus.cc:630] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Rejecting request to transfer leadership because tablet server b655449a388a41e3a606c6ea794825ad is not a voter in the active config
W20260709 13:09:38.288480 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 46439.9us
W20260709 13:09:38.318753 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 81248.4us
I20260709 13:09:38.319623 22895 leader_election.cc:400] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7.
I20260709 13:09:38.319473 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.237820 25581 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:38.321149 25581 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.242851 25497 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:38.329277 25497 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:38.332794 25600 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:38.334182 23077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2051) took 1519 ms. Trace:
I20260709 13:09:38.334550 23077 rpcz_store.cc:276] 0709 13:09:36.814813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.229262 (+414449us) service_pool.cc:224] Handling call
0709 13:09:37.229964 (+   702us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:37.252622 (+ 22658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.252673 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:37.918214 (+665541us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b4c004e3b00. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f39232d6a20 00007f39232e7a29 00007f39232ad644 00007f39232d4f2d 00007f39232d4b93 00007f392500518b 00007f3925005cb5 00007f3925007004 00007f3925006729 00007f392500bd96 00007f3925000adb
0709 13:09:37.923085 (+  4871us) log.cc:844] Serialized 590 byte log entry
0709 13:09:38.094914 (+171829us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:38.094977 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.095077 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.333880 (+238803us) raft_consensus.cc:1685] finished
0709 13:09:38.333899 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.334125 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":197580,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":55402880,"thread_start_us":155895,"threads_started":1,"wal-append.queue_time_us":252492}
I20260709 13:09:38.336683 23077 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.337965 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:38.241578 25380 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.313244 25573 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.290571 25579 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:38.271986 23045 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.315878 25562 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:38.316273 25586 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:38.296093 25611 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:38.318086 22926 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:38.323524 22931 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:38.348664 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 76770.3us
I20260709 13:09:38.328071 25422 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.339802 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.342084 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.272449 23652 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:09:38.351145 23045 leader_election.cc:336] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.127s (SENT)
I20260709 13:09:38.357682 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.340214 25589 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:38.360131 23045 leader_election.cc:336] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.839s (SENT)
I20260709 13:09:38.360527 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.345610 25579 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:38.387800 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45757.9us
I20260709 13:09:38.367282 23657 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:38.368106 25604 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.368532 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 616) took 1097 ms. Trace:
I20260709 13:09:38.369431 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.370326 22931 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:38.371780 25540 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.373898 25584 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.376945 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:38.392480 25579 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.381325 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:38.383219 25239 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.348358 25586 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:38.357241 25458 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:38.346940 25576 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.385454 25587 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.385681 25478 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.390254 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 618) took 1009 ms. Trace:
W20260709 13:09:38.428557 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.364498 25562 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.356670 24895 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.388962 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.449434 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 818) took 1201 ms. Trace:
I20260709 13:09:38.465587 23650 rpcz_store.cc:276] 0709 13:09:37.248156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.052957 (+804801us) service_pool.cc:224] Handling call
0709 13:09:38.053358 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.054166 (+   808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.054216 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.055313 (+  1097us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.121002 (+ 65689us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:38.172354 (+ 51352us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.176341 (+  3987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.176407 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.449230 (+272823us) raft_consensus.cc:1685] finished
0709 13:09:38.449250 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.449379 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37035,"prepare.queue_time_us":51031,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":4192,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":9796,"thread_start_us":64979,"threads_started":1,"wal-append.queue_time_us":181341}
I20260709 13:09:38.388715 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.392906 25473 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.357864 25611 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.459228 25239 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.378856 25494 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:38.469599 25494 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:38.469813 25611 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.470475 25494 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.471442 25494 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.472414 25380 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.473315 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.460189 23657 rpcz_store.cc:276] 0709 13:09:37.380601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.337745 (+957144us) service_pool.cc:224] Handling call
0709 13:09:38.390199 (+ 52454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.458621 25586 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:38.474716 25557 consensus_meta.cc:287] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.000s
I20260709 13:09:38.475328 23657 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:38.475967 25567 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.476660 23657 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:38.393908 23652 rpcz_store.cc:276] 0709 13:09:37.271521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.181607 (+910086us) service_pool.cc:224] Handling call
0709 13:09:38.234783 (+ 53176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.358786 (+124003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.368479 (+  9693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.477857 23657 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:38.461817 25584 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.462888 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.468113 23650 raft_consensus.cc:1240] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:38.475134 25557 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.452980 23006 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:38.480477 22931 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:38.483608 23005 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:38.483363 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 94747.9us
I20260709 13:09:38.488881 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:38.491670 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 102746us
I20260709 13:09:38.497006 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.502760 22971 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.505753 22971 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.509279 25451 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.510758 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.514045 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.480723 24895 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.490199 25473 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:38.530325 23622 leader_election.cc:336] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.605s (SENT)
W20260709 13:09:38.531009 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 156282us
I20260709 13:09:38.459899 25592 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.507238 25460 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.533370 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.535408 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.528635 25380 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.538468 24895 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:38.542225 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.542871 25585 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.542961 25583 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.542829 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.563458 23004 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:38.567989 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.568873 23078 raft_consensus.cc:2410] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:38.569633 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.570195 23078 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
W20260709 13:09:38.584339 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 53042.1us
I20260709 13:09:38.587471 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.588972 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:38.598644 23620 leader_election.cc:336] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.797s (SENT)
I20260709 13:09:38.599078 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.599927 25622 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:38.602062 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.602643 23077 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:38.603375 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.604287 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.604861 23077 raft_consensus.cc:2368] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5.
I20260709 13:09:38.605517 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.606221 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 820) took 1357 ms. Trace:
I20260709 13:09:38.606551 23656 rpcz_store.cc:276] 0709 13:09:37.248746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.060032 (+811286us) service_pool.cc:224] Handling call
0709 13:09:38.060723 (+   691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.062380 (+  1657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.062825 (+   445us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.103067 (+ 40242us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.271340 (+168273us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:38.346370 (+ 75030us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.346542 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.346605 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.606025 (+259420us) raft_consensus.cc:1685] finished
0709 13:09:38.606053 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.606168 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2464,"prepare.queue_time_us":6471,"raft.queue_time_us":159,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8128,"spinlock_wait_cycles":9465728,"thread_start_us":144729,"threads_started":1,"wal-append.queue_time_us":226556}
I20260709 13:09:38.618901 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.612176 25460 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:38.619735 25565 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.001s
I20260709 13:09:38.629695 25451 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:38.618395 25622 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.636053 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.638396 23655 raft_consensus.cc:2410] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:09:38.637665 25587 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:38.643512 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.645911 23074 raft_consensus.cc:2393] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:38.646822 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.655035 25576 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:38.608556 25019 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.664491 22928 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:09:38.635480 25555 consensus_meta.cc:287] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.003s
W20260709 13:09:38.668061 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50374.9us
I20260709 13:09:38.568011 25585 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:38.669391 22922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 587) took 1912 ms (client timeout 1605 ms). Trace:
I20260709 13:09:38.634639 25366 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.617512 25579 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.654932 25586 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.630590 25478 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:38.676867 22922 rpcz_store.cc:269] 0709 13:09:36.751984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.765572 (+ 13588us) service_pool.cc:224] Handling call
0709 13:09:38.656034 (+1890462us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540017eb54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:38.664101 (+  8067us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383817472}
I20260709 13:09:38.679903 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:38.682957 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.637753 25584 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.686786 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.687387 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.688047 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.692931 23656 raft_consensus.cc:2376] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5. Re-sending same reply.
I20260709 13:09:38.693501 23650 raft_consensus.cc:2410] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:38.693851 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:38.694311 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.694528 25579 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:38.695051 23650 raft_consensus.cc:2393] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:38.694979 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:38.695752 25619 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:09:38.696010 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.696053 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:38.696746 23654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 814) took 1449 ms (client timeout 1517 ms). Trace:
I20260709 13:09:38.692895 23657 raft_consensus.cc:2376] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5. Re-sending same reply.
I20260709 13:09:38.697507 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2056) took 1552 ms. Trace:
I20260709 13:09:38.697971 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.698431 23071 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:38.699159 23076 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:09:38.699211 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:38.700371 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.701030 23657 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:38.701658 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:38.702522 22929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 597) took 1925 ms (client timeout 2133 ms). Trace:
W20260709 13:09:38.702891 22929 rpcz_store.cc:269] 0709 13:09:36.777258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.795924 (+ 18666us) service_pool.cc:224] Handling call
0709 13:09:38.702384 (+1906460us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54001c9b54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:38.702473 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29106944}
I20260709 13:09:38.696700 23650 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.704579 23076 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:38.700660 25592 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:38.705346 23654 rpcz_store.cc:269] 0709 13:09:37.247082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.260148 (+ 13066us) service_pool.cc:224] Handling call
0709 13:09:38.695853 (+1435705us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:38.696698 (+   845us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9770752}
I20260709 13:09:38.705910 23656 raft_consensus.cc:2376] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3. Re-sending same reply.
I20260709 13:09:38.697882 23073 rpcz_store.cc:276] 0709 13:09:37.144940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.212141 (+ 67201us) service_pool.cc:224] Handling call
0709 13:09:38.697279 (+1485138us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b5400277754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:38.697443 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535345920}
I20260709 13:09:38.707912 23657 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:38.718456 22931 raft_consensus.cc:2410] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:38.669943 25557 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:38.723233 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:38.723829 22929 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.723969 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:38.726367 22926 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:38.727727 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:38.728268 22922 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.728260 22971 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.730017 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.731947 22926 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:38.719466 25380 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.736919 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.737846 25586 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.738065 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:38.739058 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.739569 23654 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:38.740350 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:38.740779 23654 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.744004 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.733263 25544 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.748198 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.748461 25583 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.749625 25585 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:38.750960 25019 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:38.751495 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.733296 25478 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.753314 23654 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:38.754324 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.755198 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.756592 23654 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:38.757375 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.758020 23654 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:38.756283 23651 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:38.722796 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:38.763371 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:38.766012 23654 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.767886 22929 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:38.768905 22922 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:38.763521 25592 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:38.772059 23651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 611) took 1513 ms (client timeout 1988 ms). Trace:
W20260709 13:09:38.772506 23651 rpcz_store.cc:269] 0709 13:09:37.258502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.783853 (+525351us) service_pool.cc:224] Handling call
0709 13:09:38.755034 (+971181us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:38.771993 (+ 16959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9832192}
I20260709 13:09:38.773438 25239 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.774603 23072 raft_consensus.cc:2410] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:38.773715 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.775624 23650 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:38.777855 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:38.779553 25574 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:09:38.784082 25592 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.784368 25574 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.785727 25453 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:38.786108 25453 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:38.786291 25557 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:38.787739 25557 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:38.788131 25557 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:38.788924 25557 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.790046 25557 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.791424 23651 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:38.792456 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:38.792979 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.793164 23651 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:38.794185 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:38.794893 23651 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:38.786285 25574 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:38.796499 25574 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:38.796976 25574 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.798120 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.786983 25453 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:38.781754 23650 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:38.783285 25377 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:38.775357 23071 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.776608 25239 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:38.801365 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.781229 23654 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:09:38.802182 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 270012us
I20260709 13:09:38.813836 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.806767 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:38.815109 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.803225 25579 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.816880 22924 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:38.807324 23651 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:38.808264 25584 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.816789 23621 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:38.828284 22929 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:38.828879 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.830413 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.817883 25585 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.839548 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:38.819479 25589 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.841779 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.843710 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.844868 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:38.844141 22924 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:38.846594 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:38.843218 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:38.847185 22929 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:38.836009 25422 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:38.835978 25494 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.843056 25603 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.826934 25019 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:09:38.958132 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 113357us
I20260709 13:09:38.884941 24895 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.840613 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 817) took 1592 ms. Trace:
W20260709 13:09:38.959403 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 106331us
I20260709 13:09:38.958264 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:38.826037 25579 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:38.839289 25366 consensus_queue.cc:1059] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:09:38.850090 25491 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:38.973372 22924 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:38.978658 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:38.846906 25632 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.979871 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:38.982473 24895 raft_consensus.cc:3055] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:38.851716 25541 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:38.982800 24895 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:38.983577 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:38.965343 25559 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:38.844519 25556 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:09:38.984978 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:38.851996 25574 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:38.851908 25422 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:38.986881 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:38.959620 25377 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.965341 25239 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:39.008927 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.017843 25603 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:38.966132 23653 rpcz_store.cc:276] 0709 13:09:37.247851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.061397 (+813546us) service_pool.cc:224] Handling call
0709 13:09:38.122438 (+ 61041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.233035 (+110597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.236575 (+  3540us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.300411 (+ 63836us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.621596 (+321185us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:38.805472 (+183876us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.816759 (+ 11287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.819861 (+  3102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.826201 (+  6340us) raft_consensus.cc:1685] finished
0709 13:09:38.827489 (+  1288us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.836510 (+  9021us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16798,"prepare.queue_time_us":182651,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1951,"raft.queue_time_us":48470,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":11201,"thread_start_us":345576,"threads_started":2,"wal-append.queue_time_us":346449}
I20260709 13:09:39.022202 25366 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.023629 25366 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:39.024006 25366 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.024632 25579 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.009050 25377 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.028044 25377 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.979782 25491 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:38.985580 25562 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.051847 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:38.985707 25611 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.985899 25572 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.958804 25555 consensus_queue.cc:1059] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:09:38.958981 25584 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:09:39.052531 22924 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:38.986137 25541 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:39.037716 24895 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.006423 25422 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.076834 24895 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:39.076838 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 91612.4us
I20260709 13:09:39.078491 23620 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:39.067678 25551 log.cc:927] Time spent T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 1.615s	user 0.010s	sys 0.006s
W20260709 13:09:39.080371 25636 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 13:09:38.965849 25494 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.083838 23620 leader_election.cc:400] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5.
I20260709 13:09:38.984665 25559 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.052772 25491 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.091706 23620 leader_election.cc:403] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:38.972807 25588 consensus_queue.cc:1059] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:09:39.052289 25562 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:39.080857 25541 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.082561 25584 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.076138 25611 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.092170 25564 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:39.113866 23620 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.110064 25579 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.112094 25239 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5.
W20260709 13:09:39.112054 23648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 614) took 1839 ms (client timeout 2071 ms). Trace:
I20260709 13:09:39.113881 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.117700 25494 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.102305 25377 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.109869 25584 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.135633 25611 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:39.157431 25562 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.182133 25491 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.182796 25584 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:39.183122 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 69315.1us
I20260709 13:09:39.183244 25239 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.184046 25377 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:39.136744 25579 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.123428 25366 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.188635 23620 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.193918 25366 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.195284 25559 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:39.189882 23652 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 8. Ops: []
W20260709 13:09:39.140244 23648 rpcz_store.cc:269] 0709 13:09:37.271176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.784086 (+512910us) service_pool.cc:224] Handling call
0709 13:09:39.102467 (+1318381us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5400930154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:39.110872 (+  8405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48246656}
I20260709 13:09:39.198762 23648 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:39.200524 25579 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.186383 23653 raft_consensus.cc:2955] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:39.205411 23071 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:39.208400 25491 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.209729 22931 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:39.212745 23077 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:39.213629 23653 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.222973 23620 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.227552 22931 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.234346 25540 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:39.234752 25540 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:39.235522 25540 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.236464 25540 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.246681 25377 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.245316 25458 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.249583 23657 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:39.251860 23656 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:39.247524 23653 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:09:39.260264 25564 consensus_queue.cc:1059] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:39.261216 25585 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.261595 25585 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:39.262373 25585 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.250377 25458 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.265228 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2100) took 1395 ms. Trace:
I20260709 13:09:39.265307 25458 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:39.265618 22923 rpcz_store.cc:276] 0709 13:09:37.869403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.869506 (+   103us) service_pool.cc:224] Handling call
0709 13:09:37.891605 (+ 22099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.236311 (+344706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.264996 (+1028685us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400238cd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:39.265146 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780651776}
I20260709 13:09:39.263447 25585 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.267973 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.275931 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.281203 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.286473 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 595) took 2509 ms. Trace:
W20260709 13:09:39.292183 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.273739 25564 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:39.293498 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.295404 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.292321 22928 rpcz_store.cc:276] 0709 13:09:36.776815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.816977 (+ 40162us) service_pool.cc:224] Handling call
0709 13:09:38.664201 (+1847224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.664891 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.286213 (+621322us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540017eb50. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:39.286398 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3606913920}
I20260709 13:09:39.295693 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:39.295821 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.300503 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.301038 23656 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:39.301755 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.302234 23656 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.303076 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.298746 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:39.282534 25573 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:39.285503 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:39.303854 25462 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:09:39.282533 25490 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.347025 23074 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:39.349175 23074 pending_rounds.cc:85] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 5
I20260709 13:09:39.349422 23074 pending_rounds.cc:107] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:39.349655 23074 raft_consensus.cc:2889] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:39.319533 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.282048 25377 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:39.359555 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:39.359593 23080 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 13:09:39.361491 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.312309 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 490) took 1361 ms. Trace:
I20260709 13:09:39.361786 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:39.364607 22924 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.311631 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.360857 23080 pending_rounds.cc:85] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 5
I20260709 13:09:39.366971 23080 pending_rounds.cc:107] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:39.367214 23080 raft_consensus.cc:2889] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.363135 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:39.368507 22925 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.364363 23072 rpcz_store.cc:276] 0709 13:09:37.950786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.950897 (+   111us) service_pool.cc:224] Handling call
0709 13:09:39.312120 (+1361223us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540010d454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:39.312255 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890289920}
I20260709 13:09:39.306216 25592 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:39.303247 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.375110 25518 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.374981 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:39.375893 23655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 804) took 2132 ms (client timeout 1755 ms). Trace:
I20260709 13:09:39.299703 25540 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:09:39.401820 25540 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:39.402149 25540 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:39.402963 25540 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.404039 25540 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.379868 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:39.380343 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1715) took 2234 ms. Trace:
W20260709 13:09:39.408910 23003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 561) took 1694 ms (client timeout 1835 ms). Trace:
W20260709 13:09:39.409281 23003 rpcz_store.cc:269] 0709 13:09:37.714181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.714326 (+   145us) service_pool.cc:224] Handling call
0709 13:09:39.379732 (+1665406us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:39.408855 (+ 29123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4615936}
W20260709 13:09:39.399109 23655 rpcz_store.cc:269] 0709 13:09:37.243247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.243371 (+   124us) service_pool.cc:224] Handling call
0709 13:09:38.125387 (+882016us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:39.375701 (+1250314us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54004deed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:39.375830 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205737600}
I20260709 13:09:39.411494 23655 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:39.299563 25143 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:09:39.385246 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.314185 23071 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.427109 22925 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:39.360960 25377 consensus_queue.cc:1243] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer b655449a388a41e3a606c6ea794825ad log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:39.372323 25592 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:39.400241 23079 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.312824 25458 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:39.381968 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.429225 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:39.429812 23073 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.429683 23654 raft_consensus.cc:2376] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4. Re-sending same reply.
I20260709 13:09:39.426891 25143 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:39.429054 25592 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.436043 25143 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:39.436295 25422 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.436946 25143 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.438086 25143 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.438566 25422 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.439330 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:39.440339 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:39.440828 23078 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.440891 23079 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:39.443308 23654 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.444308 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.444576 25548 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:39.445019 25548 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:39.445852 25548 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.446954 25548 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.427309 25476 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:09:39.449191 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.449483 23046 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.380612 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.416005 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:39.453873 23076 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.407785 22927 rpcz_store.cc:276] 0709 13:09:37.146415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.146601 (+   186us) service_pool.cc:224] Handling call
0709 13:09:37.146880 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.908619 (+761739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.380141 (+1471522us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54001c8754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:39.380290 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740485504}
I20260709 13:09:39.416504 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:39.398072 25577 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:39.447448 23654 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:39.456895 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:39.414470 22924 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:39.457486 22925 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:39.312861 25226 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:09:39.463542 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:39.464152 22923 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:39.417428 25518 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:39.465927 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.429360 25458 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.461423 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 155985us
I20260709 13:09:39.466960 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:39.452965 25604 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.459864 25650 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:39.477876 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.479164 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.480131 23073 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:39.467985 25422 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:39.482409 25564 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:39.484774 23622 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:39.484082 25586 raft_consensus.cc:2955] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:39.493896 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:39.462466 23653 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:39.498003 23071 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:39.511117 23078 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.511461 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:39.512061 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:39.513386 23079 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.472541 25458 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.514259 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:39.509734 23075 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:39.519838 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.472906 25559 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:39.522162 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.526494 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:39.527673 23622 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:39.506692 25422 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.536211 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.521489 25470 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:39.476877 25604 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.516459 25584 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:39.525691 25559 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.528352 25468 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.510526 25650 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.554762 25422 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:39.555280 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.581920 23078 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:39.569728 25576 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:39.574640 25470 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.616367 25470 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.606150 23653 raft_consensus.cc:1240] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:39.553866 25473 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:09:39.606681 22923 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:39.555065 25585 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.528585 25377 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:09:39.621640 25377 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.621987 25377 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:39.622771 25377 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.575486 25584 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.626029 25584 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.626883 25491 consensus_queue.cc:1059] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:39.629313 25604 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.596617 25559 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.610886 25576 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:39.611495 25648 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:09:39.592823 25651 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.603222 25564 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:39.602412 23656 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:39.640632 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.633141 23076 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:39.641140 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.644200 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:39.529615 25518 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.657428 25568 raft_consensus.cc:3055] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:39.657819 25568 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:39.658579 25568 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.641867 25476 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:39.648022 25491 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:39.662513 23079 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:39.664655 25143 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.662041 25592 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.668053 25599 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.669205 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1715) took 1656 ms. Trace:
I20260709 13:09:39.691061 23005 rpcz_store.cc:276] 0709 13:09:38.012470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.012599 (+   129us) service_pool.cc:224] Handling call
0709 13:09:38.016274 (+  3675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.488335 (+472061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.668896 (+1180561us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54003fc354. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:39.669106 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074376576}
I20260709 13:09:39.672735 25650 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:39.673389 23657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:39.641402 25651 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.673393 25576 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.675583 25518 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.677064 25490 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.678206 25458 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.711344 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.659575 25568 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.692898 23657 raft_consensus.cc:606] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.714248 23657 raft_consensus.cc:614] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:39.693385 25491 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:39.701630 22896 connection.cc:256] RPC call timeout handler was delayed by -1.3299351609999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2524s for a response
I20260709 13:09:39.705226 23656 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:39.679558 25476 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.678553 25584 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.661432 25377 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.711334 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.720620 23073 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:39.719511 22896 leader_election.cc:336] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.071s (SENT)
I20260709 13:09:39.707911 25650 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:39.738935 23654 raft_consensus.cc:2376] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6. Re-sending same reply.
W20260709 13:09:39.696982 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 173759us
I20260709 13:09:39.722815 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.743079 23657 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:39.722675 25491 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.717402 25564 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.720009 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.728847 25651 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:39.729534 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:39.747890 22929 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:39.731413 25476 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:39.709322 25490 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:39.751035 25490 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.752425 25490 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.707176 25143 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.720427 25336 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.749356 23651 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.739377 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.711699 25470 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.732977 25660 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:39.738719 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 98146.3us
I20260709 13:09:39.756034 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:39.757246 25604 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:39.755348 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.780753 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.746788 25539 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:39.755234 25366 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.777364 25541 consensus_meta.cc:287] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.000s
I20260709 13:09:39.793458 25591 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:39.797659 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 78163.1us
I20260709 13:09:39.798079 25470 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:39.798600 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.786357 25651 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.746697 25650 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.787261 25539 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:39.809182 25651 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.840605 23650 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:09:39.843806 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 831) took 1154 ms. Trace:
I20260709 13:09:39.844311 23650 rpcz_store.cc:276] 0709 13:09:38.689129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.861163 (+172034us) service_pool.cc:224] Handling call
0709 13:09:39.839515 (+978352us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:39.840234 (+   719us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:39.843413 (+  3179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.843733 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4398848}
I20260709 13:09:39.787292 25604 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.787458 25661 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:09:39.851789 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 129715us
I20260709 13:09:39.811322 25591 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:39.853389 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.788727 25660 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.801461 25659 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:39.862030 25660 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.802145 25366 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.805325 25541 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.865640 25541 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:39.865780 23651 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:39.866513 23080 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.866866 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.870893 22895 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.847399 25651 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:39.859314 25665 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:39.872936 23620 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.857990 23650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:09:39.874738 25661 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:39.815793 25470 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:09:39.854048 25491 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:39.891932 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 503) took 1375 ms. Trace:
I20260709 13:09:39.922091 23074 rpcz_store.cc:276] 0709 13:09:38.516424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.648424 (+132000us) service_pool.cc:224] Handling call
0709 13:09:39.314241 (+665817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.350071 (+ 35830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.891637 (+541566us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540010d450. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:39.891852 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530401536}
W20260709 13:09:39.880332 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 136960us
I20260709 13:09:39.923280 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:39.923996 22924 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:09:39.882242 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 84050.6us
I20260709 13:09:39.894150 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.926131 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:39.927019 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:39.927127 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.811618 25664 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:09:39.930104 23656 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.919360 25661 consensus_queue.cc:1243] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:39.920722 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:39.939052 22923 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.867503 23651 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.878759 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:39.924515 22972 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:39.896123 25570 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:39.897354 25239 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:39.919931 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 131625us
I20260709 13:09:39.881458 25458 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:39.947636 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.955140 22896 connection.cc:256] RPC call timeout handler was delayed by -1.0032351610000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2887s for a response
I20260709 13:09:39.898788 25548 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:39.926920 25584 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:39.871279 25591 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.963450 22972 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:39.964299 22972 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:39.967638 22923 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:39.968081 23656 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:39.877753 25539 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:39.924566 25491 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.969825 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:39.929226 25660 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:09:39.958485 25239 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:39.971267 25670 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:39.936520 25657 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:39.960368 25572 raft_consensus.cc:3055] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:39.967170 25548 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:39.987077 23656 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:09:39.989648 25548 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:39.967468 25143 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:39.995129 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 52090.7us
I20260709 13:09:39.980672 25664 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:39.979919 25572 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:40.012965 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 44510.2us
I20260709 13:09:40.017481 25491 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:40.024341 25572 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:40.025322 25671 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:09:40.025934 25572 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.026551 25239 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:40.040261 25668 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:40.043042 25591 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:40.047845 25650 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.048416 25491 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.976789 25659 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:39.991632 25674 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:40.048786 25473 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.045342 25559 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:40.052450 23651 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
W20260709 13:09:40.055440 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 69722.4us
I20260709 13:09:40.087255 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:40.087817 23651 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:40.089805 25591 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:40.091667 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 212925us
W20260709 13:09:40.057235 25669 log.cc:927] Time spent T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:09:40.106107 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:40.106446 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.998051 25679 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:40.082512 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.082683 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:40.110560 23650 raft_consensus.cc:606] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:09:39.998541 25670 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:40.083674 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:39.999854 25366 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.056737 23653 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:40.048928 25491 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.108724 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:40.110981 23650 raft_consensus.cc:614] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:40.110973 22923 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.114769 23075 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:40.094151 25570 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:40.080188 25604 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:40.035511 25422 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.128103 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:40.129112 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:40.091230 25377 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.130355 22923 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:40.131682 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:40.135305 25679 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:40.114884 25591 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.127251 25670 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.143564 25688 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:40.148718 25548 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:40.150095 25453 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.244516 25377 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.264746 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:40.265322 25377 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:40.152046 25491 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.154152 25682 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:09:40.268636 25682 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:40.268878 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 782) took 2388 ms. Trace:
I20260709 13:09:40.244879 25604 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.269498 23652 rpcz_store.cc:276] 0709 13:09:37.912338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.477735 (+565397us) service_pool.cc:224] Handling call
0709 13:09:39.105689 (+627954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.196121 (+ 90432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.009729 (+813608us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b5400930154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:40.268639 (+258910us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400930150. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:40.268804 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624725632}
I20260709 13:09:40.154863 25683 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:09:40.160064 22928 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:40.162041 25687 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:40.272280 25687 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:40.273587 25688 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.274283 25687 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:40.163734 25559 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:40.184244 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 183460us
W20260709 13:09:40.189074 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.202031 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.160566 25651 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:40.214689 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.091859 25473 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.225261 25586 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:40.236899 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 107882us
I20260709 13:09:40.217440 25660 consensus_queue.cc:1059] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:09:40.243614 25143 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:40.305645 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:40.347610 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:40.303797 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:40.355227 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:40.357363 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:40.360900 22928 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:40.360901 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:40.362751 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:40.325840 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 240155us
I20260709 13:09:40.359205 23078 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.358021 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:40.354825 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:40.365367 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 89071.8us
I20260709 13:09:40.365891 23073 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
W20260709 13:09:40.363963 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 232385us
I20260709 13:09:40.363440 23076 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:40.367630 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:40.357589 23074 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:40.356954 22927 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:40.360049 23072 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:40.372098 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:40.373481 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.382629 23078 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:40.373968 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:40.268975 25682 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:40.275696 25688 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.350528 25539 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:40.275969 25673 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:40.386947 23005 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:40.387871 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.392112 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:40.385120 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:40.393208 23077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 509) took 1863 ms (client timeout 2228 ms). Trace:
I20260709 13:09:40.348728 25592 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.354897 25664 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:40.394177 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.362253 25670 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.395001 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:40.355672 25586 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:40.364455 25470 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.397971 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.398711 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.444402 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:40.401913 23077 rpcz_store.cc:269] 0709 13:09:38.529598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.605332 (+ 75734us) service_pool.cc:224] Handling call
0709 13:09:40.393043 (+1787711us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540038a9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:40.393156 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390936320}
I20260709 13:09:40.402760 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:40.402688 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.403203 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:40.451601 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 48470.4us
I20260709 13:09:40.405891 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.276733 25599 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:09:40.460886 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:40.461316 25599 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:40.461741 25599 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:40.462095 25599 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.464438 25586 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.372869 25453 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:09:40.465795 25586 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:40.374689 25612 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.441186 23001 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:40.468032 25592 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:40.467924 25470 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.470510 25470 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.473374 25599 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.474087 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:40.474850 25681 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:40.475262 25681 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:40.475368 25599 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.444396 25689 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.480429 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.372915 25687 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:09:40.481688 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:40.482882 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.484388 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.485090 22998 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:40.486047 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.487186 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:40.487763 25678 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:09:40.488090 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:40.489379 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:40.490517 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:40.438252 25688 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:40.492003 25688 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:40.492446 25688 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.399986 25673 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:40.494550 25673 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:40.495741 25673 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.496126 25664 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:40.500142 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:40.500801 23002 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:40.437999 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 52963.1us
I20260709 13:09:40.389222 25591 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.395920 25548 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:40.445737 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.457692 23651 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:09:40.459690 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:40.398345 25143 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:40.401876 25570 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:40.468286 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.442332 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:40.502800 23072 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:40.503125 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:40.398070 23649 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:40.506531 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:40.276507 25679 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.186614 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.038434 25661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.017s	sys 0.036s
I20260709 13:09:41.191953 25592 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.202078 23076 raft_consensus.cc:2393] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:40.506810 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:40.971302 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.126346 22999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.009s	sys 0.002s
I20260709 13:09:41.216176 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:41.024024 22926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.019s	sys 0.050s
I20260709 13:09:40.483560 23003 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:40.511754 22998 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:09:40.602669 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.184957 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.702466 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.684041 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:41.187515 22969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.037s	sys 0.025s
I20260709 13:09:40.770304 24895 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:41.245604 22969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.038s	sys 0.028s
I20260709 13:09:40.590904 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:41.230938 23073 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:41.246333 24895 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.220784 22971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.002s	sys 0.012s
W20260709 13:09:41.247354 22971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.003s	sys 0.012s
I20260709 13:09:40.645507 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2063) took 1237 ms. Trace:
W20260709 13:09:40.703188 23046 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.506s (SENT) [suppressed 46 similar messages]
I20260709 13:09:41.248183 23080 rpcz_store.cc:276] 0709 13:09:39.408327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.410206 (+  1879us) service_pool.cc:224] Handling call
0709 13:09:39.430688 (+ 20482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.867009 (+436321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.645174 (+778165us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400265f54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:40.645428 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001732864}
I20260709 13:09:40.753011 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:40.649398 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2042) took 1156 ms. Trace:
I20260709 13:09:41.249513 22928 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:41.249627 23075 rpcz_store.cc:276] 0709 13:09:39.492575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.523760 (+ 31185us) service_pool.cc:224] Handling call
0709 13:09:39.524021 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.123832 (+599811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.649173 (+525341us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b540010ca54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:40.649342 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358139136}
W20260709 13:09:41.187173 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.744185 23002 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:09:41.251081 23075 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:41.233006 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 729902us
W20260709 13:09:41.251919 22926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.021s	sys 0.052s
W20260709 13:09:41.231588 22999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.011s	sys 0.002s
I20260709 13:09:41.252298 22896 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:41.176779 25539 consensus_meta.cc:287] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.001s
I20260709 13:09:41.200527 23654 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:41.246796 23074 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:41.255236 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:40.447273 25660 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:41.093706 25689 consensus_meta.cc:287] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.617s	user 0.003s	sys 0.005s
W20260709 13:09:41.202071 25661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.018s	sys 0.038s
I20260709 13:09:41.276110 23072 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:41.160444 25673 consensus_meta.cc:287] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.664s	user 0.005s	sys 0.004s
I20260709 13:09:41.309763 23653 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:41.256176 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:09:41.124818 25576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.008s	sys 0.003s
W20260709 13:09:41.223052 25664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.013s
W20260709 13:09:41.125427 25650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.012s	sys 0.000s
W20260709 13:09:41.024519 25649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.036s	sys 0.045s
I20260709 13:09:40.653532 25667 raft_consensus.cc:3055] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:40.664603 25651 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:41.326020 22998 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:41.234777 25470 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.312851 25689 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:41.316196 25539 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.843312 25674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.026s	sys 0.048s
I20260709 13:09:40.744103 25687 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.674486 25226 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:41.329820 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:41.330181 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:41.260520 25601 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.331789 24895 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:40.658284 25473 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:41.408427 22923 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.234849 25452 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.253969 25699 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:41.242945 25548 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:41.253474 25670 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:41.260044 25604 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.221998 25239 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:09:41.259508 25591 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:41.346266 25659 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.335135 25650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.012s	sys 0.006s
I20260709 13:09:41.316134 25143 raft_consensus.cc:697] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:41.339310 25649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.042s	sys 0.047s
I20260709 13:09:41.255992 25693 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:41.179486 25562 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:41.328308 25576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.011s	sys 0.006s
W20260709 13:09:41.328183 25664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.000s	sys 0.018s
I20260709 13:09:41.240499 25592 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.256121 25684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.006s	sys 0.008s
I20260709 13:09:41.328024 25660 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:41.400193 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.404392 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 194275us
W20260709 13:09:41.361545 25688 consensus_meta.cc:287] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.003s
I20260709 13:09:40.780534 25559 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.479547 25682 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.339983 25667 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:41.363055 25674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.031s	sys 0.058s
I20260709 13:09:40.655057 25681 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.421028 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.629766 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 926525us
I20260709 13:09:41.422801 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:41.631342 23072 raft_consensus.cc:2393] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:41.373843 25226 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:41.472806 22923 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
W20260709 13:09:41.473721 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 217644us
I20260709 13:09:41.420221 25548 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:41.363883 25470 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.404274 25687 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.374894 25539 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.474768 25704 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.593401 23621 leader_election.cc:336] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.835s (SENT)
W20260709 13:09:41.598222 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.660912 25713 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:41.661372 25708 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:41.661468 25713 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.422401 25452 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.418591 25601 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.460042 25336 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:09:41.664409 25452 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.664769 25601 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.665438 22922 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:41.603433 25688 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.668444 23002 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:41.668757 22929 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:41.667510 22922 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:41.670017 25688 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.670671 25688 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:41.671955 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:41.672629 22928 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:41.674326 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:41.675056 22924 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
W20260709 13:09:41.574214 25684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.007s	sys 0.013s
W20260709 13:09:41.676199 25695 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 13:09:41.482672 25716 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.677048 25716 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.424921 25670 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.681412 25670 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.478272 25473 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:41.682188 25473 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.684691 25473 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:41.685230 25473 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:41.685756 25473 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.687253 25586 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.221s	user 0.006s	sys 0.005s
W20260709 13:09:41.630329 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.601477 25576 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:41.574499 25651 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:41.473817 25659 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.629562 25674 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:41.667971 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:41.658846 23621 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:41.688580 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.482272 25490 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.420490 25699 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.634069 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:41.476958 25591 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.692615 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1719) took 1305 ms. Trace:
I20260709 13:09:41.633860 25693 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:41.597663 25632 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:41.705686 22931 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:41.707227 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 113848us
I20260709 13:09:41.671250 25688 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.710584 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 76581.7us
I20260709 13:09:41.722074 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:41.723106 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:41.664798 25592 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.717217 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:41.738155 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:41.738440 22998 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.741264 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:41.745003 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:41.712677 22999 rpcz_store.cc:276] 0709 13:09:40.386899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.387000 (+   101us) service_pool.cc:224] Handling call
0709 13:09:40.404789 (+ 17789us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:40.405174 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.405210 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:40.442248 (+ 37038us) log.cc:844] Serialized 52 byte log entry
0709 13:09:41.252867 (+810619us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:41.331150 (+ 78283us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.691592 (+360442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.692361 (+   769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.692418 (+    57us) raft_consensus.cc:1685] finished
0709 13:09:41.692434 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.692559 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150165,"prepare.queue_time_us":81908,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6746,"raft.queue_time_us":119638,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":4557,"thread_start_us":1113214,"threads_started":2,"wal-append.queue_time_us":925245}
W20260709 13:09:41.748276 25707 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:09:41.749764 25705 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
W20260709 13:09:41.750304 25694 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 13:09:41.750890 25712 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.752207 25710 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:09:41.752931 25703 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:09:41.679569 25716 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:41.627424 25559 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.754465 22926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2124) took 1643 ms. Trace:
I20260709 13:09:41.755369 25559 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.727907 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:41.756609 23654 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:41.733744 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:41.736359 23652 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:09:41.751598 25712 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.759110 22998 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:41.761039 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:41.761057 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:41.762797 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:41.769843 23656 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:41.711479 25719 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.713764 25723 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.720708 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 316046us
I20260709 13:09:41.784902 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:41.722882 25689 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.703930 25651 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.770211 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:41.812825 22971 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:41.778069 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 841) took 2071 ms. Trace:
I20260709 13:09:41.716387 25586 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:41.710093 25713 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.754889 22926 rpcz_store.cc:276] 0709 13:09:40.110883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.111063 (+   180us) service_pool.cc:224] Handling call
0709 13:09:40.111465 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:40.170362 (+ 58897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.170405 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:40.209736 (+ 39331us) log.cc:844] Serialized 52 byte log entry
0709 13:09:41.252309 (+1042573us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:41.252356 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.252425 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.754194 (+501769us) raft_consensus.cc:1685] finished
0709 13:09:41.754220 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.754399 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22908,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"thread_start_us":1091207,"threads_started":2,"wal-append.queue_time_us":1108724}
I20260709 13:09:41.821090 23657 rpcz_store.cc:276] 0709 13:09:39.706213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.743648 (+ 37435us) service_pool.cc:224] Handling call
0709 13:09:40.681872 (+938224us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:40.682089 (+   217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.682371 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.682407 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.178866 (+496459us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.335972 (+157106us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:41.336122 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.336321 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.756119 (+419798us) raft_consensus.cc:1685] finished
0709 13:09:41.756138 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.777997 (+ 21859us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13958528,"thread_start_us":133589,"threads_started":1,"wal-append.queue_time_us":298314}
I20260709 13:09:41.785466 23003 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:41.702617 25576 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.741256 25709 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 13:09:41.816001 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:41.815582 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:41.841547 22999 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.775904 25679 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:41.844022 25679 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:41.845192 25679 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.763512 25473 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.714460 25490 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.849030 25473 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.849681 25473 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.850612 25490 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.852329 25490 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:41.853266 25473 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.774259 23651 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:41.780892 25664 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.854542 25664 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.856436 25664 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.776432 25592 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.856987 25592 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.858737 22999 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:41.858930 25592 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.782481 25716 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:41.838507 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 93580.3us
I20260709 13:09:41.859687 25586 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.778962 25559 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:41.860853 25559 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.861682 25586 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.863282 25559 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.852959 25490 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.865072 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.718582 25673 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:41.863927 25559 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.863379 25586 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:41.692011 25704 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.810571 25706 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
W20260709 13:09:41.873824 22997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.048s	sys 0.032s
I20260709 13:09:41.810112 25452 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:41.877321 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:41.815281 25599 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.719803 25143 consensus_queue.cc:237] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:41.889892 22997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.048s	sys 0.032s
I20260709 13:09:41.911984 25736 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.912557 25736 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.914466 22998 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:41.723640 25660 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.892123 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 79361.9us
W20260709 13:09:41.892884 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 65407.3us
I20260709 13:09:41.881979 25586 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.839138 25721 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.924702 25490 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.867751 25713 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:41.924868 25721 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.925469 25713 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.900290 25712 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.901306 25539 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:41.905889 25704 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.740983 25632 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.907527 25730 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:41.908036 25717 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:41.957844 25576 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:41.958196 25717 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.908525 25725 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:09:41.960639 25725 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:41.961076 25725 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:41.961999 25725 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:41.963521 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45210.1us
I20260709 13:09:41.964417 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:41.723380 25667 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.784722 25719 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.966199 25702 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:41.910247 25699 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:41.836055 25670 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:09:41.966631 25632 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.876895 25674 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.911232 25599 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:41.890645 23074 consensus_meta.cc:287] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.001s
I20260709 13:09:41.917363 25664 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:09:41.893033 23005 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:41.745260 25226 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.919298 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:41.921885 25722 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.922811 25736 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.923566 25686 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:41.889403 25559 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.882231 25673 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.908774 25732 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:41.916043 25452 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:41.932742 25713 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.811676 25723 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:41.956763 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1736) took 1494 ms. Trace:
I20260709 13:09:41.964457 25687 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:41.926985 25721 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:42.209612 22931 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
W20260709 13:09:42.300689 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.024s	sys 0.053s
W20260709 13:09:42.399937 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.024s	sys 0.056s
W20260709 13:09:42.064616 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.372390 23622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.010s
I20260709 13:09:41.931391 25586 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.406056 22999 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:41.933290 25518 raft_consensus.cc:3055] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:42.299743 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 439567us
W20260709 13:09:41.967898 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50467.4us
W20260709 13:09:42.397759 23076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.006s	sys 0.005s
I20260709 13:09:42.417019 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1741) took 1088 ms. Trace:
W20260709 13:09:42.412846 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 359878us
W20260709 13:09:42.356200 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.433284 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.432861 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.455718 23045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.003s	sys 0.017s
I20260709 13:09:42.456672 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:41.966771 25719 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.479463 23072 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.304056 25746 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.486884 23080 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:42.455523 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.453876 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:42.494647 22896 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:42.496354 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:42.497956 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:42.460127 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:42.042690 25562 consensus_meta.cc:287] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.003s
W20260709 13:09:42.478891 23045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.003s	sys 0.017s
I20260709 13:09:42.483934 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:41.978874 25718 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:41.987602 25604 consensus_meta.cc:287] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.002s
I20260709 13:09:42.196827 25576 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.454955 23074 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:41.967983 25688 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.420935 25659 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.413162 25712 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.457942 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:42.454865 25686 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:42.454511 23000 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:09:42.523103 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.523357 23621 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:42.523680 23000 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:42.524524 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.454670 23002 rpcz_store.cc:276] 0709 13:09:41.329130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.329427 (+   297us) service_pool.cc:224] Handling call
0709 13:09:42.405689 (+1076262us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400011654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:42.416949 (+ 11260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700096384}
W20260709 13:09:42.457782 23622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.000s	sys 0.015s
I20260709 13:09:42.413837 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:42.453787 23076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.006s	sys 0.007s
W20260709 13:09:42.504559 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.525691 23005 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.454782 22997 rpcz_store.cc:276] 0709 13:09:40.462435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.491308 (+ 28873us) service_pool.cc:224] Handling call
0709 13:09:40.491550 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.512732 (+ 21182us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:40.745824 (+233092us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.956392 (+1210568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:41.956449 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:41.956493 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.956554 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.956698 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35886,"prepare.queue_time_us":232874,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":46100,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":1166080,"threads_started":1,"wal-append.queue_time_us":1222325}
I20260709 13:09:42.456856 22971 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:41.981483 25717 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.035826 25704 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.383577 25743 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.974525 25591 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:41.976330 25470 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:42.507354 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 723826us
I20260709 13:09:42.535832 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:42.537736 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.538304 22922 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:42.539191 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:42.509435 23074 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2049) took 2003 ms (client timeout 2274 ms). Trace:
I20260709 13:09:42.395452 25651 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:42.511056 23075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.015s	sys 0.016s
I20260709 13:09:42.457324 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.421113 25725 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.452729 25518 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:42.001799 25548 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.541978 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:42.457693 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.459684 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.452803 25730 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:42.201870 25702 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:42.455293 25699 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:42.526564 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:42.526643 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 69850.6us
I20260709 13:09:42.549767 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.550637 22928 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:42.551076 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:42.555392 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.533210 25686 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:42.453827 25693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.007s	sys 0.012s
I20260709 13:09:42.510969 25604 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.507292 25683 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.534685 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2052) took 1935 ms. Trace:
I20260709 13:09:42.520548 25688 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:42.540009 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.509306 25736 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.428983 25737 consensus_queue.cc:1059] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:09:42.511065 25714 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.559144 25632 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:42.555119 25377 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.568665 25660 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:42.540359 23075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.015s	sys 0.016s
W20260709 13:09:42.540089 23074 rpcz_store.cc:269] 0709 13:09:40.505873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.506008 (+   135us) service_pool.cc:224] Handling call
0709 13:09:42.509380 (+2003372us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:42.541494 23045 connection.cc:256] RPC call timeout handler was delayed by -2.0271196879999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:09:42.456959 23648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.010s
I20260709 13:09:42.544117 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:42.520737 25143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.016s	sys 0.020s
I20260709 13:09:42.542225 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.573798 25749 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.604686 23656 raft_consensus.cc:2410] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:42.604810 25749 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.605547 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.548871 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.607045 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.466737 25722 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.608201 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.608796 23002 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:42.609206 25722 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.576519 25559 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.560372 22924 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:42.611799 23654 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:42.576921 25730 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.613206 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.613322 22825 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35510 (request call id 350) took 7170 ms. Trace:
I20260709 13:09:42.614239 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.614893 23654 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.616492 25599 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.518184 25718 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:42.618155 25715 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.895s	user 0.009s	sys 0.007s
I20260709 13:09:42.536898 25592 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.568678 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2125) took 1890 ms. Trace:
I20260709 13:09:42.577469 25673 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.619196 22929 rpcz_store.cc:276] 0709 13:09:40.678235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.681075 (+  2840us) service_pool.cc:224] Handling call
0709 13:09:40.681410 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.669215 (+987805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.568478 (+899263us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54002a7954. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:42.568627 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270146304}
I20260709 13:09:42.546106 25713 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.483642 25732 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.628961 25727 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:42.629426 25727 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:42.629581 25732 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.630187 25727 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.588624 25683 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.631327 25727 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.544548 25719 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:42.589066 23651 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:42.631908 25719 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:42.632383 25719 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.589294 25736 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.633267 25682 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.633086 25518 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.560822 25717 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.634285 25518 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.590319 25723 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.573372 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.544502 25748 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:42.587230 25422 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.635293 25748 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:42.557242 25742 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.589511 25452 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.508930 25746 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.636227 25748 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.637636 25746 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.591408 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.518970 25576 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.641288 25576 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.641583 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.592103 25714 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.642710 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.644692 25719 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.645201 25714 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:42.645485 25604 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.595336 25377 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.646030 25604 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.646634 25719 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.647907 25377 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:42.546393 25704 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.649881 22931 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:42.650314 25704 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:42.595537 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.597168 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2055) took 1843 ms. Trace:
W20260709 13:09:42.603826 23648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.004s	sys 0.011s
I20260709 13:09:42.595796 25660 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:42.570101 25699 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.579420 25548 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:42.568827 25693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.010s	sys 0.017s
W20260709 13:09:42.599017 23045 connection.cc:256] RPC call timeout handler was delayed by -1.9869010720000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:09:42.439925 25692 consensus_queue.cc:1175] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "01988c2c817947859340a730b7f1247d" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: [4.7-6.8]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:09:42.655433 23045 connection.cc:256] RPC call timeout handler was delayed by -1.9727266100001088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:09:42.655957 25699 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.579855 25752 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:09:42.571429 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.656761 23655 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:42.585778 25681 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.657611 25684 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.658114 25684 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.659147 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.607372 25749 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.613750 22825 rpcz_store.cc:276] 0709 13:09:35.451270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.453505 (+  2235us) service_pool.cc:224] Handling call
0709 13:09:35.932636 (+479131us) spinlock_profiling.cc:243] Waited 877 us on lock 0x7b5400002490. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee6640 00007f392adbdb76 00007f392aec7c3e 00007f39293882a4 00007f3929388232 00007f3929388161 00007f39293880dc 00007f3929387392 00007f392334548c 00007f39233448c6
0709 13:09:42.613259 (+6680623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:38.483389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:38.568296 (+ 84907us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:38.568327 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:09:38.568345 (+    18us) tablet.cc:662] Decoding operations
0709 13:09:38.569381 (+  1036us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:38.569435 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:38.569462 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:38.606286 (+ 36824us) tablet.cc:701] Row locks acquired
0709 13:09:38.606301 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:09:38.606444 (+   143us) write_op.cc:270] Start()
0709 13:09:38.606561 (+   117us) write_op.cc:276] Timestamp: P: 1783602578606401 usec, L: 0
0709 13:09:38.606583 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:38.607192 (+   609us) log.cc:844] Serialized 4432 byte log entry
0709 13:09:38.838366 (+231174us) op_driver.cc:464] REPLICATION: finished
0709 13:09:39.023481 (+185115us) write_op.cc:301] APPLY: starting
0709 13:09:39.023571 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:39.023959 (+   388us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:39.024117 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:39.025732 (+  1615us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:39.026066 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:09:39.026131 (+    65us) write_op.cc:312] APPLY: finished
0709 13:09:39.099250 (+ 73119us) log.cc:844] Serialized 83 byte log entry
0709 13:09:39.099443 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.107929 (+  8486us) write_op.cc:454] Released schema lock
0709 13:09:39.110699 (+  2770us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:39.123908 (+ 13209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.123961 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":25,"spinlock_wait_cycles":2017664,"child_traces":[["op",{"apply.queue_time_us":184882,"apply.run_cpu_time_us":4188,"apply.run_wall_time_us":100401,"num_ops":11,"prepare.queue_time_us":341204,"prepare.run_cpu_time_us":21839,"prepare.run_wall_time_us":262224,"raft.queue_time_us":82067,"raft.run_cpu_time_us":4305,"raft.run_wall_time_us":17020,"replication_time_us":231617,"thread_start_us":396506,"threads_started":4,"wal-append.queue_time_us":146646,"wal-append.run_cpu_time_us":32974,"wal-append.run_wall_time_us":1381786}]]}
I20260709 13:09:42.580418 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.542114 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.661259 23000 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:42.577744 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.586467 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 813) took 1386 ms. Trace:
I20260709 13:09:42.627169 25713 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.652050 23075 rpcz_store.cc:276] 0709 13:09:40.753779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.258801 (+505022us) service_pool.cc:224] Handling call
0709 13:09:41.259212 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.574913 (+315701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.574947 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.629733 (+ 54786us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.878868 (+249135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:41.890063 (+ 11195us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.596889 (+706826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.596959 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.597001 (+    42us) raft_consensus.cc:1685] finished
0709 13:09:42.597013 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.597113 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17853,"prepare.queue_time_us":14715,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":9263,"raft.queue_time_us":976479,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":58993,"spinlock_wait_cycles":56320,"thread_start_us":1212403,"threads_started":3,"wal-append.queue_time_us":334121}
I20260709 13:09:42.650787 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.673364 22931 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:42.546543 25743 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.675073 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.565889 25702 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.680384 25226 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.681313 25702 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.596661 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.682016 22998 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:42.528054 23071 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:42.682655 25586 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:42.684566 23071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2044) took 3191 ms (client timeout 1716 ms). Trace:
W20260709 13:09:42.685029 22923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 1752) took 2211 ms (client timeout 1805 ms). Trace:
W20260709 13:09:42.684928 23071 rpcz_store.cc:269] 0709 13:09:39.493000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.511260 (+ 18260us) service_pool.cc:224] Handling call
0709 13:09:42.684416 (+3173156us) spinlock_profiling.cc:243] Waited 3 s on lock 0x7b5400267354. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:42.684505 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6899026304}
I20260709 13:09:42.581496 23005 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
W20260709 13:09:42.685483 22923 rpcz_store.cc:269] 0709 13:09:40.473726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.473873 (+   147us) service_pool.cc:224] Handling call
0709 13:09:42.684853 (+2210980us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54003caad4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:42.684970 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147300096}
I20260709 13:09:42.686187 24895 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.686661 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60272 (request call id 11) took 2894 ms. Trace:
I20260709 13:09:42.686618 24895 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.588064 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.604023 22922 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:42.662016 22930 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:42.664769 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.689775 22928 raft_consensus.cc:2393] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:42.667079 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.692312 22926 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.649029 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.693586 22924 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:42.626547 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.660467 23657 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:42.532521 25712 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.624408 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:42.695848 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 71560.3us
I20260709 13:09:42.696120 23002 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
W20260709 13:09:42.604190 25143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.017s	sys 0.021s
I20260709 13:09:42.588626 23076 rpcz_store.cc:276] 0709 13:09:40.599021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.242890 (+643869us) service_pool.cc:224] Handling call
0709 13:09:41.243538 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.244101 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:41.597555 (+353454us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.534343 (+936788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.534410 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:42.534454 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.534518 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.534631 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":532500,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":70573,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":1255698,"threads_started":2,"wal-append.queue_time_us":993552}
I20260709 13:09:42.673990 22972 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:42.677544 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.677996 22927 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:42.662130 23653 rpcz_store.cc:276] 0709 13:09:41.215767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.215911 (+   144us) service_pool.cc:224] Handling call
0709 13:09:42.586306 (+1370395us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b54004de254. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:42.586410 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146583424}
I20260709 13:09:42.632393 25737 raft_consensus.cc:3055] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:42.679368 25683 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:42.568048 25734 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:42.604207 23649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 803) took 5361 ms (client timeout 1701 ms). Trace:
I20260709 13:09:42.730226 22972 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:42.619134 25592 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.687060 23650 rpcz_store.cc:276] 0709 13:09:39.792083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.857841 (+ 65758us) service_pool.cc:224] Handling call
0709 13:09:42.686521 (+2828680us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54005e01d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3925004853 00007f3929fd260a 00007f39235587d4 00007f3923558762 00007f3923558691 00007f392355860c 00007f39235578c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:42.686614 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531058560}
I20260709 13:09:42.655395 25693 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:42.698046 23621 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:42.671911 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 531) took 2335 ms. Trace:
I20260709 13:09:42.699613 25684 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.700951 25736 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.702085 22923 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:42.704514 25659 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:42.626024 25688 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.721863 25702 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:42.678953 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.706166 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:42.716347 22925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2123) took 2634 ms (client timeout 2112 ms). Trace:
I20260709 13:09:42.752681 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:42.753578 23071 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:42.719529 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.720331 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.641280 25591 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:42.675489 25713 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.672575 25377 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.672710 25699 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.619153 25718 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:42.733330 22970 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:42.735117 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.735984 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:42.737711 23079 rpcz_store.cc:276] 0709 13:09:40.291143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.291281 (+   138us) service_pool.cc:224] Handling call
0709 13:09:40.291644 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.292073 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.292112 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.292677 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.236946 (+944269us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b1800085840. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa0d1 00007f3924fc5a0f
0709 13:09:41.358978 (+122032us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:41.727805 (+368827us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.908286 (+180481us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800085840. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:42.588528 (+680242us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b1800085840. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3924bb24bc 00007f3921f0048b 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1a455 00007f3925002060 00007f3925014716 00007f3925025287
0709 13:09:42.588647 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.588721 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.617471 (+ 28750us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:42.626327 (+  8856us) raft_consensus.cc:1685] finished
0709 13:09:42.626347 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.626463 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12461,"prepare.queue_time_us":457437,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":29730,"raft.queue_time_us":151437,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":41311,"spinlock_wait_cycles":114680960,"thread_start_us":530042,"threads_started":3,"wal-append.queue_time_us":1310993}
I20260709 13:09:42.743024 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.745898 24895 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:42.707213 25742 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.706683 25737 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:42.747318 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.836776 22999 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:42.656852 25692 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.752547 22925 rpcz_store.cc:269] 0709 13:09:40.082254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.083426 (+  1172us) service_pool.cc:224] Handling call
0709 13:09:42.716138 (+2632712us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54003c91d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:42.716273 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4050276224}
I20260709 13:09:42.717653 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:42.759732 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:42.841843 22922 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.841907 23076 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:42.762060 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:42.843124 23075 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.653792 25660 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.767674 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:42.845185 23071 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.738253 25592 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:42.855705 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.763383 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:42.737594 25723 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.745086 25143 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:42.755339 22926 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:42.745042 25719 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:42.832067 22928 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
W20260709 13:09:42.805069 25715 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:42.747841 25659 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:42.837983 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:42.874655 23000 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:42.839381 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 103482us
W20260709 13:09:42.875417 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 377510us
I20260709 13:09:42.734748 25734 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.875308 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:42.881176 22972 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:42.881332 22896 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:42.762346 25688 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.882464 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:42.882956 22972 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:42.884042 23006 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:42.839612 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 106370us
W20260709 13:09:42.884755 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 328505us
I20260709 13:09:42.856652 25702 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.890525 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:42.890817 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 234761us
I20260709 13:09:42.891141 23650 raft_consensus.cc:2376] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7. Re-sending same reply.
I20260709 13:09:42.893595 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.886186 23622 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:42.856832 25684 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:42.895694 25684 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.895982 23657 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:42.896061 25684 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:42.897140 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.900148 23045 connection.cc:256] RPC call timeout handler was delayed by -1.7847230280000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260709 13:09:42.900794 23045 connection.cc:256] RPC call timeout handler was delayed by -1.5480917780000709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:09:42.888019 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.873888 25143 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:42.732434 23649 rpcz_store.cc:269] 0709 13:09:37.242904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.253553 (+ 10649us) service_pool.cc:224] Handling call
0709 13:09:39.110228 (+1856675us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:42.604045 (+3493817us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54006a1654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:42.604144 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2922597120}
I20260709 13:09:42.910926 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:42.907364 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.805398 25591 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:42.901186 23045 connection.cc:256] RPC call timeout handler was delayed by -1.5348751210000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
I20260709 13:09:42.908700 23651 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
W20260709 13:09:42.912432 23045 connection.cc:256] RPC call timeout handler was delayed by -1.5227228920000471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:09:42.912746 23045 connection.cc:256] RPC call timeout handler was delayed by -1.321428491000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:09:42.913022 23045 connection.cc:256] RPC call timeout handler was delayed by -1.1600898480000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 13:09:42.913398 23045 connection.cc:256] RPC call timeout handler was delayed by -1.1397196880000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2892s for a response
I20260709 13:09:42.883396 25659 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.836328 25377 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.840507 25699 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:42.913722 23045 connection.cc:256] RPC call timeout handler was delayed by -1.088290145999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:09:42.914813 23003 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:42.916255 22972 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:42.874837 25719 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:42.887475 25718 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.919476 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:42.919551 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0180803870000545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:09:42.900969 25670 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.900074 25548 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:42.919768 25239 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.919607 25740 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:09:42.910524 25700 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.236s
I20260709 13:09:42.915434 25143 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.857231 25692 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.924763 23654 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:42.957003 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.958168 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.914309 25673 consensus_queue.cc:1059] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:09:42.921612 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.921777 25719 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.922842 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.843327 25742 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:42.918653 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.962118 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.962842 23651 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.889104 25687 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:42.888706 25599 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.890655 25702 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.934067 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:42.927922 25604 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.932104 25718 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.876850 25723 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:42.918598 25674 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.940696 25758 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:42.936836 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:42.956045 25453 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:42.943845 24895 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:42.946697 23045 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:42.950729 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:42.917104 25757 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.044607 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 93957.1us
I20260709 13:09:42.959952 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:42.919597 25336 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:42.920555 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 594) took 1009 ms. Trace:
I20260709 13:09:43.047721 23003 rpcz_store.cc:276] 0709 13:09:41.911482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.878133 (+966651us) service_pool.cc:224] Handling call
0709 13:09:42.914506 (+ 36373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.920338 (+  5832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.920507 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.943499 25239 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.941078 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:42.941640 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50478.9us
I20260709 13:09:43.010890 23004 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
W20260709 13:09:43.023079 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 86306.2us
I20260709 13:09:42.962764 25548 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.044749 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 98348.5us
I20260709 13:09:42.943145 25576 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:43.045622 23652 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:42.964527 25599 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.966918 25712 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:42.975824 25702 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.053948 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.023573 25743 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.054358 22924 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:43.077482 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.081341 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.024739 25761 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:43.028034 25453 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.103896 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.104091 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.054137 25683 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.878597 25693 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.055011 25736 raft_consensus.cc:2764] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:43.056473 25239 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.102638 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682d24a2200c4222a401f9ab803af214"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:09:43.105233 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.129156 23045 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:43.129941 24895 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:43.078833 25670 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.086117 25632 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:43.108131 25453 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.082381 25704 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.109314 25683 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.082454 25336 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:43.124030 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.111554 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 177577us
I20260709 13:09:43.091107 25599 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.901161 25737 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.130074 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:43.109422 25717 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:43.099447 25761 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:43.109688 25673 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:43.122074 25751 log.cc:927] Time spent T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.294s	user 0.001s	sys 0.001s
I20260709 13:09:43.082986 25576 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.114599 25730 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:43.130048 25763 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:09:43.131083 25670 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.120389 25712 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.090831 25548 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.138655 23045 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:43.133284 25632 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.135378 25732 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.043491 25758 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.166409 25758 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.150671 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:43.144843 25673 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:43.139801 25683 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.057296 25757 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.151875 25688 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.153959 25336 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:43.155534 25768 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:43.156383 25692 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.156893 25591 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.159412 25658 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.152082 25732 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:43.161638 25723 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.163323 25548 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.141005 25746 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:43.153080 25559 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:43.168954 25673 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.147137 25576 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.169461 25742 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.148264 25737 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.175134 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:43.175390 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.204538 23657 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:43.176031 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.150727 25670 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.146720 25717 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:43.153079 25632 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.188174 25658 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.209075 25717 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.210064 25659 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.211061 23651 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:43.139343 25704 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.169023 25684 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:43.180289 25686 consensus_meta.cc:287] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.005s
I20260709 13:09:43.199311 25746 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:43.179941 25718 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.216609 25711 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.207765 25453 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.217053 25711 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.217439 25711 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.218532 25453 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:43.219512 25681 consensus_meta.cc:287] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.001s
I20260709 13:09:43.207451 25559 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:43.220046 25632 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.220793 25559 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.188885 25732 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.224144 25632 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.188407 25761 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.225898 25761 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:43.222339 25727 consensus_meta.cc:287] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.544s	user 0.003s	sys 0.002s
I20260709 13:09:43.232630 25719 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.224212 25734 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.236209 25719 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.234105 25713 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.236863 25757 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:43.238283 25713 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:43.241874 25700 raft_consensus.cc:3055] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:43.242393 25700 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:43.250914 25659 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:43.227145 25746 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.251495 25699 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.253496 25658 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.243310 25700 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.239148 25711 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.256379 25684 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.256660 25704 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.257007 25711 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.259409 25702 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.261801 25667 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.262442 25702 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.224462 25686 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.270205 25686 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:43.271102 25766 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
W20260709 13:09:43.274071 25776 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 13:09:43.292335 25673 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.295150 25673 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.299520 25732 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.302263 25732 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:43.303476 25683 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.306097 25683 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.291316 25670 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:43.340181 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.097646 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 43773.2us
W20260709 13:09:43.344820 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.346525 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.351986 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:43.377314 22827 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 4 to 5, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 5 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.389952 22827 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 6, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 6 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.397677 22827 catalog_manager.cc:5697] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:09:43.400375 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.402261 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.401263 23001 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:09:43.401583 23004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1726) took 3004 ms (client timeout 1527 ms). Trace:
I20260709 13:09:43.403724 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:43.403985 23004 rpcz_store.cc:269] 0709 13:09:40.402310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.402474 (+   164us) service_pool.cc:224] Handling call
0709 13:09:43.400928 (+2998454us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b54000ef6d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:43.401192 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5710206080}
I20260709 13:09:43.404585 23002 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:43.404824 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.405340 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.405562 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.406141 23005 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:43.406665 23003 raft_consensus.cc:606] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:43.406785 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.407238 23003 raft_consensus.cc:614] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:43.400414 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.408967 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1743) took 2079 ms. Trace:
I20260709 13:09:43.409487 23001 rpcz_store.cc:276] 0709 13:09:41.329720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.331325 (+  1605us) service_pool.cc:224] Handling call
0709 13:09:41.331673 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.407906 (+2076233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.408602 (+   696us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54003a9b54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:43.408888 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4757634304}
I20260709 13:09:43.410496 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1722) took 3022 ms. Trace:
I20260709 13:09:43.410923 23006 rpcz_store.cc:276] 0709 13:09:40.387803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.387899 (+    96us) service_pool.cc:224] Handling call
0709 13:09:40.400910 (+ 13011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.884678 (+2483768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.410003 (+525325us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b5400098654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:43.410291 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5710247168}
W20260709 13:09:43.416549 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.417060 23046 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.537s	user 0.012s	sys 0.018s
W20260709 13:09:43.417563 23046 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.538s	user 0.012s	sys 0.018s
I20260709 13:09:43.409036 23000 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.213143 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.206670 23655 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:43.205791 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.432487 23004 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:43.406301 23002 raft_consensus.cc:2376] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8. Re-sending same reply.
I20260709 13:09:43.472354 25548 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:43.473448 25548 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:43.475262 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 59650us
I20260709 13:09:43.481060 23656 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:43.481503 25711 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:43.481369 25742 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:43.481779 25688 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:43.482463 25711 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.205534 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.487955 25717 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:43.488715 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 69174.5us
I20260709 13:09:43.492316 25732 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:43.493180 25732 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.494355 23046 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:43.495782 25591 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:09:43.496886 25736 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.502808 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:43.506865 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.509800 25377 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.509881 25723 consensus_queue.cc:1059] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:43.513221 23657 raft_consensus.cc:2393] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:43.520244 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.529405 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.514025 22928 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:43.534667 22998 raft_consensus.cc:2376] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8. Re-sending same reply.
I20260709 13:09:43.521209 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:43.543624 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 445581us
I20260709 13:09:43.546451 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:43.555572 25586 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.511626 25723 raft_consensus.cc:3055] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:43.544670 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.516116 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 331182us
I20260709 13:09:43.529024 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:43.530005 23649 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:43.573490 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.519712 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:43.521449 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 857) took 1787 ms. Trace:
I20260709 13:09:43.518959 22827 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.521733 23654 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:43.538661 23652 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:43.543475 25670 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:43.554311 25143 consensus_meta.cc:287] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.003s
I20260709 13:09:43.559993 25700 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:43.600672 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.606310 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.618458 25786 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.619165 25786 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.621704 25786 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.622225 25786 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.622773 25786 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.624173 22998 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:43.625590 23653 raft_consensus.cc:2410] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:43.626977 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.627164 25711 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.627803 23003 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:43.628415 23657 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:43.629593 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.630795 25586 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:43.631762 25592 consensus_meta.cc:287] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
I20260709 13:09:43.631912 25586 raft_consensus.cc:3055] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.632404 25586 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:43.632227 25592 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.633751 22997 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:43.633662 25586 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:43.634876 22997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 589) took 1724 ms (client timeout 2078 ms). Trace:
I20260709 13:09:43.635058 25586 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.597429 25723 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:43.635686 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:43.636560 22928 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.637223 23621 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.638216 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:43.638964 22922 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.639110 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.638722 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:43.638365 25775 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:43.636813 25723 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:43.634800 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 537805us
I20260709 13:09:43.639570 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.596416 25732 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.642827 22924 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:09:43.635402 22997 rpcz_store.cc:269] 0709 13:09:41.910235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.547884 (+637649us) service_pool.cc:224] Handling call
0709 13:09:43.634653 (+1086769us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54000efbd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:43.634806 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244841216}
I20260709 13:09:43.628693 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:43.662518 22929 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.648752 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.644853 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 865) took 1091 ms. Trace:
I20260709 13:09:43.646703 23654 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:43.646354 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.650183 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.647147 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.668280 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.652386 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.651177 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:43.647346 22970 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:43.646970 22827 catalog_manager.cc:5697] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 4, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 4 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:09:43.650391 22926 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:43.665879 23656 rpcz_store.cc:276] 0709 13:09:42.553134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.605318 (+ 52184us) service_pool.cc:224] Handling call
0709 13:09:43.624305 (+1018987us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54006a1654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:43.644802 (+ 20497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948484864}
I20260709 13:09:43.667496 25548 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.650978 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:43.676895 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.670264 23651 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:43.676393 23000 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:09:43.667518 25722 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.684116 22998 raft_consensus.cc:2368] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:09:43.685029 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.685693 22998 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:43.643447 25143 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.686591 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.687209 22998 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.669866 23649 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:43.688326 25143 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.689390 22827 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 3 to 5, now has a pending config: VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194), VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195), VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 5 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:43.692358 22999 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:43.696301 23005 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:09:43.697476 23003 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:43.704736 25692 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:43.698426 25722 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:43.707062 25599 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.006s
I20260709 13:09:43.707155 25722 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.651889 25743 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:43.708470 22922 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:43.667904 25711 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.709558 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.709121 22928 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:43.709522 22971 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.714346 23006 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:43.710363 25377 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.716159 23004 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
W20260709 13:09:43.716290 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 197830us
I20260709 13:09:43.719275 22925 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.707556 25599 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.718956 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.717927 22827 catalog_manager.cc:5697] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 2, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.730754 23656 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:43.718871 25377 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:43.732031 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 49830.1us
I20260709 13:09:43.719255 25670 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.731464 23000 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:09:43.735267 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 161934us
W20260709 13:09:43.735966 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.646579 25775 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:43.738968 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 100428us
I20260709 13:09:43.731246 25723 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.744437 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.745111 23000 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:43.733915 25377 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:43.750036 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 102865us
I20260709 13:09:43.751430 23655 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:43.755869 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.755988 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.757699 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:43.759121 25736 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:43.759811 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:43.760010 25736 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.760483 25736 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.760897 25736 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.761747 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.762768 25711 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:43.763547 25711 consensus_queue.cc:1243] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:09:43.766155 25239 consensus_meta.cc:287] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.003s
I20260709 13:09:43.766558 25239 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.772092 23046 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:43.773248 25559 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.773515 23046 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.774863 25559 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:43.775156 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:43.775290 25559 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:43.775956 25559 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:43.775514 25576 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.567s	user 0.004s	sys 0.005s
I20260709 13:09:43.780241 25713 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:43.780023 25576 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.780644 25713 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:43.781059 25713 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.781378 23001 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:43.782078 25576 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:43.743458 25700 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.805913 23006 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:09:43.800217 23002 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:43.763689 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.753274 22827 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 3 to 4, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:43.806192 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49162.4us
I20260709 13:09:43.812912 22970 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:43.814337 25692 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:43.814834 25692 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:43.815269 25692 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.808126 22929 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:43.816390 22998 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:43.806187 22925 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:43.753031 25592 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.825114 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 590) took 1914 ms. Trace:
I20260709 13:09:43.825480 22999 rpcz_store.cc:276] 0709 13:09:41.910515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.852615 (+942100us) service_pool.cc:224] Handling call
0709 13:09:42.879988 (+ 27373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.692753 (+812765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.824823 (+132070us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54000c80d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:43.825036 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867440512}
I20260709 13:09:43.827981 23621 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:43.829416 25651 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:43.830221 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.830157 25651 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:43.831776 22827 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 4 to 6, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 6 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:43.833554 22827 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 4 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:43.835108 22827 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 4 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:09:43.847827 25786 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.853013 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:43.763480 25702 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:43.853832 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:43.856050 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 175743us
W20260709 13:09:43.857436 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 142693us
W20260709 13:09:43.862084 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45406.9us
I20260709 13:09:43.599900 23648 rpcz_store.cc:276] 0709 13:09:41.734325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.734480 (+   155us) service_pool.cc:224] Handling call
0709 13:09:41.734819 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.898083 (+163264us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:42.653393 (+755310us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.042550 (+389157us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.085701 (+ 43151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.095961 (+ 10260us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:43.100403 (+  4442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.270525 (+170122us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:43.272745 (+  2220us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b180016f3c0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:43.520914 (+248169us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540063d8d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:43.520985 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.521213 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22498,"prepare.queue_time_us":836094,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":8227,"raft.queue_time_us":81879,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":5805,"spinlock_wait_cycles":362368384,"thread_start_us":1008337,"threads_started":3,"wal-append.queue_time_us":314653}
I20260709 13:09:43.866241 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.869943 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:43.874770 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68899.6us
I20260709 13:09:43.875965 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.821602 25700 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.880029 25749 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.880247 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:43.881572 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:43.881721 23078 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:43.764287 25660 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:43.870343 25592 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:43.885008 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 109965us
I20260709 13:09:43.891011 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.886094 22827 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.859283 25732 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.890241 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.895581 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:43.897156 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:43.897284 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:43.898121 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:43.892228 25670 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:43.885564 25700 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.900466 23075 raft_consensus.cc:2376] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4. Re-sending same reply.
I20260709 13:09:43.904335 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:43.885885 25749 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.870633 25377 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:43.892511 25592 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.869979 25559 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:43.888798 25660 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.914357 22930 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:43.902799 25651 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:43.920289 25599 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:43.914965 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.921953 23046 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:43.927140 23077 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:43.927835 23079 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:43.918242 22827 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 3, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.932564 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.881219 25775 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:43.912533 25749 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.935273 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:43.936510 22999 raft_consensus.cc:2410] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:43.918569 25592 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.942658 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.944705 22972 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:43.921640 25660 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.946918 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.932801 25702 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:43.920764 25651 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:43.917768 25670 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:43.960294 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:43.945526 22827 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 4 to 5, VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195) evicted. New cstate: current_term: 2 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.955643 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:43.964861 23004 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:43.959187 23003 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:43.959313 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49847.1us
I20260709 13:09:43.937145 25723 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:43.938503 25746 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:43.967936 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 53695.1us
I20260709 13:09:43.937302 25239 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:43.964495 25651 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.978977 25702 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:43.973964 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:43.985841 23071 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:43.984086 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 97455.5us
I20260709 13:09:43.977887 25775 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.984674 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:43.969787 25746 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.999523 25775 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:43.973654 25599 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:43.984493 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:44.011056 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.011260 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:44.011934 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 93396.2us
I20260709 13:09:44.012264 22896 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:44.001142 25711 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:44.016443 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:44.004878 25746 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.004554 25775 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.972544 25736 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.006103 25336 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:44.036010 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 65108.5us
I20260709 13:09:44.034236 23074 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:44.046262 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.046633 25559 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:44.046204 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 318620us
I20260709 13:09:44.047326 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:44.025451 25599 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:44.052873 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.053277 25736 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.053735 22928 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:44.053982 25736 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:44.067323 25452 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:44.067408 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:44.074920 25787 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.075791 25452 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:44.075552 25787 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.076930 25452 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:44.078153 25787 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.079028 25586 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:44.079535 25586 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:44.080000 25586 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.084766 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.085554 22928 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:44.086031 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.087193 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.087780 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.088019 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.088732 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.088824 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.089507 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.089636 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.090339 22997 raft_consensus.cc:2410] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:44.090375 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.090754 23000 raft_consensus.cc:2393] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:44.091698 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.092916 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.093618 23004 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:44.096069 23073 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:44.097939 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:44.099224 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.089660 22928 raft_consensus.cc:2410] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:44.097200 25559 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.103487 25699 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.103240 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.103984 25559 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.104598 22923 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:44.104136 25699 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.104002 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.105720 22931 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:44.106156 25559 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.106693 25699 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:43.995218 25743 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:09:44.110919 23003 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
W20260709 13:09:44.103293 25792 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:09:44.115906 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.138881 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.139513 23003 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
W20260709 13:09:44.132701 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 100516us
W20260709 13:09:44.141819 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 134041us
I20260709 13:09:44.145215 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.148698 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.039713 25722 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.148636 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:44.152201 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 166591us
W20260709 13:09:44.156586 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 246384us
I20260709 13:09:44.157119 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.143705 25377 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:44.158978 23003 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:44.108101 25336 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.165572 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.159638 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:44.152971 25736 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:44.168978 23653 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:09:44.171412 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.172827 22925 raft_consensus.cc:2393] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 2: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:44.173938 23003 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:44.178711 25775 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.181209 23073 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:44.181862 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.182304 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.183981 25599 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.199098 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.201370 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.202049 23003 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:44.199263 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 100612us
I20260709 13:09:44.208595 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.169670 25736 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:44.170079 25711 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:44.234336 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 79711.8us
I20260709 13:09:44.238960 25749 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.240785 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:44.246021 23656 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:44.245743 25711 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.240694 25470 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:09:44.241120 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.247879 23655 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:44.248024 25801 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:09:44.249454 23648 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:44.241591 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:44.241747 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:44.240820 25732 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:44.242184 23649 pending_rounds.cc:85] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 6
I20260709 13:09:44.242376 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.257767 23651 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:44.243103 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.258726 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.243597 25713 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.244102 25736 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.255483 22929 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.256064 23655 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:44.261483 22928 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:44.146675 25702 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:44.266372 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.273950 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.276057 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:44.278208 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 116702us
I20260709 13:09:44.157037 25670 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.292040 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.293299 23004 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:44.302709 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.294230 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.294646 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:44.302651 22928 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:44.260617 25377 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:44.310141 23071 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:44.316325 22931 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:44.322302 25452 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:44.322752 25452 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.323076 25452 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:44.323201 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 174663us
I20260709 13:09:44.324498 22896 leader_election.cc:400] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:09:44.324777 22896 leader_election.cc:403] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:44.325476 25336 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:44.326624 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:44.329963 25700 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.263069 23649 pending_rounds.cc:107] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:44.333976 23002 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:44.334084 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.335243 23079 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:44.337854 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:44.335614 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.347501 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.348097 23079 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:44.347965 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.348053 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.353715 23652 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:44.354532 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.354420 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.355599 23652 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:44.356472 23651 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:44.357331 23657 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:44.331636 25797 log.cc:927] Time spent T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.003s
I20260709 13:09:44.360706 23656 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:44.358100 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 182504us
I20260709 13:09:44.266916 25586 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:44.365665 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.367273 23071 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:44.358639 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.373457 23655 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:44.375286 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.336755 23649 raft_consensus.cc:2889] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.380825 23652 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:44.361373 25717 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.394451 25717 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.394856 25717 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:44.398739 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.384071 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.384577 23075 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:44.401473 25548 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.401678 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.402150 25548 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.402887 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.403156 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:44.361543 25591 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:09:44.404241 25591 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.405295 23621 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:44.389616 23080 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:44.409255 25699 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:44.409793 25699 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:44.387849 22998 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:44.410830 25699 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.390102 25775 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:44.412079 23648 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:44.412791 25700 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.414645 25592 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:44.405546 23073 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:44.415752 22999 raft_consensus.cc:2368] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7.
I20260709 13:09:44.390000 23074 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:44.406176 25713 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:44.416989 25586 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:44.417181 25723 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:44.417343 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.417928 25693 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:44.418089 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.419018 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.419888 23072 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:44.420058 23655 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:44.420478 25736 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.420554 25775 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:44.422616 25692 consensus_meta.cc:287] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.001s
I20260709 13:09:44.425913 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.365669 25732 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:44.426529 23079 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:44.429955 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.430842 23003 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:44.435973 23077 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:44.438730 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.442623 22929 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:44.424186 25548 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.448163 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.448760 22998 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 2.
I20260709 13:09:44.450281 22972 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:44.355569 25651 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.460728 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.460253 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:44.462321 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 83259.2us
I20260709 13:09:44.467460 23045 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:44.422995 25452 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:44.466281 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.469048 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:44.484375 23004 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:44.470391 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:44.486846 23655 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:44.470393 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:44.468931 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.489441 23654 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:44.489993 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.469195 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:44.493151 22929 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.463898 25775 consensus_queue.cc:1243] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:44.494741 23653 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:44.468780 25673 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:44.496884 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.497731 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.514003 23079 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:44.500108 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.515043 23071 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:44.515101 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.500484 25799 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.266s	user 0.000s	sys 0.002s
I20260709 13:09:44.500943 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.500808 25717 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:44.501653 25787 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:44.501713 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:44.494747 25548 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.502554 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:44.437263 25692 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.503048 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:44.503861 25732 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:44.506860 25794 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.272s	user 0.000s	sys 0.002s
I20260709 13:09:44.507869 25803 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:44.489817 25599 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:09:44.517258 25812 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.517563 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.538232 25711 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:44.538722 23075 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:44.535454 23073 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:44.540036 25732 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.685670 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.638895 23002 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:44.693734 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:44.684079 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:44.688725 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 185766us
I20260709 13:09:44.554728 23005 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:44.695930 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.552063 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.691980 23074 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:44.676219 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:44.684509 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.546221 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.567123 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:44.697808 22922 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.549808 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:44.675822 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.699570 22998 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:09:44.677137 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.551970 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:44.701975 23652 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:44.557155 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 93204.8us
I20260709 13:09:44.702598 23650 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:44.706918 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:44.513372 25673 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:44.518291 25660 consensus_meta.cc:287] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:09:44.667254 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:44.709685 23657 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:44.674324 25746 consensus_meta.cc:287] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.000s
I20260709 13:09:44.709671 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:44.544924 25749 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.711799 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:44.755056 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:44.786793 23651 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:44.760430 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.765201 22922 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:44.796311 22924 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:44.983543 22926 raft_consensus.cc:1813] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Handling vote request from an unknown peer b655449a388a41e3a606c6ea794825ad
I20260709 13:09:44.711525 23079 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
W20260709 13:09:44.804342 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 97539.5us
I20260709 13:09:44.734972 22997 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:44.759478 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:44.787643 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 84594us
I20260709 13:09:44.985772 23621 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:44.713330 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 371516us
I20260709 13:09:44.986241 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:44.986959 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:44.674916 25808 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:44.983093 23655 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 1.
I20260709 13:09:44.787572 23072 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:44.555641 25651 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:44.787297 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.866004 23656 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:44.982714 23004 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:44.545080 25722 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:45.031603 22930 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:44.937387 25809 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 13:09:45.030475 25660 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.033288 25775 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.034044 23001 raft_consensus.cc:2368] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:45.024556 23073 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:44.701018 25452 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:45.022073 25746 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.037642 25746 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:44.984989 22926 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:44.545357 25692 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:45.027184 25815 log.cc:927] Time spent T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:09:45.039131 25660 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:45.027856 25803 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:45.039783 25660 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:45.039979 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 53113.2us
I20260709 13:09:45.040562 25660 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:45.041026 25660 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:45.041719 25700 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:45.041865 25660 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:45.038635 25143 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:45.044404 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 58233.7us
I20260709 13:09:45.045746 22926 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:45.046934 25452 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:45.047137 22930 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:44.640791 25548 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:45.027953 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 272978us
W20260709 13:09:45.027225 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.804097 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 44970.4us
I20260709 13:09:45.056818 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:44.713490 25713 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:44.808012 25699 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.715807 25673 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:45.029536 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:44.787400 25812 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.022087 25808 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:45.073644 25749 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.074128 25808 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:44.544245 25592 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:45.075186 25812 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:45.030243 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:45.075693 25592 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:45.075990 25717 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:45.076074 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 45904.2us
I20260709 13:09:45.076684 25717 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:45.076856 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:45.077111 25717 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:45.077546 25717 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:45.074147 25749 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.078312 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:44.912467 25814 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:09:45.005977 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:45.079975 25749 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:45.081117 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.075248 25808 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:45.081751 22923 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:45.082656 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:45.064324 25713 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:45.031239 25823 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:45.033959 25377 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.088701 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.089177 22923 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:45.089265 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 83346.4us
I20260709 13:09:45.038209 25239 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:44.795823 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.052364 22929 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.000s
I20260709 13:09:45.090822 22929 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:45.091913 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:44.909864 25811 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.372s	user 0.000s	sys 0.000s
I20260709 13:09:45.094272 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 616) took 1171 ms. Trace:
I20260709 13:09:45.094430 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:45.062759 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 328286us
I20260709 13:09:45.094775 23001 rpcz_store.cc:276] 0709 13:09:43.923160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.923309 (+   149us) service_pool.cc:224] Handling call
0709 13:09:45.088856 (+1165547us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540030e8d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:45.094207 (+  5351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506284416}
I20260709 13:09:45.064159 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:45.085585 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.086037 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.096565 22928 raft_consensus.cc:2393] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:45.097594 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:45.098922 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.093441 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.057868 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.100716 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:45.100752 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.101976 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.103580 22926 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:45.108511 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 44423.9us
I20260709 13:09:45.109189 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:45.110424 22930 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:45.083520 25813 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:45.113729 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:45.111394 23045 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:45.116343 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 51393.2us
I20260709 13:09:45.117031 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.086896 25591 raft_consensus.cc:2764] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:45.113013 22931 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:45.121536 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.121935 23077 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:45.058049 25143 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 13:09:45.123968 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 67268.9us
W20260709 13:09:45.127014 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 72108.1us
W20260709 13:09:45.125571 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 97685.3us
I20260709 13:09:45.128449 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.130239 23073 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.130263 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.131084 23077 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.131081 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.130584 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.133159 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:45.133445 23071 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:45.118279 25813 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:45.134512 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.140132 23075 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.140553 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:45.143814 25699 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.136315 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.122767 25722 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:45.124284 25803 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.139338 22929 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:45.139493 22926 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:09:45.149780 23077 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:45.152040 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.152643 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:45.153085 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.145191 25813 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.153805 23076 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:45.154445 23045 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:45.154999 25810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.009s	sys 0.034s
I20260709 13:09:45.155205 25821 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:45.119199 25673 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.124688 25651 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:45.156234 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.161731 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.163309 23075 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:45.126354 25336 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:09:45.195305 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 86165.8us
W20260709 13:09:45.162400 25817 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:09:45.146550 25591 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:09:45.162647 25746 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.220002 25746 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.221514 25336 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:45.221951 25336 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:45.222867 25548 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:45.223907 25711 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.224229 25470 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.224723 25470 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.227487 25713 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:45.223013 25336 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.229820 25336 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:45.230417 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:45.230832 22926 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:45.230938 23652 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
I20260709 13:09:45.236068 23652 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:45.236141 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.236831 22924 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:45.165884 25810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.010s	sys 0.034s
I20260709 13:09:45.200306 22971 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:45.206736 23073 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:45.215778 25831 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.216187 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:45.202790 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.231019 22930 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:45.241382 22923 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:45.244650 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:45.245826 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:45.247498 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 113265us
I20260709 13:09:45.255512 22998 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:45.250087 23080 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:45.262626 23621 leader_election.cc:400] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:45.262966 23621 leader_election.cc:403] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:45.200245 25821 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:45.271257 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:45.271965 23000 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.272166 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:45.273016 22999 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:45.263447 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:45.276305 23001 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:45.264412 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:45.265093 22929 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:45.278079 23077 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:45.279268 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.283953 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:45.285573 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 140886us
I20260709 13:09:45.232496 25830 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.279843 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:45.287703 23003 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:45.297268 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.257526 25749 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:45.258369 25699 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:45.310722 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:45.304162 22814 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adf5adaae5184191bdaff064d051da2a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b655449a388a41e3a606c6ea794825ad is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:09:45.305595 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 51063us
W20260709 13:09:45.306103 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 54910.7us
I20260709 13:09:45.313421 23652 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:45.308359 25717 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:45.308929 25377 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:45.309484 25713 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.279101 25548 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.324501 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.325253 23073 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
W20260709 13:09:45.299574 25736 consensus_meta.cc:287] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.851s	user 0.010s	sys 0.000s
I20260709 13:09:45.167583 25803 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.310782 23080 raft_consensus.cc:2376] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4. Re-sending same reply.
W20260709 13:09:45.317719 25787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.019s	sys 0.038s
I20260709 13:09:45.332507 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:45.335083 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:45.340297 25699 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.340814 25239 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:45.261039 25723 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:09:45.303412 25831 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:45.278642 25822 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:45.348654 23000 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:09:45.345492 23078 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:09:45.350242 22927 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:45.350310 23077 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
W20260709 13:09:45.350229 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 150019us
I20260709 13:09:45.385061 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.353614 25239 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.385881 23073 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:45.395772 23071 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:45.344027 25787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.020s	sys 0.038s
I20260709 13:09:45.397631 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.359915 25377 raft_consensus.cc:697] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:45.384157 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:45.352174 25548 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:45.407967 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 73054.1us
I20260709 13:09:45.415364 23071 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:45.351871 25722 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:45.419147 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.423293 23073 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
W20260709 13:09:45.419170 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 132931us
I20260709 13:09:45.384207 25822 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.394814 25736 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:45.423610 23046 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:45.397487 25787 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:45.416271 25723 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:45.428529 22971 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:45.428730 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 67495.2us
I20260709 13:09:45.440697 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.445482 23077 raft_consensus.cc:2410] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:45.419194 25835 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:45.422799 25831 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:45.451918 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 99200.4us
I20260709 13:09:45.407940 25838 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:09:45.427415 25822 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.432425 25723 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:45.475617 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:45.477193 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 43903.6us
W20260709 13:09:45.479190 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 67585us
I20260709 13:09:45.476249 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:45.482095 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 53638.3us
I20260709 13:09:45.443558 25664 consensus_queue.cc:1059] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:45.454953 25670 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:45.485144 23046 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:45.425769 25839 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:09:45.488863 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 156480us
I20260709 13:09:45.489607 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:45.456044 25736 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:45.495175 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:45.507167 23073 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:45.496080 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:45.494406 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:45.494086 22971 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:45.507119 25591 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:09:45.425469 25821 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:45.497637 22972 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:45.484191 25711 raft_consensus.cc:697] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:45.641607 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 156492us
W20260709 13:09:45.820256 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 325882us
W20260709 13:09:46.024479 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 526861us
W20260709 13:09:46.013453 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 519397us
W20260709 13:09:45.643571 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 198664us
W20260709 13:09:46.020313 22896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.007s
W20260709 13:09:46.026832 22896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.007s
I20260709 13:09:46.025346 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:09:46.027208 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 534572us
I20260709 13:09:46.028834 23046 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:45.493722 25834 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:45.889505 25336 consensus_meta.cc:287] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.000s
W20260709 13:09:45.914754 25813 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.716s	user 0.005s	sys 0.005s
I20260709 13:09:45.496311 25842 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:46.053761 25838 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:09:46.060760 25859 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:46.061458 25859 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:45.819562 25843 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.582s
I20260709 13:09:46.080042 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:45.801913 25787 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.112838 25859 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:46.114850 25711 consensus_queue.cc:237] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:45.710696 25670 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:45.876834 25844 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
W20260709 13:09:46.010805 23649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.018s	sys 0.064s
I20260709 13:09:45.897648 25839 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.896147 25803 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:45.495805 25841 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.600s
W20260709 13:09:46.118975 23076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.011s
W20260709 13:09:46.240378 23076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.010s	sys 0.011s
I20260709 13:09:46.042299 23073 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:46.241255 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2095) took 1007 ms. Trace:
W20260709 13:09:46.124686 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 96045.1us
I20260709 13:09:45.868191 25855 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.867798 25849 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:45.496644 25592 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.545s
I20260709 13:09:45.868046 25833 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.709045 25660 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.411s
I20260709 13:09:46.241649 23073 rpcz_store.cc:276] 0709 13:09:45.233432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.495021 (+261589us) service_pool.cc:224] Handling call
0709 13:09:46.241182 (+746161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.238842 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 118874us
W20260709 13:09:46.195899 23649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.020s	sys 0.066s
W20260709 13:09:46.260066 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.006s	sys 0.029s
I20260709 13:09:45.839573 25736 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.366s
W20260709 13:09:46.272728 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.007s	sys 0.029s
W20260709 13:09:46.205312 25713 consensus_meta.cc:287] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.000s
W20260709 13:09:46.231913 25822 consensus_meta.cc:287] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.003s
I20260709 13:09:45.839779 25723 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:46.305126 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 55203.1us
I20260709 13:09:46.307404 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2098) took 1073 ms. Trace:
I20260709 13:09:46.119683 25813 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:46.246978 25838 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:46.315445 23080 rpcz_store.cc:276] 0709 13:09:45.234145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.266326 (+ 32181us) service_pool.cc:224] Handling call
0709 13:09:46.307206 (+1040880us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b54000889d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:46.307341 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22336384}
I20260709 13:09:46.271342 25803 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.269394 25849 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.802220 25722 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:46.321071 23072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 552) took 1811 ms (client timeout 1525 ms). Trace:
I20260709 13:09:45.789016 25377 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.332799 25775 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:45.872555 25831 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.301643 25713 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:46.331921 23075 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:46.339957 23072 rpcz_store.cc:269] 0709 13:09:44.496983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.508817 (+ 11834us) service_pool.cc:224] Handling call
0709 13:09:46.308047 (+1799230us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b540021aa54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:46.308178 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42058112}
I20260709 13:09:46.345783 23080 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:46.334594 25670 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:46.369693 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:46.385010 22925 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:46.194886 25842 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.305787 25822 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.585196 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2085) took 1440 ms. Trace:
W20260709 13:09:46.585232 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 559905us
W20260709 13:09:46.525900 22897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.028s
W20260709 13:09:46.586161 22897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.013s	sys 0.033s
I20260709 13:09:46.581791 25812 raft_consensus.cc:3055] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:46.436990 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 50009.8us
I20260709 13:09:46.586786 25812 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:46.586987 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.585776 23075 rpcz_store.cc:276] 0709 13:09:45.144966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.314115 (+1169149us) service_pool.cc:224] Handling call
0709 13:09:46.314496 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.584940 (+270444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.585138 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.587872 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.530102 22894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.000s	sys 0.035s
W20260709 13:09:46.588747 22894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.006s	sys 0.046s
I20260709 13:09:46.588907 23075 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:46.589600 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2088) took 1358 ms. Trace:
I20260709 13:09:46.590049 23075 rpcz_store.cc:276] 0709 13:09:45.231668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.588432 (+1356764us) service_pool.cc:224] Handling call
0709 13:09:46.588745 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.589338 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.589518 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.588160 25812 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.593482 25812 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:46.594816 25830 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:46.527926 25239 consensus_meta.cc:287] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 1.118s	user 0.011s	sys 0.000s
I20260709 13:09:46.597513 25822 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:46.598258 25239 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.600283 25842 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:46.428117 22895 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.540s (SENT) [suppressed 35 similar messages]
W20260709 13:09:46.342944 23045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.007s	sys 0.035s
W20260709 13:09:46.607925 23045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.010s	sys 0.035s
W20260709 13:09:46.608237 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.11356e+06us
I20260709 13:09:46.323805 25839 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:46.466888 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 437901us
I20260709 13:09:46.576606 23656 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:46.595352 25830 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.626508 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2086) took 1470 ms. Trace:
I20260709 13:09:46.643389 23080 rpcz_store.cc:276] 0709 13:09:45.156279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.324717 (+1168438us) service_pool.cc:224] Handling call
0709 13:09:46.345626 (+ 20909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.626214 (+280588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.626437 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.346941 25664 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.012s	sys 0.026s
W20260709 13:09:46.647177 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 404455us
I20260709 13:09:46.612007 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:46.380123 25700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.015s	sys 0.035s
W20260709 13:09:46.640925 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 560933us
I20260709 13:09:46.634843 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:46.647955 23046 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:46.331211 25849 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:46.648547 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 278945us
W20260709 13:09:46.652205 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 224119us
I20260709 13:09:46.663617 23080 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.662752 23072 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:46.664645 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2096) took 1431 ms. Trace:
I20260709 13:09:46.665050 23072 rpcz_store.cc:276] 0709 13:09:45.233707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.626039 (+1392332us) service_pool.cc:224] Handling call
0709 13:09:46.656147 (+ 30108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.664382 (+  8235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.664594 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.625694 25787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.008s
I20260709 13:09:46.395813 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 837) took 2117 ms. Trace:
W20260709 13:09:46.682861 22895 leader_election.cc:336] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.626s (SENT)
I20260709 13:09:46.394740 25775 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.693027 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2097) took 1459 ms. Trace:
W20260709 13:09:46.692967 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 105805us
I20260709 13:09:46.646318 25830 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:46.671013 25787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.008s
W20260709 13:09:46.652972 25700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.034s	sys 0.056s
I20260709 13:09:46.697757 23080 rpcz_store.cc:276] 0709 13:09:45.233914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.644409 (+1410495us) service_pool.cc:224] Handling call
0709 13:09:46.663410 (+ 19001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.675819 (+ 12409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.692939 (+ 17120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.698994 23045 leader_election.cc:400] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7.
W20260709 13:09:46.698845 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 50975.1us
W20260709 13:09:46.698607 22895 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.693s (SENT)
I20260709 13:09:46.645053 25838 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.635896 25839 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:46.662946 25855 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:46.648789 25664 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.024s	sys 0.049s
W20260709 13:09:46.647987 25868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.003s	sys 0.022s
I20260709 13:09:46.679759 25851 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:46.731122 25851 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.733507 25851 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:46.684993 25660 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.686417 25863 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:46.718313 23045 leader_election.cc:403] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:46.717787 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:46.752665 23046 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:46.718802 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:46.682230 25813 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:46.684643 25860 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.684973 25861 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:09:46.723410 25868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.006s	sys 0.025s
I20260709 13:09:46.723852 25869 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.724737 25855 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:46.725425 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:46.726197 25865 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:46.729048 25775 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:46.704633 25836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.019s	sys 0.064s
I20260709 13:09:46.683324 25872 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:46.777405 25803 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:46.719451 25839 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.718261 25548 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:46.831128 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2095) took 1705 ms. Trace:
I20260709 13:09:46.834244 25870 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:46.795636 25711 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.001s	sys 0.011s
W20260709 13:09:46.852095 25711 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.002s	sys 0.011s
I20260709 13:09:46.852221 25864 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.852787 25864 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.704099 25856 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:09:46.840734 23076 rpcz_store.cc:276] 0709 13:09:45.125462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.163129 (+ 37667us) service_pool.cc:224] Handling call
0709 13:09:45.199819 (+ 36690us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:45.442026 (+242207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.442087 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:45.479378 (+ 37291us) log.cc:844] Serialized 52 byte log entry
0709 13:09:46.271802 (+792424us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.698717 (+426915us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.830724 (+132007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.830826 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.830884 (+    58us) raft_consensus.cc:1685] finished
0709 13:09:46.830901 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.831048 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95472,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6018,"thread_start_us":1414298,"threads_started":4,"wal-append.queue_time_us":1017664}
I20260709 13:09:46.799835 25863 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.855450 25871 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:46.721446 25713 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:09:46.856069 25871 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.777221 25660 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:46.842006 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:46.842747 25840 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:46.842981 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1772) took 1762 ms. Trace:
I20260709 13:09:46.824344 25838 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.843050 25821 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.843485 25880 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:46.835428 25836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.020s	sys 0.067s
I20260709 13:09:46.853184 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2090) took 1733 ms. Trace:
I20260709 13:09:46.842617 25873 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.858177 25660 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:46.965567 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 271020us
I20260709 13:09:46.844969 25813 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:46.996348 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 291052us
I20260709 13:09:47.001909 25813 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:46.957412 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 258805us
I20260709 13:09:47.002629 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:47.003386 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.002879 25813 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.003811 25851 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.860785 25872 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:46.964704 22923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 1777) took 1882 ms (client timeout 1661 ms). Trace:
W20260709 13:09:46.965507 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 212941us
W20260709 13:09:46.965677 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 330907us
I20260709 13:09:47.000463 23074 rpcz_store.cc:276] 0709 13:09:45.120025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.156499 (+ 36474us) service_pool.cc:224] Handling call
0709 13:09:46.308382 (+1151883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.320939 (+ 12557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.320983 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.325339 (+  4356us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:46.325396 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.325471 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.853009 (+527538us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540021aa50. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:46.853127 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2550849792}
W20260709 13:09:47.008888 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 257237us
I20260709 13:09:47.011883 23080 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:47.006094 22927 rpcz_store.cc:276] 0709 13:09:45.080846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.103039 (+ 22193us) service_pool.cc:224] Handling call
0709 13:09:45.103468 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.394792 (+291324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.842720 (+1447928us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400373a54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:46.842904 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567147904}
I20260709 13:09:46.858129 25871 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:47.008414 22923 rpcz_store.cc:269] 0709 13:09:45.082169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.082387 (+   218us) service_pool.cc:224] Handling call
0709 13:09:46.964458 (+1882071us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b54003b97d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:46.964596 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13836160}
I20260709 13:09:47.013449 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:46.959911 25711 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7.
I20260709 13:09:47.022296 25878 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:47.022848 25878 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.011736 25821 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.025162 25878 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:47.018695 25840 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:46.695819 23649 rpcz_store.cc:276] 0709 13:09:44.241247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.241532 (+   285us) service_pool.cc:224] Handling call
0709 13:09:44.241883 (+   351us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:44.787806 (+545923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.787844 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:44.788609 (+   765us) log.cc:844] Serialized 78 byte log entry
0709 13:09:45.089308 (+300699us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:45.333926 (+244618us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.415916 (+ 81990us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.293027 (+877111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.318015 (+ 24988us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.322233 (+  4218us) raft_consensus.cc:1685] finished
0709 13:09:46.322652 (+   419us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.345005 (+ 22353us) inbound_call.cc:177] Queueing success response
0709 13:09:46.579839 (+234834us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b4800210b58. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3929f33aa1 00007f3929f2ab37 00007f3929f2a9ca 00007f392a02226f 00007f392a021f37 00007f392a03655c 00007f392a036508 00007f392a036488 00007f392a036443 00007f392a0356ec 00007f3928f5fa96
Metrics: {"mutex_wait_us":79285,"prepare.queue_time_us":315488,"raft.queue_time_us":158444,"raft.run_cpu_time_us":34975,"raft.run_wall_time_us":1169087,"spinlock_wait_cycles":18160896,"thread_start_us":1599088,"threads_started":4,"wal-append.queue_time_us":345516,"wal-append.run_cpu_time_us":3570,"wal-append.run_wall_time_us":1343723}
I20260709 13:09:47.000586 25838 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.014997 23620 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:47.016757 23003 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:09:47.027809 23072 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:47.013840 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:46.840636 25803 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:47.033907 23072 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:46.835220 25869 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.042263 25872 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:46.947105 25860 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:46.868570 25548 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:46.955480 25864 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:47.047293 23072 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.049437 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:47.051131 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 85203.1us
I20260709 13:09:47.059100 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:47.059417 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:47.060245 22970 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:47.069653 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 64208.4us
I20260709 13:09:47.070153 22970 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:47.059803 23080 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:09:47.072329 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:47.102406 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:47.046200 25803 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.835098 25865 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:47.124101 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 110724us
I20260709 13:09:47.124503 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:47.117131 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:47.125828 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:47.050630 25859 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:47.058580 25872 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.127290 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 113491us
I20260709 13:09:47.042891 25855 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.071237 25864 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:47.100471 25713 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.106390 25861 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:47.162153 25861 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:47.161860 25864 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.162271 25713 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.133680 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:47.112448 25836 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:46.868397 25870 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.133671 25869 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:47.141004 25787 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:47.142524 25883 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.123987 25700 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:09:47.142913 25858 log.cc:927] Time spent T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:09:47.143272 25862 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:47.144078 23072 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.146328 23080 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:47.117473 25860 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.157452 25822 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:47.129736 25891 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.197558 25892 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:09:47.199985 23006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 617) took 3268 ms (client timeout 1771 ms). Trace:
W20260709 13:09:47.200346 23006 rpcz_store.cc:269] 0709 13:09:43.931225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.931363 (+   138us) service_pool.cc:224] Handling call
0709 13:09:47.199797 (+3268434us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000ef1d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:47.199922 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3411179264}
I20260709 13:09:47.197072 25891 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.071449 25548 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.012466 25873 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.205462 25873 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:47.180858 25812 consensus_meta.cc:287] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:09:47.163132 25861 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.167049 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:47.162992 25713 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.177448 25883 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.211202 25883 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:47.211706 25883 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.212019 25722 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.180364 25869 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:09:47.172439 25787 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.215854 25787 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.192831 25692 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:09:47.216322 25902 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.216861 25902 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.218873 25840 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:47.219149 23079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2100) took 1984 ms (client timeout 1540 ms). Trace:
W20260709 13:09:47.179560 25889 log.cc:927] Time spent T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:47.174446 25836 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:47.039072 25880 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:47.194218 22895 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.776s (SENT)
I20260709 13:09:47.221611 25836 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.139022 25859 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.141415 25872 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:47.219583 23079 rpcz_store.cc:269] 0709 13:09:45.234749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.235905 (+  1156us) service_pool.cc:224] Handling call
0709 13:09:47.218955 (+1983050us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540042c7d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:47.219081 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3716481920}
I20260709 13:09:47.245929 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:47.230967 25862 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:47.262537 25904 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.351528 23003 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:47.264408 25880 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:47.403086 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 255495us
W20260709 13:09:47.405381 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 159560us
I20260709 13:09:47.413178 25880 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:47.449314 25880 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:47.450510 25880 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:47.452256 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.454248 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 231431us
W20260709 13:09:47.455461 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.452153 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 671) took 1066 ms. Trace:
W20260709 13:09:47.452545 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 258351us
W20260709 13:09:47.453420 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 319828us
W20260709 13:09:47.370121 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 368888us
I20260709 13:09:47.458406 23072 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:47.460268 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:47.461615 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:47.812131 25803 consensus_meta.cc:287] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.682s	user 0.003s	sys 0.008s
I20260709 13:09:47.812845 25803 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.453138 25865 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:47.457548 22930 rpcz_store.cc:276] 0709 13:09:46.385728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.435943 (+ 50215us) service_pool.cc:224] Handling call
0709 13:09:46.585299 (+149356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:46.718181 (+132882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.718214 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:46.721583 (+  3369us) log.cc:844] Serialized 52 byte log entry
0709 13:09:46.796186 (+ 74603us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:46.796236 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.796324 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.205051 (+408727us) raft_consensus.cc:1685] finished
0709 13:09:47.205071 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.452094 (+247023us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18089,"raft.queue_time_us":198083,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":99579,"thread_start_us":137356,"threads_started":2,"wal-append.queue_time_us":399763}
I20260709 13:09:47.496132 25869 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.456439 25864 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:47.818439 25869 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:47.457607 25841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.000s	sys 0.009s
I20260709 13:09:47.821311 25869 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:47.519583 25902 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:47.822183 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 655151us
W20260709 13:09:47.707834 25670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.002s	sys 0.014s
W20260709 13:09:47.821620 25841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.011s	sys 0.030s
I20260709 13:09:47.465013 25548 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:47.819621 25914 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:47.502386 22931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.000s	sys 0.015s
W20260709 13:09:47.861863 22931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.000s	sys 0.024s
I20260709 13:09:47.462316 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:47.505764 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:47.457626 22895 leader_election.cc:336] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.792s (SENT)
I20260709 13:09:47.598827 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:47.444882 25849 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.001s
W20260709 13:09:47.841841 22897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.010s	sys 0.055s
I20260709 13:09:47.453114 25808 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.888947 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.910403 22897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.018s	sys 0.069s
I20260709 13:09:47.862775 22931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 669) took 1479 ms. Trace:
W20260709 13:09:47.908669 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 450358us
I20260709 13:09:47.913228 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:47.916071 22998 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:47.917874 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.918684 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.821638 25787 consensus_meta.cc:287] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.004s
I20260709 13:09:47.823623 25713 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:47.660127 25700 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.261s
I20260709 13:09:47.727290 25870 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:47.588758 25893 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.993695 25914 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:47.920655 25849 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:47.930503 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 267634us
W20260709 13:09:48.179845 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 722175us
I20260709 13:09:47.917454 22931 rpcz_store.cc:276] 0709 13:09:46.383120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.383259 (+   139us) service_pool.cc:224] Handling call
0709 13:09:46.383572 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.383814 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:46.798670 (+414856us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.862341 (+1063671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.862404 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.862460 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.862557 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.862718 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":684934,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":794,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":1331705,"threads_started":2}
I20260709 13:09:48.005781 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:47.984714 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:47.991277 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 165765us
I20260709 13:09:48.037175 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:48.005834 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 85611.9us
I20260709 13:09:48.005968 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:47.984419 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:47.841483 25670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.002s	sys 0.017s
I20260709 13:09:47.898588 25891 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:48.176293 25702 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.939785 25143 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:47.939986 25808 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.177569 25893 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:47.986048 25830 consensus_meta.cc:287] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 1.265s	user 0.006s	sys 0.009s
I20260709 13:09:48.005728 25548 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.920483 25822 consensus_meta.cc:287] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.006s
I20260709 13:09:48.005556 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:48.180601 22895 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.815s (SENT)
W20260709 13:09:47.897872 25839 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 1.030s	user 0.005s	sys 0.004s
I20260709 13:09:47.520829 25898 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:48.183032 23046 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:48.182420 22999 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:48.190802 23075 raft_consensus.cc:1240] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:48.191318 23074 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:48.186906 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:47.915318 25717 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:48.167276 25883 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.001s
W20260709 13:09:48.115935 25915 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:09:48.196110 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.984910 25868 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.913623 25862 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:48.197610 23001 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:48.078845 25905 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:48.200397 22895 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.947s (SENT)
I20260709 13:09:48.213742 25880 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:48.214738 25891 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:09:48.215196 22895 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.926s (SENT)
I20260709 13:09:48.214962 25880 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.215360 25891 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.201148 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:48.216243 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:48.217058 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:48.217670 25880 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.217905 25891 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.184966 25746 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.218371 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:48.199731 25822 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.044783 25904 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:09:48.215687 22895 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:48.214509 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:48.220263 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:48.190030 25787 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:48.205034 23074 pending_rounds.cc:85] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 5
I20260709 13:09:48.193181 25702 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.223152 23074 pending_rounds.cc:107] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:48.225179 23074 raft_consensus.cc:2889] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.199064 25548 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.196347 25143 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.227180 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:48.212810 25851 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.228935 23002 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:48.230501 22895 leader_election.cc:336] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.985s (SENT)
I20260709 13:09:48.230954 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:48.228086 25904 consensus_queue.cc:1243] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:48.233136 25880 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.234115 25702 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.234292 25808 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:48.214363 25868 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:48.233320 25904 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:48.236228 25904 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:48.236958 25868 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:48.239806 25911 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.240432 25914 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.240309 25911 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:48.226684 25717 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.213055 25898 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.241467 25717 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:48.242041 22895 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 2.135s (SENT)
I20260709 13:09:48.241936 25717 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.242543 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:48.196920 25830 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.244056 25880 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.244270 23003 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:48.245237 25830 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.232474 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:48.218909 25859 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.238390 25904 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:48.222100 25746 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.199470 25839 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:48.228780 25891 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:48.262429 25920 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:09:48.264336 25909 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:09:48.264947 25143 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.257296 25746 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:48.274451 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 91491.1us
I20260709 13:09:48.249467 25902 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.279142 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:48.279285 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:48.212427 25883 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:48.263473 25922 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:09:48.293079 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:48.293560 23004 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:48.293708 22931 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.257262 25849 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:48.295861 23046 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:48.297732 23002 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:48.311348 23046 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:48.282011 25891 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:48.342258 22931 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
W20260709 13:09:48.377957 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.060869 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.312098 23001 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:49.063053 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2038) took 1039 ms. Trace:
I20260709 13:09:49.063562 23001 rpcz_store.cc:276] 0709 13:09:48.023972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.289862 (+265890us) service_pool.cc:224] Handling call
0709 13:09:48.311566 (+ 21704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.062725 (+751159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.062969 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.295536 25855 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:48.450202 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2094) took 3217 ms. Trace:
W20260709 13:09:48.368861 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 896) took 3068 ms (client timeout 1771 ms). Trace:
W20260709 13:09:49.072789 23656 rpcz_store.cc:269] 0709 13:09:45.300906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.310501 (+  9595us) service_pool.cc:224] Handling call
0709 13:09:48.368605 (+3058104us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54004d71d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:48.368751 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2767210880}
W20260709 13:09:49.064729 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.639117 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1755) took 4552 ms. Trace:
I20260709 13:09:49.075735 22997 rpcz_store.cc:276] 0709 13:09:44.086532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.090983 (+  4451us) service_pool.cc:224] Handling call
0709 13:09:44.091233 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.007105 (+915872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.021318 (+1014213us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400386920. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f81dc0 00007f392500da02 00007f3925009dd6 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2
0709 13:09:48.638779 (+2617461us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b540030edd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:48.639011 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530208512}
I20260709 13:09:48.652619 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 644) took 1623 ms. Trace:
I20260709 13:09:49.077219 23004 rpcz_store.cc:276] 0709 13:09:47.029125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.131503 (+102378us) service_pool.cc:224] Handling call
0709 13:09:47.131772 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.296116 (+1164344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.652304 (+356188us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400012554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:48.652544 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643499264}
I20260709 13:09:48.648877 25813 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.310598 25904 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.312819 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.096927 22927 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 3: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:49.096956 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.097875 22923 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:49.087841 25855 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:49.098848 25855 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.650822 25599 raft_consensus.cc:3055] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:49.099951 25599 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:48.643517 25723 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.100450 23001 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: [6.6-9.7]
W20260709 13:09:48.626461 25882 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.903s	user 0.003s	sys 0.000s
I20260709 13:09:49.072494 23075 rpcz_store.cc:276] 0709 13:09:45.233150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.591027 (+1357877us) service_pool.cc:224] Handling call
0709 13:09:46.591392 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.204751 (+1613359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.449854 (+245103us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400033c54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:48.450120 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3677817216}
W20260709 13:09:48.484130 23620 connection.cc:256] RPC call timeout handler was delayed by -2.2288845159999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:09:49.104418 23620 connection.cc:256] RPC call timeout handler was delayed by -2.193784515999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 13:09:48.366822 25932 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.179236 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.093719 23004 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:48.343276 25834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.818s	user 0.020s	sys 0.019s
W20260709 13:09:48.398211 25927 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:09:48.373803 23045 connection.cc:256] RPC call timeout handler was delayed by -1.693243845999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 13:09:48.644495 23000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 641) took 1920 ms. Trace:
I20260709 13:09:48.706497 25851 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.104816 23620 connection.cc:256] RPC call timeout handler was delayed by -2.119984516000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 13:09:48.311810 25902 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:48.347941 25673 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.108974 22999 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:48.367538 25925 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:48.621405 25239 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:48.343461 25717 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.832917 25893 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.847043 25746 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:49.059181 25822 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:48.708022 25897 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.399550 25839 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.914551 25883 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.764350 25931 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.805563 25838 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:48.846187 25872 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.764062 25787 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:48.627790 25863 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.401506 25736 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.113322 23000 rpcz_store.cc:276] 0709 13:09:46.724308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.727314 (+  3006us) service_pool.cc:224] Handling call
0709 13:09:46.727646 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.134080 (+406434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.134107 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.134147 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:47.134174 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.644174 (+1510000us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002e5754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:48.644235 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.644421 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934102272}
I20260709 13:09:49.104115 25930 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.085938 23072 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.005s	sys 0.005s
W20260709 13:09:49.135391 23072 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.005s	sys 0.005s
W20260709 13:09:49.137351 22926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.011s	sys 0.022s
W20260709 13:09:49.137707 22926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.011s	sys 0.022s
W20260709 13:09:49.142166 23074 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.010s	sys 0.015s
W20260709 13:09:49.142501 23074 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.010s	sys 0.015s
W20260709 13:09:49.117353 23045 connection.cc:256] RPC call timeout handler was delayed by -1.6047811629999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:09:49.089048 25470 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:48.343950 25849 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.767s
I20260709 13:09:49.117238 25902 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.311743 25928 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.813s
W20260709 13:09:49.110000 25834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.593s	user 0.052s	sys 0.049s
I20260709 13:09:49.116330 25932 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:49.128288 23077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2092) took 3889 ms (client timeout 1985 ms). Trace:
I20260709 13:09:49.136853 25821 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:49.145200 22930 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:49.155309 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2109) took 1662 ms. Trace:
W20260709 13:09:49.144042 23045 connection.cc:256] RPC call timeout handler was delayed by -1.550143845999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 13:09:49.155954 23045 connection.cc:256] RPC call timeout handler was delayed by -1.3575438459999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23170000000000002s for a response
I20260709 13:09:49.135675 25898 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:49.154322 23077 rpcz_store.cc:269] 0709 13:09:45.232645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.397375 (+164730us) service_pool.cc:224] Handling call
0709 13:09:49.121667 (+3724292us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54000898d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:49.121841 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107532160}
I20260709 13:09:49.122587 25851 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.155714 23080 rpcz_store.cc:276] 0709 13:09:47.492829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.813124 (+320295us) service_pool.cc:224] Handling call
0709 13:09:47.813392 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.813702 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.813727 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.814139 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.193728 (+379589us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:48.193765 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.193830 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.155120 (+961290us) raft_consensus.cc:1685] finished
0709 13:09:49.155138 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.155258 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2553,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":160,"thread_start_us":253353,"threads_started":1,"wal-append.queue_time_us":347817}
I20260709 13:09:49.153471 25902 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.160231 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:49.161796 23078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 538) took 4830 ms (client timeout 1640 ms). Trace:
I20260709 13:09:49.161666 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:49.162592 23078 rpcz_store.cc:269] 0709 13:09:44.328464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.328587 (+   123us) service_pool.cc:224] Handling call
0709 13:09:49.158990 (+4830403us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54003890d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:49.159085 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296477952}
I20260709 13:09:49.136476 25822 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.163102 22930 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:49.153672 25470 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.153664 25548 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.162317 22927 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:49.136104 25897 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.142933 25736 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:49.158488 25452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.011s	sys 0.031s
I20260709 13:09:49.171752 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2096) took 4040 ms. Trace:
I20260709 13:09:49.136673 25931 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:49.182017 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2111) took 1668 ms. Trace:
I20260709 13:09:49.182138 25869 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.182783 25941 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.188920 25941 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.190174 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.191596 25941 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:49.194442 25851 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:49.194713 25803 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.182835 22999 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:49.196599 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 647) took 1153 ms. Trace:
I20260709 13:09:49.188290 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.197117 22999 rpcz_store.cc:276] 0709 13:09:48.043102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.081098 (+1037996us) service_pool.cc:224] Handling call
0709 13:09:49.108840 (+ 27742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.196386 (+ 87546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.196550 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.182451 23072 rpcz_store.cc:276] 0709 13:09:47.513193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.190408 (+677215us) service_pool.cc:224] Handling call
0709 13:09:48.198909 (+  8501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.200214 (+  1305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.200244 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.206270 (+  6026us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.343417 (+137147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:49.135875 (+792458us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.136098 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.136191 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.181814 (+ 45623us) raft_consensus.cc:1685] finished
0709 13:09:49.181835 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.181962 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3912,"prepare.queue_time_us":812051,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":32279,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":5284,"thread_start_us":877104,"threads_started":2,"wal-append.queue_time_us":894357}
I20260709 13:09:49.176636 23073 rpcz_store.cc:276] 0709 13:09:45.128811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.302165 (+1173354us) service_pool.cc:224] Handling call
0709 13:09:46.302555 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.345964 (+ 43409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.345999 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.381157 (+ 35158us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.662172 (+281015us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:46.996040 (+333868us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.067282 (+ 71242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.067331 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.625727 (+1558396us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:49.163849 (+538122us) raft_consensus.cc:1685] finished
0709 13:09:49.169328 (+  5479us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.169422 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":387120,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":107,"raft.queue_time_us":41796,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":200,"spinlock_wait_cycles":25784064,"thread_start_us":452197,"threads_started":3,"wal-append.queue_time_us":206725}
I20260709 13:09:49.145224 25930 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.169114 25849 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:49.151196 25891 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:49.199021 25452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.012s	sys 0.031s
I20260709 13:09:49.186434 25239 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.171203 25876 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.187834 25932 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.183146 25746 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:49.222929 23002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.003s	sys 0.022s
I20260709 13:09:49.225288 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.227819 22927 raft_consensus.cc:2410] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:09:49.227342 23002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.003s	sys 0.022s
I20260709 13:09:49.171213 25470 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:49.229882 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.230767 22931 raft_consensus.cc:2410] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:09:49.232254 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 646) took 1189 ms. Trace:
I20260709 13:09:49.186625 25869 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.233212 23002 rpcz_store.cc:276] 0709 13:09:48.042784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.298565 (+255781us) service_pool.cc:224] Handling call
0709 13:09:48.298885 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.300182 (+  1297us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:48.471690 (+171508us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.231785 (+760095us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.231949 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.231991 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:49.232036 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.232097 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.232204 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":284768,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":199,"thread_start_us":756465,"threads_started":1}
I20260709 13:09:49.183104 25893 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:49.223826 25849 raft_consensus.cc:697] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:49.226723 25746 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:49.241662 25930 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:49.240423 22895 leader_election.cc:336] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 2.054s (SENT)
I20260709 13:09:49.242686 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.241367 25849 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.244086 22931 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:49.244666 22895 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:49.227945 25239 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.235616 25931 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:49.241811 25897 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:49.246551 23071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2094) took 4123 ms (client timeout 1771 ms). Trace:
W20260709 13:09:49.250661 23071 rpcz_store.cc:269] 0709 13:09:45.122730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.136007 (+ 13277us) service_pool.cc:224] Handling call
0709 13:09:49.246391 (+4110384us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540042d1d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:49.246482 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575623040}
I20260709 13:09:49.249960 25239 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:49.252959 22895 leader_election.cc:336] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 2.183s (SENT)
I20260709 13:09:49.253508 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:49.256381 23005 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.000s	sys 0.004s
W20260709 13:09:49.256734 23005 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.000s	sys 0.004s
I20260709 13:09:49.257149 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:49.258072 22927 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:49.259217 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:49.226534 25876 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:49.293669 22895 leader_election.cc:336] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 2.581s (SENT)
I20260709 13:09:49.302696 22895 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:49.304024 22929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.006s	sys 0.006s
W20260709 13:09:49.304503 22929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.006s	sys 0.006s
W20260709 13:09:49.305369 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 993970us
W20260709 13:09:49.307200 22895 leader_election.cc:336] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.540s (SENT)
I20260709 13:09:49.317674 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:49.308673 25937 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:49.313432 25876 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:49.314523 25736 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.316203 25822 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:49.319761 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:49.342516 22931 raft_consensus.cc:2368] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3.
I20260709 13:09:49.306663 22972 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:49.334622 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 175002us
I20260709 13:09:49.339397 22927 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:49.339526 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.340466 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.305992 25873 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:49.345484 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:49.334923 25548 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:49.360126 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 53571.2us
I20260709 13:09:49.360603 23077 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:49.348255 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2039) took 1324 ms. Trace:
I20260709 13:09:49.350203 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.354704 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:49.365345 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:49.366187 22895 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.621s (SENT)
I20260709 13:09:49.366091 22930 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:49.372047 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.372648 23071 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:09:49.372716 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.317119 25591 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.375031 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.316877 25470 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:49.376709 23071 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:49.375167 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2183) took 1083 ms. Trace:
I20260709 13:09:49.378490 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.379253 23071 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:49.380440 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.381400 23071 raft_consensus.cc:2368] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:49.383340 23622 leader_election.cc:400] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3.
I20260709 13:09:49.383813 23622 leader_election.cc:403] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:49.398784 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:49.399951 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.377466 22922 rpcz_store.cc:276] 0709 13:09:48.291778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.300177 (+  8399us) service_pool.cc:224] Handling call
0709 13:09:49.061072 (+760895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.061328 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:49.303738 (+242410us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.374878 (+ 71140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.374922 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:49.374966 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.375024 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.375119 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":235431,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":588,"thread_start_us":310762,"threads_started":2}
I20260709 13:09:49.401051 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.401602 22999 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:49.403264 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.403900 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.376073 22972 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:49.407560 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.409715 23079 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:49.410547 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:49.411238 23078 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:49.411355 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.404513 23075 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:49.415707 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2114) took 1598 ms. Trace:
I20260709 13:09:49.411919 23072 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:49.375388 25871 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.372313 25821 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.427629 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:49.416213 23074 rpcz_store.cc:276] 0709 13:09:47.817313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.257704 (+440391us) service_pool.cc:224] Handling call
0709 13:09:48.289040 (+ 31336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.289307 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:49.142916 (+853609us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.413897 (+270981us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.414024 (+   127us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:49.414109 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.414250 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.415631 (+  1381us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":855847,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":143,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":1123702,"threads_started":2}
I20260709 13:09:49.412997 22972 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:49.424660 23002 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:49.424708 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:49.425604 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 80217.7us
I20260709 13:09:49.430956 23000 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:49.431394 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.431573 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:49.430792 22972 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:49.432030 23006 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:49.416170 25842 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:49.414779 25917 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:49.436880 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:49.437086 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.444947 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.445017 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.445672 23074 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:49.445837 23006 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:49.436480 22926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2186) took 1143 ms. Trace:
I20260709 13:09:49.448565 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:49.451717 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.452539 22924 raft_consensus.cc:2410] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:49.362524 23005 rpcz_store.cc:276] 0709 13:09:48.024311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.298159 (+273848us) service_pool.cc:224] Handling call
0709 13:09:48.324947 (+ 26788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.325191 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:49.257020 (+931829us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.347976 (+ 90956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.348018 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:49.348062 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.348118 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.348207 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147293,"prepare.queue_time_us":289764,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":13776,"thread_start_us":749477,"threads_started":2}
I20260709 13:09:49.457347 25941 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.457851 25941 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.428758 25723 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:49.435961 25930 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:49.459978 25930 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:49.460346 25930 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:49.420313 25592 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:09:49.434553 25821 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.462690 25855 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.435703 25852 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.466223 25902 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.467875 25932 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:49.468633 25932 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:49.469094 25932 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:49.437860 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:49.473335 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 88771.2us
I20260709 13:09:49.475225 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:49.477038 23622 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:49.480120 23620 connection.cc:256] RPC call timeout handler was delayed by -1.7554845160000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
I20260709 13:09:49.446913 22926 rpcz_store.cc:276] 0709 13:09:48.292660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.295989 (+  3329us) service_pool.cc:224] Handling call
0709 13:09:48.296284 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.311204 (+ 14920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.311234 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.316967 (+  5733us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.138097 (+821130us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:49.138134 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.138203 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.436240 (+298037us) raft_consensus.cc:1685] finished
0709 13:09:49.436268 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.436431 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9839,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12014,"thread_start_us":682820,"threads_started":1,"wal-append.queue_time_us":829680}
W20260709 13:09:49.481575 23620 connection.cc:256] RPC call timeout handler was delayed by -1.7393038730000399s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:09:49.482811 23071 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:09:49.483392 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.484082 23656 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:49.470009 25821 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.486773 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2182) took 1195 ms. Trace:
I20260709 13:09:49.487167 22929 rpcz_store.cc:276] 0709 13:09:48.291462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.299244 (+  7782us) service_pool.cc:224] Handling call
0709 13:09:48.299555 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.299915 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.299947 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.316414 (+ 16467us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.305058 (+988644us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:49.305114 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.305203 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.486576 (+181373us) raft_consensus.cc:1685] finished
0709 13:09:49.486598 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.486720 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":335,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12321,"thread_start_us":851891,"threads_started":1,"wal-append.queue_time_us":1050205}
I20260709 13:09:49.446720 25879 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:49.437515 25953 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:49.497099 25962 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:49.497328 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.535349 23653 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:49.535945 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:49.537101 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.536890 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.576392 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.480852 25871 raft_consensus.cc:697] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:49.534781 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.920228 23078 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:49.577003 23652 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:49.922266 23651 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:49.675002 23656 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:49.589071 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1769) took 2127 ms. Trace:
I20260709 13:09:49.536134 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:49.553437 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.925314 23655 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:49.589373 23654 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:49.567370 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.926749 22929 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:49.923434 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.498155 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:49.930128 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.930508 22924 raft_consensus.cc:2410] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:49.932216 23657 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:49.932943 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.838089 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.933576 22929 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
W20260709 13:09:49.925936 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.497095 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:49.935791 23649 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:49.618731 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.924053 23003 rpcz_store.cc:276] 0709 13:09:47.461554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.461797 (+   243us) service_pool.cc:224] Handling call
0709 13:09:47.811856 (+350059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.244842 (+432986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.588852 (+1344010us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54002e6154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:49.589022 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993809664}
I20260709 13:09:49.936442 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:49.930895 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 423216us
I20260709 13:09:49.826921 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:49.937683 22896 connection.cc:256] RPC call timeout handler was delayed by -1.0706927969999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 13:09:49.938094 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.938855 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:49.941095 22930 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:49.941228 22925 raft_consensus.cc:1275] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:49.925638 23650 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
W20260709 13:09:49.943217 22928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2189) took 1626 ms (client timeout 1851 ms). Trace:
I20260709 13:09:49.943583 23001 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:49.936764 23653 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:49.942088 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:49.943801 22928 rpcz_store.cc:269] 0709 13:09:48.317313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.317778 (+   465us) service_pool.cc:224] Handling call
0709 13:09:49.837880 (+1520102us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800003698. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:49.943139 (+105259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3090816}
I20260709 13:09:49.484464 25822 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.951345 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.951910 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.952401 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.952513 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.953187 22998 raft_consensus.cc:2393] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:49.956171 22930 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:09:49.638164 25960 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:09:49.958325 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.958602 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.953270 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.960142 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.965443 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.960436 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:49.966138 22997 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:49.966239 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:49.965495 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.967286 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.962976 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:49.959462 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.967118 23654 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:49.967796 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.493844 25911 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:49.953660 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:49.577343 25962 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.968058 23652 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:49.968917 22929 raft_consensus.cc:2410] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:49.611588 25947 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.969092 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:49.941617 25891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.047s
W20260709 13:09:50.016868 25891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.047s
I20260709 13:09:50.017537 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.017859 25891 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:50.018349 25891 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:49.970407 22925 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:50.018666 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:49.970844 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.840644 25851 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.534781 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.804692 25592 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:50.028613 25592 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.030534 25592 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.030952 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:50.031543 22926 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.973172 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.699777 25902 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.970508 25852 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3.
I20260709 13:09:49.975193 23653 raft_consensus.cc:2393] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:49.823462 25711 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:49.823963 25956 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:49.832207 25239 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.823735 25736 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.498008 25879 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.791745 25840 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:49.475499 25931 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.474s
I20260709 13:09:49.506232 25917 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:49.498976 25941 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:49.589414 25952 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.940999 25821 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.044032 25855 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:49.942034 25749 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.965394 25833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.000s	sys 0.022s
I20260709 13:09:50.020968 23077 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:49.614974 25831 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.359s
I20260709 13:09:50.021258 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.960561 25723 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:50.156451 25723 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.156762 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.157008 25723 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.025554 23650 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:50.023393 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.028049 25856 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.024276 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.793131 25930 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:49.967998 23073 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:50.033058 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:49.968461 25953 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:09:50.046051 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 165150us
I20260709 13:09:50.011740 25849 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.018740 25891 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:50.048229 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.049199 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:49.663252 25932 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.020539 25962 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.083355 25879 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:49.976845 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.019255 25911 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:49.806890 25599 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.153178 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.160508 23649 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:50.080192 25893 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:50.161785 23654 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:50.087992 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:50.164426 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.035801 25851 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.041160 25947 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:50.152449 25833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.009s	sys 0.045s
I20260709 13:09:50.167940 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:50.190721 25965 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:09:50.174868 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.164952 25856 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.295739 25599 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.170707 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:50.303965 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 273782us
W20260709 13:09:50.297595 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 257537us
W20260709 13:09:50.330823 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 161257us
I20260709 13:09:50.188941 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.332105 23073 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:09:50.085070 25736 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.333392 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.085695 25239 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.361745 23079 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.332337 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.165395 25841 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:50.176468 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:50.359953 23657 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:50.296934 25911 consensus_queue.cc:1243] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer b655449a388a41e3a606c6ea794825ad log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:50.340673 23655 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:50.116442 25840 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.359679 23654 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:09:50.268818 25855 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.166s
W20260709 13:09:50.335285 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 161237us
I20260709 13:09:50.371171 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:50.371730 23651 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:50.177958 25930 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:50.364362 22971 connection.cc:256] RPC call timeout handler was delayed by -1.6540066289999231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:09:50.385429 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 436302us
I20260709 13:09:50.336539 25963 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.387324 22971 connection.cc:256] RPC call timeout handler was delayed by -1.6180066289999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 13:09:50.386626 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:50.388530 22971 connection.cc:256] RPC call timeout handler was delayed by -1.4957919710000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:09:50.389147 23073 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:50.358562 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 426689us
W20260709 13:09:50.364789 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 416141us
I20260709 13:09:50.084757 25711 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.161770 25821 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.134016 25871 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.372309 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:50.115187 25952 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.335389 25931 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:50.389262 22971 connection.cc:256] RPC call timeout handler was delayed by -1.4553419229999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:09:50.191253 25849 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.335377 25902 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:50.429226 23077 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:09:50.409334 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 47435.2us
I20260709 13:09:50.411438 23652 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [2.5-4.7]
I20260709 13:09:50.411015 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:50.151607 25956 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.334841 25945 consensus_queue.cc:1059] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:09:50.412602 23621 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:50.422930 22971 connection.cc:256] RPC call timeout handler was delayed by -1.3770419229999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 13:09:50.422523 25965 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:50.420603 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:50.178483 25953 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.427433 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.448215 23649 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:09:50.393378 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.407266 25822 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.357715 25893 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:50.443871 22971 connection.cc:256] RPC call timeout handler was delayed by -1.3275419230000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:09:50.457572 22971 connection.cc:256] RPC call timeout handler was delayed by -1.2465366540000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
W20260709 13:09:50.458006 22971 connection.cc:256] RPC call timeout handler was delayed by -1.0827419229999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:09:50.458384 22971 connection.cc:256] RPC call timeout handler was delayed by -1.0260419229999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:09:50.161600 25749 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.381171 25838 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:09:50.448451 23073 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:50.430797 25970 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:50.423507 25941 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.422763 25931 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:50.464243 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51765.4us
I20260709 13:09:50.467283 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2097) took 3490 ms. Trace:
I20260709 13:09:50.420456 25984 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:09:50.380815 25973 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:09:50.407774 25841 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.488607 23076 rpcz_store.cc:276] 0709 13:09:46.977395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.977525 (+   130us) service_pool.cc:224] Handling call
0709 13:09:49.121965 (+2144440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.223164 (+101199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.223194 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.227178 (+  3984us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.382210 (+155032us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:49.382261 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.580910 (+198649us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b54000898d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:49.580971 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.581041 (+    70us) raft_consensus.cc:1685] finished
0709 13:09:49.581060 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.467126 (+886066us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54000898d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:50.467229 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1625,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3418,"spinlock_wait_cycles":5091765888,"thread_start_us":141941,"threads_started":1,"wal-append.queue_time_us":252237}
I20260709 13:09:50.498170 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.453112 25977 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.506044 23073 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:50.508376 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.459903 25822 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.513326 25822 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.514775 25956 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:50.475409 25852 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.515897 25852 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:50.516315 25852 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.517670 25952 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:50.518193 25982 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:50.510340 22998 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:50.508133 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.511440 23005 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:50.511349 25981 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:50.512603 25869 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.521281 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.483270 25941 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.525118 23075 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:50.526141 23073 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:50.522440 23621 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:50.412729 25963 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.531903 25981 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:50.532537 25869 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:50.533182 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.534071 25849 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.534685 25956 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:50.534708 25953 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.508337 25988 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:09:50.519759 25470 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:50.538118 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:50.538302 25966 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.452s	user 0.002s	sys 0.000s
I20260709 13:09:50.541276 25821 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.542543 25239 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:50.544044 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.484144 25979 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:09:50.652082 25979 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:50.549893 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.652479 25979 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:50.652921 23077 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:09:50.653494 25964 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.337s	user 0.000s	sys 0.005s
I20260709 13:09:50.653358 25979 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.654663 25979 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.459435 25876 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:09:50.567404 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.659441 23073 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:50.660349 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.661125 23073 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:50.662133 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.573223 25749 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.573985 25736 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:50.494395 25980 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:50.551297 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:50.579835 22926 consensus_meta.cc:287] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.001s
I20260709 13:09:50.667989 23074 raft_consensus.cc:2368] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:50.668116 22926 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:50.445979 25902 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.452662 25978 consensus_queue.cc:1059] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:09:50.602120 25956 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.604272 23079 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:50.670007 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 578) took 1173 ms. Trace:
I20260709 13:09:50.670416 23079 rpcz_store.cc:276] 0709 13:09:49.497010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.497555 (+   545us) service_pool.cc:224] Handling call
0709 13:09:50.188826 (+691271us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:50.669938 (+481112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18168576}
I20260709 13:09:50.671162 25956 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:50.673483 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.623347 23071 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:50.624666 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.675047 23652 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:50.628322 25833 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:50.545557 25840 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:50.629917 25970 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.630128 25841 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.526288 25984 consensus_queue.cc:1243] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:50.527484 25977 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.585251 25941 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.638537 25893 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:50.639506 25891 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.595798 25723 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.583289 25869 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:50.642854 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 672) took 1065 ms. Trace:
I20260709 13:09:50.736284 23649 rpcz_store.cc:276] 0709 13:09:49.577006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.316832 (+739826us) service_pool.cc:224] Handling call
0709 13:09:50.642685 (+325853us) spinlock_profiling.cc:243] Waited 85.4 ms on lock 0x7b54006a1654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:50.642796 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196441344}
I20260709 13:09:50.646842 22927 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:50.647231 23651 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:50.635309 25879 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.742761 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.648088 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:50.648699 25931 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.651376 25963 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:50.651908 25974 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:50.653781 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.746603 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:50.370033 25917 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.656756 22928 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:50.747805 23649 raft_consensus.cc:2376] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8. Re-sending same reply.
I20260709 13:09:50.568100 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 581) took 1033 ms. Trace:
I20260709 13:09:50.748471 23075 rpcz_store.cc:276] 0709 13:09:49.535105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.535543 (+   438us) service_pool.cc:224] Handling call
0709 13:09:50.524658 (+989115us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:50.524829 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.567847 (+ 43018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.568050 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21579520}
I20260709 13:09:50.574180 25852 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.661923 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.675104 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 577) took 1186 ms. Trace:
I20260709 13:09:50.683583 25970 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.681597 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 576) took 1209 ms. Trace:
I20260709 13:09:50.753593 23074 rpcz_store.cc:276] 0709 13:09:49.472001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.474424 (+  2423us) service_pool.cc:224] Handling call
0709 13:09:50.551115 (+1076691us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:50.681516 (+130401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18287872}
I20260709 13:09:50.754608 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.680590 25980 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:50.758939 25968 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.423s	user 0.002s	sys 0.002s
W20260709 13:09:50.713372 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 254255us
W20260709 13:09:50.686856 23620 leader_election.cc:336] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.640s (SENT)
W20260709 13:09:50.761893 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 331313us
I20260709 13:09:50.741492 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:50.733297 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.741712 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.763113 23079 raft_consensus.cc:2410] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:50.763631 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.763866 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.551237 25711 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:50.749904 23071 rpcz_store.cc:276] 0709 13:09:49.488740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.490910 (+  2170us) service_pool.cc:224] Handling call
0709 13:09:50.622848 (+1131938us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:50.623109 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.674885 (+ 51776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.675056 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22579968}
W20260709 13:09:50.629195 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 106843us
I20260709 13:09:50.755167 23074 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:50.766969 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.768253 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:50.684409 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 229422us
I20260709 13:09:50.755414 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:50.756453 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.757611 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.771446 23073 raft_consensus.cc:2410] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:50.771718 23077 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:50.772363 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.772866 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.773075 23073 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:50.761983 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.774117 23075 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:50.774235 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.764330 23079 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:50.675762 25833 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:50.755954 25970 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:50.777979 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 321125us
W20260709 13:09:50.778258 22971 leader_election.cc:336] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.771s (SENT)
I20260709 13:09:50.781535 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.781908 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:50.782106 23071 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:50.782894 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.778970 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:50.779532 22895 leader_election.cc:336] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 2.625s (SENT)
I20260709 13:09:50.783947 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.784310 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:50.784469 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.775022 23077 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:09:50.783869 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.785424 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.785643 23079 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:50.785830 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.785914 23077 raft_consensus.cc:2376] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5. Re-sending same reply.
I20260709 13:09:50.786608 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.787307 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:50.789132 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 102314us
W20260709 13:09:50.789983 23620 leader_election.cc:336] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.679s (SENT)
W20260709 13:09:50.790172 22971 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.017s (SENT)
I20260709 13:09:50.791585 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.780104 23046 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:50.797120 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.797851 22926 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:50.800837 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.800953 22926 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:50.801805 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.802114 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.802531 22930 raft_consensus.cc:2410] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:50.802637 22926 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:50.803160 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.804180 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.804543 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.806074 23073 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:50.808794 23073 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:50.810464 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:50.811393 23073 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:50.812692 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.813402 22930 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:50.813596 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.814893 23077 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:50.783823 23657 raft_consensus.cc:2376] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7. Re-sending same reply.
I20260709 13:09:50.818925 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:50.787739 23079 raft_consensus.cc:2410] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:50.818477 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:50.881218 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.884167 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.885100 23077 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:50.886411 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.858758 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.869397 23652 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:50.881845 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.887908 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.890177 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.894824 23073 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:50.895509 22922 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 2.
I20260709 13:09:50.825004 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.821820 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:50.858327 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.863341 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:50.862120 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 82608.1us
W20260709 13:09:50.901232 22895 connection.cc:256] RPC call timeout handler was delayed by -1.1262698280000905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2785s for a response
I20260709 13:09:50.904273 22926 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:09:50.818922 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 368978us
I20260709 13:09:50.905208 22972 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:50.897161 23649 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.892838 23077 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:50.906776 22926 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:50.892725 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 471015us
I20260709 13:09:50.909629 22926 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:50.912814 22926 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:50.915719 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:50.916965 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.847265 23046 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:50.918962 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 71805.7us
I20260709 13:09:50.811789 25592 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.927023 23073 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:50.932852 23071 raft_consensus.cc:3055] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:50.933203 23071 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:50.925863 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:50.790716 25821 consensus_queue.cc:1059] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:09:50.781260 25841 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:09:50.954594 23079 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:50.819926 25711 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:50.949827 22997 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:50.949301 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:50.960960 22998 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.950456 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.961994 23000 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:50.956997 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.949159 23077 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:50.816617 25947 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:50.951632 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:50.933954 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.934952 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.956072 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:50.947449 23073 pending_rounds.cc:85] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 5
I20260709 13:09:50.927897 25736 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:50.962771 22926 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:50.963618 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.765990 25869 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.960067 23071 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:50.964919 23073 pending_rounds.cc:107] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:50.975726 23073 raft_consensus.cc:2889] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.965863 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.965762 23005 raft_consensus.cc:2410] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:50.967980 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.967607 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.979712 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:50.970386 23649 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:50.981729 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.982977 22926 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:50.983940 23006 raft_consensus.cc:2410] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:50.984649 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:50.984846 22927 raft_consensus.cc:2410] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:50.986227 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:51.012955 23000 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:51.014110 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 195693us
W20260709 13:09:51.017158 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 61179.3us
I20260709 13:09:51.018195 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:50.985303 23649 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:51.020102 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:51.019313 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:50.929947 25840 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:09:50.890628 25746 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:51.025705 25821 raft_consensus.cc:3055] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:51.025125 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50022.7us
I20260709 13:09:50.967594 25736 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.046527 22927 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:50.964308 25893 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:51.047147 23071 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:51.036337 23652 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:50.958290 25978 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:51.022423 25711 raft_consensus.cc:697] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:50.946720 25997 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:51.048391 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:51.050057 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:51.051611 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:50.969175 25996 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:51.063257 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.974843 25861 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
W20260709 13:09:51.066525 22895 leader_election.cc:336] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.594s (SENT)
I20260709 13:09:50.963810 25749 consensus_queue.cc:1059] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:09:51.026237 25849 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:51.048107 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:50.929981 25833 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:50.953928 25980 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:51.045931 25932 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.133929 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:51.208401 23005 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.164783 23071 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:51.078809 22998 raft_consensus.cc:2410] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:51.074239 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:51.209417 23071 pending_rounds.cc:85] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 3
I20260709 13:09:51.214041 23071 pending_rounds.cc:107] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:51.214416 23071 raft_consensus.cc:2889] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.177300 23652 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:51.209204 23000 raft_consensus.cc:2410] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:09:51.207166 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 140660us
W20260709 13:09:51.221436 22895 leader_election.cc:336] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.660s (SENT)
W20260709 13:09:51.222237 22895 leader_election.cc:336] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.896s (SENT)
I20260709 13:09:51.223794 22895 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:51.062415 25962 consensus_meta.cc:287] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.000s
I20260709 13:09:51.080739 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:51.208246 23006 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:51.128793 25852 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:51.267198 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:51.270956 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:51.164412 25822 consensus_meta.cc:287] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
W20260709 13:09:51.160552 26000 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:09:51.054602 25821 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:51.075747 25736 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:51.265481 26008 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:09:51.149713 25977 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:51.076476 25893 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:51.065166 25723 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:51.117269 25891 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:51.070107 25973 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.216s
I20260709 13:09:51.213325 25996 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.095170 25879 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:51.282260 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2207) took 1353 ms. Trace:
W20260709 13:09:51.323263 23004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2043) took 1951 ms (client timeout 2469 ms). Trace:
I20260709 13:09:51.298130 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:51.323107 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:51.331974 23004 rpcz_store.cc:269] 0709 13:09:49.372269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.372461 (+   192us) service_pool.cc:224] Handling call
0709 13:09:51.300740 (+1928279us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400097754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:51.323207 (+ 22467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3142717696}
I20260709 13:09:51.161689 25978 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:51.336313 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 673) took 1759 ms. Trace:
I20260709 13:09:51.207356 25997 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.331756 22923 rpcz_store.cc:276] 0709 13:09:49.929008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.929119 (+   111us) service_pool.cc:224] Handling call
0709 13:09:49.951956 (+ 22837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.366897 (+414941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.366927 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.403405 (+ 36478us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.858056 (+454651us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:50.858095 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.858157 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.282029 (+423872us) raft_consensus.cc:1685] finished
0709 13:09:51.282051 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.282199 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7463,"raft.queue_time_us":65222,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":743818,"threads_started":2,"wal-append.queue_time_us":509141}
W20260709 13:09:51.337703 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.246268 25932 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:51.347965 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 570440us
I20260709 13:09:51.336706 23654 rpcz_store.cc:276] 0709 13:09:49.577320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.366552 (+789232us) service_pool.cc:224] Handling call
0709 13:09:50.407852 (+ 41300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.408055 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:50.419142 (+ 11087us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.678933 (+259791us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.335867 (+656934us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18001d2540. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3921f1fa40 00007f3921f1a4e4 00007f3921f1a455 00007f3925002060 00007f3925014716 00007f3925025287 00007f3925025208
0709 13:09:51.335995 (+   128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.336046 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:51.336098 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.336161 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.336260 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604352,"prepare.queue_time_us":12102,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3897,"raft.queue_time_us":13017,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":29961,"spinlock_wait_cycles":18305792,"thread_start_us":245391,"threads_started":1,"wal-append.queue_time_us":879876}
I20260709 13:09:51.285931 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:51.350445 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.351450 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 573664us
W20260709 13:09:51.351858 22970 connection.cc:256] RPC call timeout handler was delayed by -1.0974505679999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 13:09:51.352191 22970 connection.cc:256] RPC call timeout handler was delayed by -1.0622489410000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:09:51.352689 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:51.275913 25998 raft_consensus.cc:3055] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:51.335047 25973 consensus_queue.cc:1243] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:51.276348 25849 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:51.345019 25999 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 13:09:51.279543 26001 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 13:09:51.345681 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.278326 26005 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:09:51.337194 25893 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:51.279021 26006 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:09:51.287715 25833 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.270498 25962 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.374927 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:51.334805 25996 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:51.273242 25842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.018s	sys 0.020s
I20260709 13:09:51.349949 25997 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:51.277247 25822 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:51.426882 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.360553 25998 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:51.374372 25849 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:51.635800 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 283165us
I20260709 13:09:51.373219 26013 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:51.438526 23654 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:51.381976 26010 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:09:51.379690 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 328167us
I20260709 13:09:51.639616 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 907) took 1060 ms. Trace:
I20260709 13:09:51.639787 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:51.639986 23654 rpcz_store.cc:276] 0709 13:09:50.579443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.378792 (+799349us) service_pool.cc:224] Handling call
0709 13:09:51.399210 (+ 20418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.639388 (+240178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.639561 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:51.450801 26023 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:09:51.439256 25842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.018s	sys 0.020s
W20260709 13:09:51.453357 26015 log.cc:927] Time spent T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:09:51.459872 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 669856us
W20260709 13:09:51.648298 23620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 1.761s (SENT) [suppressed 52 similar messages]
I20260709 13:09:51.372707 25821 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:51.660087 23650 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:09:51.578154 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 444244us
I20260709 13:09:51.439038 23075 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:51.661749 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:51.616037 23656 raft_consensus.cc:2368] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6.
I20260709 13:09:51.380378 25723 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:51.384773 25838 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:51.638958 25849 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:51.618042 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 580) took 2083 ms. Trace:
I20260709 13:09:51.379640 26021 raft_consensus.cc:2764] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:51.618561 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34256 (request call id 88) took 1656 ms. Trace:
I20260709 13:09:51.679971 23072 rpcz_store.cc:276] 0709 13:09:49.534786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.536608 (+  1822us) service_pool.cc:224] Handling call
0709 13:09:49.935609 (+399001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.380116 (+444507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.380160 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.384852 (+  4692us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.685034 (+300182us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:50.956926 (+271892us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.962068 (+  5142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.962788 (+   720us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.617818 (+655030us) raft_consensus.cc:1685] finished
0709 13:09:51.617838 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.617985 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81026,"prepare.queue_time_us":380976,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":99529,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":38578,"spinlock_wait_cycles":12544,"thread_start_us":929591,"threads_started":3,"wal-append.queue_time_us":561488}
I20260709 13:09:51.374722 25969 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:09:51.625818 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 899) took 1083 ms. Trace:
I20260709 13:09:51.691563 23651 rpcz_store.cc:276] 0709 13:09:50.542240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.542351 (+   111us) service_pool.cc:224] Handling call
0709 13:09:50.646866 (+104515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.738583 (+ 91717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.625567 (+886984us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54006a1650. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:51.625743 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239651200}
I20260709 13:09:51.694572 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 916) took 1057 ms. Trace:
W20260709 13:09:51.695355 26016 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
I20260709 13:09:51.640868 23045 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:51.642412 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 418669us
I20260709 13:09:51.652382 23005 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:51.704685 22895 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:51.658280 25997 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:51.616616 26018 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.262s	user 0.001s	sys 0.006s
I20260709 13:09:51.644222 25239 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:51.672003 26025 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.672533 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:51.672854 23654 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:51.672598 25723 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:51.644906 25749 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:51.648661 26011 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.264s	user 0.006s	sys 0.001s
I20260709 13:09:51.675588 25822 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:51.676733 25970 consensus_meta.cc:287] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.002s
I20260709 13:09:51.676923 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 667) took 2146 ms. Trace:
I20260709 13:09:51.718390 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 911) took 1082 ms. Trace:
I20260709 13:09:51.677743 25962 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:51.718794 23654 rpcz_store.cc:276] 0709 13:09:50.635924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.645431 (+1009507us) service_pool.cc:224] Handling call
0709 13:09:51.672684 (+ 27253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.716104 (+ 43420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.718336 (+  2232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.677896 22931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1789) took 1721 ms. Trace:
I20260709 13:09:51.687255 23078 rpcz_store.cc:276] 0709 13:09:49.962566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.965789 (+  3223us) service_pool.cc:224] Handling call
0709 13:09:51.618268 (+1652479us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540038a4d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3925010735 00007f39250089fa 00007f3929fd04c9 00007f392354cc54 00007f392354cbe2 00007f392354cb11 00007f392354ca8c 00007f392354bd42 00007f392334548c 00007f39233448c6
0709 13:09:51.618482 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173408640}
I20260709 13:09:51.695990 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:51.696285 25979 consensus_meta.cc:287] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.041s	user 0.003s	sys 0.016s
I20260709 13:09:51.372480 25711 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:51.697824 25956 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:09:51.694926 23651 rpcz_store.cc:276] 0709 13:09:50.637223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.692508 (+1055285us) service_pool.cc:224] Handling call
0709 13:09:51.692784 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.694243 (+  1459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.694276 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.694313 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:51.694346 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.694397 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.694507 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1205,"raft.queue_time_us":2555,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67}
W20260709 13:09:51.701135 25941 consensus_meta.cc:287] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.002s
I20260709 13:09:51.645257 26013 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.717293 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:51.724721 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 76446.3us
I20260709 13:09:51.722903 22931 rpcz_store.cc:276] 0709 13:09:49.956950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.957074 (+   124us) service_pool.cc:224] Handling call
0709 13:09:49.957396 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.408740 (+451344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.408769 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.429565 (+ 20796us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.915319 (+485754us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.915356 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.915413 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.677710 (+762297us) raft_consensus.cc:1685] finished
0709 13:09:51.677729 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.677845 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47434,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":857066,"threads_started":2,"wal-append.queue_time_us":538022}
I20260709 13:09:51.718401 23653 rpcz_store.cc:276] 0709 13:09:49.530527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.334152 (+803625us) service_pool.cc:224] Handling call
0709 13:09:50.361321 (+ 27169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.408332 (+ 47011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.408359 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.424479 (+ 16120us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.950190 (+525711us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.950229 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.950294 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.676739 (+726445us) raft_consensus.cc:1685] finished
0709 13:09:51.676757 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.676872 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28399,"raft.queue_time_us":37952,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3910,"thread_start_us":484282,"threads_started":1,"wal-append.queue_time_us":991343}
W20260709 13:09:51.727624 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 60044.8us
I20260709 13:09:51.714841 25239 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.735670 23651 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:51.718595 25917 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.733186 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 921) took 1094 ms. Trace:
I20260709 13:09:51.739043 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2119) took 1380 ms. Trace:
I20260709 13:09:51.738916 23654 rpcz_store.cc:276] 0709 13:09:50.638431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.722425 (+1083994us) service_pool.cc:224] Handling call
0709 13:09:51.732684 (+ 10259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.732849 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.732885 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.732928 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.732969 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.733025 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.733133 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:51.708734 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 67936.1us
I20260709 13:09:51.739499 23074 rpcz_store.cc:276] 0709 13:09:50.358723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.916870 (+558147us) service_pool.cc:224] Handling call
0709 13:09:50.917175 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.917643 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.917672 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.929633 (+ 11961us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.024483 (+ 94850us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:51.024538 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.024623 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.738841 (+714218us) raft_consensus.cc:1685] finished
0709 13:09:51.738873 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.738994 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13293,"thread_start_us":38533,"threads_started":1,"wal-append.queue_time_us":333454}
I20260709 13:09:51.739594 22895 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:51.742372 23074 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
W20260709 13:09:51.744189 23620 connection.cc:256] RPC call timeout handler was delayed by -1.0120069690000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:09:51.744551 23620 connection.cc:256] RPC call timeout handler was delayed by -1.0039069690000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 13:09:51.733309 22923 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:51.718503 26021 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.732559 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:51.748921 23078 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:51.736253 23003 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:51.735146 25941 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.691102 25947 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:51.775230 25947 raft_consensus.cc:3055] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:51.775633 25947 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:51.776284 25941 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:51.776472 25947 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.777711 25947 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.777740 25736 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.745030 22923 pending_rounds.cc:85] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 6
I20260709 13:09:51.747611 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 923) took 1097 ms. Trace:
I20260709 13:09:51.781041 22923 pending_rounds.cc:107] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:51.781394 22923 raft_consensus.cc:2889] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.781162 23651 rpcz_store.cc:276] 0709 13:09:50.638935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.731465 (+1092530us) service_pool.cc:224] Handling call
0709 13:09:51.735359 (+  3894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.736118 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.736268 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.690574 25775 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:51.751740 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2211) took 1106 ms. Trace:
I20260709 13:09:51.780411 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:51.783051 22929 rpcz_store.cc:276] 0709 13:09:50.645428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.653679 (+  8251us) service_pool.cc:224] Handling call
0709 13:09:50.653975 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.654289 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.654313 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.654789 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.951171 (+296382us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:50.951208 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.951272 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.751425 (+800153us) raft_consensus.cc:1685] finished
0709 13:09:51.751454 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.751644 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1151,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4780,"thread_start_us":296034,"threads_started":1,"wal-append.queue_time_us":668358}
I20260709 13:09:51.752769 23649 raft_consensus.cc:2410] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:09:51.757114 25893 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:51.759824 25979 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:51.789438 25979 raft_consensus.cc:697] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:51.761870 25975 consensus_queue.cc:1059] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:51.764426 25993 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.403s	user 0.000s	sys 0.000s
I20260709 13:09:51.759223 25849 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.764546 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 898) took 1222 ms. Trace:
I20260709 13:09:51.766142 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:51.800242 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 909) took 1200 ms. Trace:
I20260709 13:09:51.800351 25969 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:51.799113 23648 rpcz_store.cc:276] 0709 13:09:50.541958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.544467 (+  2509us) service_pool.cc:224] Handling call
0709 13:09:50.544815 (+   348us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:50.655600 (+110785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.663060 (+  7460us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:50.788869 (+125809us) log.cc:844] Serialized 78 byte log entry
0709 13:09:51.174763 (+385894us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:51.360679 (+185916us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.674293 (+313614us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.693318 (+ 19025us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.693503 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.693585 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.694789 (+  1204us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:51.764287 (+ 69498us) raft_consensus.cc:1685] finished
0709 13:09:51.764318 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.764486 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352483,"prepare.queue_time_us":572688,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":374729,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":28906,"spinlock_wait_cycles":5273344,"thread_start_us":327230,"threads_started":2,"wal-append.queue_time_us":350533}
I20260709 13:09:51.800746 23655 rpcz_store.cc:276] 0709 13:09:50.599372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.684879 (+ 85507us) service_pool.cc:224] Handling call
0709 13:09:51.765950 (+1081071us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:09:51.800143 (+ 34193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4467456}
I20260709 13:09:51.770385 25902 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:51.718199 25970 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.771932 26035 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.802073 25822 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:51.802551 25822 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.802907 25822 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:51.803999 23657 raft_consensus.cc:2368] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
I20260709 13:09:51.804947 25970 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:51.805503 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 691) took 1264 ms. Trace:
I20260709 13:09:51.805858 23650 rpcz_store.cc:276] 0709 13:09:50.541443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.543766 (+  2323us) service_pool.cc:224] Handling call
0709 13:09:51.805330 (+1261564us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400709ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:51.805450 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375497600}
W20260709 13:09:51.806787 22814 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adf5adaae5184191bdaff064d051da2a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b655449a388a41e3a606c6ea794825ad is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:51.772183 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:51.773960 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:51.734391 25998 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.750982 25996 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.790633 25979 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:51.795995 23074 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:51.797022 23079 raft_consensus.cc:1240] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:51.797781 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 52514.5us
I20260709 13:09:51.741209 25239 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.820087 25997 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:51.981915 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 689) took 1895 ms (client timeout 1537 ms). Trace:
I20260709 13:09:51.909296 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:52.055341 23620 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:51.972532 23046 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:51.843205 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:52.055552 23656 rpcz_store.cc:269] 0709 13:09:50.086878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.156489 (+ 69611us) service_pool.cc:224] Handling call
0709 13:09:51.975538 (+1819049us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54005e1ad4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:51.981818 (+  6280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009960704}
I20260709 13:09:52.038604 22928 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:52.057808 22931 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.056552 22926 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.038851 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 920) took 1400 ms. Trace:
I20260709 13:09:52.059311 23649 rpcz_store.cc:276] 0709 13:09:50.638189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.019879 (+381690us) service_pool.cc:224] Handling call
0709 13:09:51.976265 (+956386us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54004deed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:52.038783 (+ 62518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682938624}
I20260709 13:09:51.856462 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:51.840629 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:51.932329 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 61481.3us
W20260709 13:09:51.820104 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 46221us
I20260709 13:09:52.074074 22929 raft_consensus.cc:1813] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Handling vote request from an unknown peer b655449a388a41e3a606c6ea794825ad
W20260709 13:09:52.074805 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.074733 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 102260us
W20260709 13:09:52.075572 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.074115 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 905) took 1530 ms. Trace:
W20260709 13:09:52.076174 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 304094us
I20260709 13:09:52.076529 23657 rpcz_store.cc:276] 0709 13:09:50.543512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.858067 (+314555us) service_pool.cc:224] Handling call
0709 13:09:51.972803 (+1114736us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54006a09d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:52.074041 (+101238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083036416}
I20260709 13:09:52.080389 22929 raft_consensus.cc:2368] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:52.085119 22895 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:52.085076 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:52.086179 22895 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.086642 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2051) took 1069 ms. Trace:
I20260709 13:09:52.088909 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:52.089309 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:51.841209 25855 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:51.820174 25851 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:52.086987 22999 rpcz_store.cc:276] 0709 13:09:51.016834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.016957 (+   123us) service_pool.cc:224] Handling call
0709 13:09:51.052812 (+ 35855us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:51.053312 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.053353 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:51.066209 (+ 12856us) log.cc:844] Serialized 78 byte log entry
0709 13:09:51.272477 (+206268us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:51.325037 (+ 52560us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.034001 (+708964us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b1800370fc0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3921f1fa40 00007f3921f1a4e4 00007f3921f1a455 00007f3925002060 00007f3925014716 00007f3925025287 00007f3925025208
0709 13:09:52.035096 (+  1095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.035206 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.035262 (+    56us) raft_consensus.cc:1685] finished
0709 13:09:52.086409 (+ 51147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.086580 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11735,"prepare.queue_time_us":61718,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1172,"raft.queue_time_us":752512,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":10738,"spinlock_wait_cycles":6092032,"thread_start_us":138812,"threads_started":1,"wal-append.queue_time_us":219216}
I20260709 13:09:51.840451 25962 raft_consensus.cc:3055] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:51.842772 25981 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:52.092559 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:51.850095 25978 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:52.074131 25998 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.030886 25869 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:51.847628 25849 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.095368 25932 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:52.095818 25723 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:52.096740 22931 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
W20260709 13:09:52.123826 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 68561.1us
I20260709 13:09:52.124600 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:52.091882 25855 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:52.097882 25822 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.098940 25953 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:52.108076 25962 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:52.107285 23046 leader_election.cc:400] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:52.141733 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1775) took 1193 ms. Trace:
I20260709 13:09:52.111383 25981 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:52.172101 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50780.3us
I20260709 13:09:51.842317 25736 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:51.840700 25996 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.112689 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.088023 25902 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:52.088150 25974 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:52.114349 25856 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:52.115105 26027 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:52.115417 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.116026 25893 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:52.092016 26007 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.120536 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 46660.3us
I20260709 13:09:52.129674 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:52.137977 25723 consensus_queue.cc:1243] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer b655449a388a41e3a606c6ea794825ad log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:52.091890 26021 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:52.090711 25879 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:09:52.111132 25931 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.174494 25981 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.121831 25973 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
W20260709 13:09:52.170390 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45854.9us
I20260709 13:09:52.221061 23620 leader_election.cc:400] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:52.173027 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:52.221863 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48963.8us
I20260709 13:09:52.221417 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:52.222492 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:52.223250 22931 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:52.223855 22970 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:52.140837 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 587) took 1302 ms. Trace:
I20260709 13:09:52.201413 22926 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:52.093318 25749 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:52.224417 23079 rpcz_store.cc:276] 0709 13:09:50.838197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.098313 (+260116us) service_pool.cc:224] Handling call
0709 13:09:51.137755 (+ 39442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.056010 (+918255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.140503 (+ 84493us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400266e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:52.140767 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515435392}
I20260709 13:09:52.225304 22923 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:52.209702 25849 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:52.204726 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 92118.9us
I20260709 13:09:52.124212 25861 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.213709 25996 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.172869 25239 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.138154 26035 raft_consensus.cc:2764] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:52.095907 26025 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:09:51.963670 26003 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:52.170971 23046 leader_election.cc:403] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:52.171084 23001 rpcz_store.cc:276] 0709 13:09:50.948308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.950858 (+  2550us) service_pool.cc:224] Handling call
0709 13:09:50.968418 (+ 17560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.968665 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:51.016008 (+ 47343us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.679267 (+663259us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b18003687a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa23a 00007f3925014a2a
0709 13:09:52.141337 (+462070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.141404 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:52.141458 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.141543 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.141671 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349225,"prepare.queue_time_us":47164,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3278,"raft.queue_time_us":349489,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4086,"spinlock_wait_cycles":17031040,"thread_start_us":112583,"threads_started":1,"wal-append.queue_time_us":1109331}
I20260709 13:09:52.201850 25902 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.252259 25902 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.229465 25855 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.252476 25879 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:52.252975 25855 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.199890 25974 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:52.254797 25974 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.226743 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:52.204722 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 89377.9us
I20260709 13:09:52.222000 25841 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.210258 25856 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:52.230060 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:52.130044 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.232173 25971 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:52.226111 25982 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.232767 26039 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:52.233253 26040 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:52.234272 25822 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:52.235363 26042 log.cc:927] Time spent T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:52.230713 25842 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:52.232335 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:52.284119 22924 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.215282 26021 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:52.243800 25861 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:52.256932 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.263804 25841 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.257093 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.258383 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:52.267030 25971 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.262657 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.230695 25871 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.249802 25996 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.297453 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.229905 25987 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:52.207741 26007 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:52.268257 22929 raft_consensus.cc:1240] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:52.248647 26003 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:52.283046 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 153444us
W20260709 13:09:52.297370 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 71801.9us
I20260709 13:09:52.299839 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:52.241329 23076 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:52.167646 25997 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:09:52.270044 26039 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:52.260713 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:52.303390 22930 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.268808 25749 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.269331 25893 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:52.265139 23045 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:52.265873 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 171171us
I20260709 13:09:52.295542 25971 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.292346 25841 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.285454 26021 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.283821 25842 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:52.296594 25871 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.264679 25962 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.315896 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 904) took 1772 ms. Trace:
I20260709 13:09:52.298657 25987 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.323789 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:52.334504 23652 rpcz_store.cc:276] 0709 13:09:50.543321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.218743 (+675422us) service_pool.cc:224] Handling call
0709 13:09:51.220119 (+  1376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.744390 (+524271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.744420 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.744914 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.958858 (+213944us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:51.958912 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.959005 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.315452 (+356447us) raft_consensus.cc:1685] finished
0709 13:09:52.315479 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.315817 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":413966,"raft.queue_time_us":414983,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":5944,"thread_start_us":248106,"threads_started":2,"wal-append.queue_time_us":272394}
I20260709 13:09:52.324046 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:52.326148 23071 pending_rounds.cc:85] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 6
I20260709 13:09:52.336172 23071 pending_rounds.cc:107] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:09:52.336534 23071 raft_consensus.cc:2889] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:52.326323 22930 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:52.325640 23046 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:52.340303 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:52.306900 25723 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.307011 25975 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:52.347509 23072 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:09:52.343618 23077 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:52.302318 26048 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.304951 26039 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.314862 25988 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:52.349763 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:52.314046 25852 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:52.350674 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53293.2us
I20260709 13:09:52.326697 25842 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.340094 25871 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.339287 25849 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.339238 25987 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:52.354436 26047 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:09:52.339138 25998 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:52.358773 26048 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:52.347198 25975 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.361574 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.398028 23620 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:52.347527 25984 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:52.348668 25953 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:52.346922 26003 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:52.353181 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 96143.4us
I20260709 13:09:52.399590 23620 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.354538 26053 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:52.405193 23079 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:09:52.406204 26041 log.cc:927] Time spent T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:09:52.407722 26013 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.409265 22924 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:52.349308 25851 consensus_queue.cc:1059] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:09:52.413097 25953 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:52.411831 25470 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.459702 23620 leader_election.cc:400] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:52.461138 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:52.447217 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.401041 25975 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.469265 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.470690 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.465845 23620 leader_election.cc:403] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:52.466154 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.466131 22924 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.468410 23000 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:52.471709 23005 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:52.473088 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:52.473407 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 60694.3us
I20260709 13:09:52.473982 22999 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:52.442176 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:52.467911 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 145559us
I20260709 13:09:52.475569 23003 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.415444 25984 raft_consensus.cc:697] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:52.403640 25947 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:52.410820 26056 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:52.482092 23045 leader_election.cc:336] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.573s (SENT)
I20260709 13:09:52.481590 25947 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.466648 25969 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:52.485526 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.488229 22924 raft_consensus.cc:2410] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:52.491240 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.492120 23006 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:52.417948 25911 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:09:52.402979 25998 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.512554 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:52.479894 26006 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:52.495321 23003 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:52.500317 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:52.514640 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.515228 22924 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:52.515260 22999 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:52.500941 22971 leader_election.cc:336] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.540s (SENT)
I20260709 13:09:52.501921 25941 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:09:52.502326 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.507014 25953 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:52.507145 25984 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.508039 26054 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:52.490721 25947 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.489674 26056 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:52.510619 25239 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:52.464934 25852 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:09:52.402944 25849 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.523252 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.540653 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.491354 25851 raft_consensus.cc:3055] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:52.557490 23000 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:52.558459 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.558622 25842 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.547043 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.559460 23003 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.560053 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.560644 23002 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.514432 25855 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.500396 25969 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:52.559015 23004 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.524266 25775 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:52.545892 25723 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:52.564539 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:52.545454 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 56121.9us
I20260709 13:09:52.573096 23000 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.582046 23621 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.580646 25775 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.584686 25775 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.581157 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.586159 23005 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:52.578965 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:52.587390 23621 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.547371 25996 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.589553 23621 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:52.547638 26056 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.524989 25856 consensus_queue.cc:1059] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:09:52.552788 25861 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.597764 23006 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:52.597882 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:52.581269 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.552758 25851 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:52.599375 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.604003 22999 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.606824 22929 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:52.569219 25956 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:09:52.609154 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 94376.2us
W20260709 13:09:52.613147 22896 leader_election.cc:336] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.594s (SENT)
I20260709 13:09:52.613656 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.617558 23000 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:52.620857 23003 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:52.621624 23002 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:52.572714 26062 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.594786 25869 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:52.625272 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.624003 26062 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.602807 26007 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:52.612857 26053 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:52.591751 26021 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.626133 26071 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.627755 25239 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.636103 25869 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:52.636132 26062 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:52.648087 23045 leader_election.cc:336] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.661s (SENT)
I20260709 13:09:52.648823 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:52.645730 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 64520.9us
W20260709 13:09:52.678483 22896 leader_election.cc:336] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.660s (SENT)
I20260709 13:09:52.678967 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.636796 25998 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.680301 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.624619 25956 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.683048 22931 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:52.683602 23045 leader_election.cc:336] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.708s (SENT)
W20260709 13:09:52.685706 23045 leader_election.cc:336] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.723s (SENT)
I20260709 13:09:52.686115 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:52.692950 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 64916.2us
I20260709 13:09:52.639189 26075 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:52.686010 25891 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:52.652871 26055 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:52.691602 25851 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.645061 26076 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:52.699172 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 109682us
I20260709 13:09:52.692490 25869 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.679709 25996 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.747493 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.640646 26039 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.696657 25998 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.697410 26075 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.750077 26075 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.750982 26039 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:52.697683 25470 consensus_queue.cc:1059] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:09:52.641209 25723 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.753603 25470 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:52.753937 25470 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:52.754741 25470 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.755858 25470 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.685302 25969 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.757118 25956 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.703366 26057 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.768113 26074 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:52.636646 26070 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
W20260709 13:09:52.783293 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.769372 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.699733 25987 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:52.803635 26072 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:09:52.742996 26048 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:52.814646 26077 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:52.822494 26074 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:52.828651 25746 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.833459 25842 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:52.834136 26078 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.836879 26055 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.821049 26039 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.922219 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:52.935580 23045 leader_election.cc:336] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.043s (SENT)
I20260709 13:09:52.936203 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:52.944382 25917 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:52.946353 26080 log.cc:927] Time spent T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:52.938706 26039 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.905859 26074 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:52.950969 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.951946 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.953560 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:52.953962 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 206523us
W20260709 13:09:52.955073 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 185754us
I20260709 13:09:52.748188 26076 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.749346 25996 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:52.909637 25982 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:52.909749 25998 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.910241 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.963704 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 353874us
I20260709 13:09:52.916347 26054 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:09:52.917668 22997 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:09:52.969666 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:52.970880 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:52.970995 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:52.971405 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.972671 23005 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:52.973531 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.968911 22999 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:52.974462 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.982074 23652 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:52.982306 23649 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: [3.6-6.7]
I20260709 13:09:52.982102 22998 raft_consensus.cc:1217] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-6.7]   Dedup: 3.6->[6.7-6.7]
I20260709 13:09:52.983422 22998 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: [3.6-6.7]
W20260709 13:09:52.977923 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.957966 25821 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.984256 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:52.961429 26076 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.988121 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.988328 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:52.988655 23002 raft_consensus.cc:1813] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Handling vote request from an unknown peer b655449a388a41e3a606c6ea794825ad
I20260709 13:09:52.989018 23005 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:52.989087 23002 raft_consensus.cc:2368] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:52.991313 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:52.806752 26053 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:52.994302 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:52.978367 26055 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:52.997412 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:52.973124 25956 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:52.995251 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 89229.3us
I20260709 13:09:52.995191 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:52.998097 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.010824 23652 raft_consensus.cc:2376] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5. Re-sending same reply.
W20260709 13:09:53.003532 22971 leader_election.cc:336] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.627s (SENT)
I20260709 13:09:53.010842 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:52.982851 25849 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.011814 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:53.012516 22971 leader_election.cc:336] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.682s (SENT)
I20260709 13:09:53.012895 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.013399 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.013986 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:52.964545 25917 consensus_queue.cc:1059] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:09:53.015951 23003 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:09:53.018101 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 46772.4us
I20260709 13:09:52.969765 25998 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:52.951030 26074 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.024421 23621 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:53.026523 23621 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:53.028280 23621 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:53.036661 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:52.985819 25978 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:09:52.998724 26079 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.037331 23656 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:53.009248 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.039552 23002 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:53.039204 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.017377 25956 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:52.998167 25855 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.966548 25982 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.009451 26055 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:53.034448 23004 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:09:53.043022 23045 leader_election.cc:400] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:53.044236 23651 pending_rounds.cc:85] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 5
I20260709 13:09:53.046588 23651 pending_rounds.cc:107] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:53.046891 23651 raft_consensus.cc:2889] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.047405 23621 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:53.038041 25849 raft_consensus.cc:3055] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:53.024526 26021 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.032110 26039 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:53.049328 26079 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:53.038740 26082 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:53.051715 26055 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.053490 25956 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:53.058233 25871 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.011s
I20260709 13:09:53.044575 23648 raft_consensus.cc:2376] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7. Re-sending same reply.
I20260709 13:09:53.043795 26086 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:53.063452 25869 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:53.096414 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49068.4us
I20260709 13:09:53.083268 23656 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:09:53.043524 25749 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.732s	user 0.014s	sys 0.025s
I20260709 13:09:53.004410 26078 consensus_queue.cc:1059] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:09:53.027590 25723 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:09:53.045073 26074 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.044003 25917 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:53.085142 25981 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.010s
I20260709 13:09:53.067524 25849 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:53.091889 26082 raft_consensus.cc:697] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:53.091288 25974 consensus_meta.cc:287] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.836s	user 0.017s	sys 0.004s
I20260709 13:09:53.090207 26039 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:53.111132 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.095779 26079 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:53.101562 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.106815 26055 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.120646 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:53.109782 25902 consensus_meta.cc:287] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.857s	user 0.011s	sys 0.011s
W20260709 13:09:53.112072 25971 consensus_meta.cc:287] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.769s	user 0.017s	sys 0.002s
I20260709 13:09:53.119920 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.106052 25749 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
W20260709 13:09:53.116039 25841 consensus_meta.cc:287] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.005s
I20260709 13:09:53.124050 26059 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:09:53.116998 25917 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.118736 25981 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.125221 26034 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:53.124471 25849 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:53.117985 25775 consensus_meta.cc:287] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.014s
I20260709 13:09:53.094640 25871 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.171324 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.106192 25956 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:09:53.180644 25956 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:53.181102 25956 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:53.182087 25956 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.141273 25902 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.186169 25902 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.190726 25956 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.190759 23080 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:53.178330 26082 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.133078 25978 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:53.193300 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 98720.7us
I20260709 13:09:53.144672 26039 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:53.122900 25974 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.194931 25994 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.205161 22928 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:53.117837 26075 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.209977 23001 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:53.191972 25947 consensus_meta.cc:287] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:09:53.212330 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2136) took 1915 ms. Trace:
I20260709 13:09:53.219105 23074 rpcz_store.cc:276] 0709 13:09:51.297138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.743302 (+446164us) service_pool.cc:224] Handling call
0709 13:09:51.743606 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.060983 (+317377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.212100 (+1151117us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b54000893d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:53.212252 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119929088}
I20260709 13:09:53.215225 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.132893 26007 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:09:53.170804 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.221149 23656 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:53.196615 25978 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.169785 25841 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.204183 25996 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.141362 25971 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.256966 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.192725 25775 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.219902 25849 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.265461 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.266494 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.264575 25974 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.229966 25998 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:53.284189 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.259824 25978 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.194564 26034 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.261915 26086 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:53.304958 23656 raft_consensus.cc:2393] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.319780 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.271817 22926 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:53.231932 25947 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.302434 25749 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:53.318746 25941 consensus_meta.cc:287] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.786s	user 0.018s	sys 0.007s
I20260709 13:09:53.328141 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.324820 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:53.329569 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.331591 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.331848 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.333055 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.333820 23077 raft_consensus.cc:2410] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:09:53.333690 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.334479 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.335160 23072 raft_consensus.cc:2368] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
W20260709 13:09:53.335765 22896 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.602s (SENT)
I20260709 13:09:53.335882 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.336220 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.336990 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:53.337247 22896 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.607s (SENT)
I20260709 13:09:53.337667 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:53.338014 26021 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:53.338322 25911 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.318361 25932 raft_consensus.cc:3055] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:53.336342 25852 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:53.342156 23073 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:53.344641 23655 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.308209 23648 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.345321 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.349771 23077 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.350033 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.351380 23656 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:53.344828 25932 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:09:53.355844 26090 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:09:53.306255 26039 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.357748 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.317708 25982 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:53.358248 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.358949 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.361366 23656 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 3.
I20260709 13:09:53.362175 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.362183 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.362797 23656 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 1.
I20260709 13:09:53.339449 25941 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
W20260709 13:09:53.371266 26056 consensus_meta.cc:287] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.010s
I20260709 13:09:53.372069 26056 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:53.372604 25975 consensus_meta.cc:287] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.891s	user 0.012s	sys 0.020s
I20260709 13:09:53.373014 25975 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.374013 26056 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.375274 22999 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:53.360600 23651 raft_consensus.cc:2376] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3. Re-sending same reply.
I20260709 13:09:53.376727 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:53.377338 22896 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.651s (SENT)
I20260709 13:09:53.377776 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:53.362721 23073 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
W20260709 13:09:53.366113 26091 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:09:53.366053 26096 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.264909 26079 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.218740 25994 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.344645 25852 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:53.415683 26096 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.368429 25971 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.368726 26034 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.368942 26100 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:53.369763 23075 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:09:53.370204 26089 log.cc:927] Time spent T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 13:09:53.363466 26014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.008s	sys 0.000s
I20260709 13:09:53.378454 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.369848 25775 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.379285 26003 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.381105 23657 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:53.382943 26013 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.364212 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.390345 25749 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.366611 26075 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:53.377206 26062 consensus_meta.cc:287] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.022s
I20260709 13:09:53.411041 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:53.429718 26014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.008s	sys 0.000s
I20260709 13:09:53.374927 25975 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.365741 26102 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:53.354202 25932 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.416692 25852 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.421852 23075 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:53.426401 23077 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:53.389130 25841 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.390529 25917 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.442319 25947 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.436887 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:53.455160 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:53.437348 23656 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.413671 25871 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.455848 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:53.456476 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:53.434194 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.412184 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.444597 23071 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:53.449537 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.449949 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:53.457911 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:53.458328 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.413975 25821 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.444021 26075 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.442721 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.458921 23656 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:53.453984 26102 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:53.460340 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.364148 26086 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.465368 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.467758 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.469938 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.429931 26100 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.452909 25852 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.472812 23073 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:53.441462 25956 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:09:53.440845 25749 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.439594 26013 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.455554 25973 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.471587 25917 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:53.488255 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:53.460335 25932 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.442072 26062 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:53.502691 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 177965us
W20260709 13:09:53.496196 25470 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.003s
I20260709 13:09:53.452131 26078 consensus_queue.cc:1059] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:53.472523 25736 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.504777 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.510378 22896 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:53.479197 23648 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:53.488713 26021 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.491896 25902 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:53.477851 26025 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:53.515368 22971 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.811s (SENT)
I20260709 13:09:53.501488 25917 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:53.521185 22923 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.526480 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:53.454952 26082 consensus_queue.cc:1175] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:09:53.520437 25841 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:53.525626 25821 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:53.529615 25917 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.539885 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.529985 25470 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:53.555243 22971 leader_election.cc:336] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.851s (SENT)
I20260709 13:09:53.555861 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:53.546515 26104 log.cc:927] Time spent T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:09:53.538167 25841 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:53.570618 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.571805 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.572871 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:53.579031 23005 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:09:53.574853 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.570092 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.579798 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.580971 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.583237 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.586104 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.586908 25956 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.592077 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.552011 26014 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:53.594807 23077 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:53.595759 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.596349 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.596350 23077 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:53.598321 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.599830 25974 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:53.599407 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.601141 23077 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:53.602030 26105 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:53.603941 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.604626 23072 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:53.604707 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.605239 23078 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.605291 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.607895 23077 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:53.608945 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.609697 23077 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 3: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:53.578415 26094 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.613525 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.590184 25841 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.621666 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.623257 23077 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:53.623433 23620 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47800 dropped due to backpressure: service queue is full with 50 items
I20260709 13:09:53.548282 26102 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.597113 26014 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:53.635263 23077 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:53.607717 25911 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.636615 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:53.638104 22999 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:53.638648 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.639479 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:53.641021 25749 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.630800 26014 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:53.643132 23080 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2105) took 3674 ms (client timeout 1947 ms). Trace:
W20260709 13:09:53.643519 23080 rpcz_store.cc:269] 0709 13:09:49.968610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.968815 (+   205us) service_pool.cc:224] Handling call
0709 13:09:53.642969 (+3674154us) spinlock_profiling.cc:243] Waited 3.17 s on lock 0x7b5400294354. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:53.643067 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7299766528}
I20260709 13:09:53.648097 23078 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:53.648612 23080 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:53.653555 23078 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:53.646837 25974 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:53.624013 23620 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47800 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 887)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 882)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 940)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 714)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 715)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 720)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 929)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 939)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 945)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 946)
W20260709 13:09:53.653962 26076 consensus_meta.cc:287] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.644s	user 0.004s	sys 0.009s
I20260709 13:09:53.667912 26076 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.670843 23650 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:53.672385 26076 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:53.672784 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.671819 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.677268 23654 raft_consensus.cc:2368] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9.
I20260709 13:09:53.655859 25974 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.678115 25974 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.678916 26096 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:53.677961 25841 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.681227 25841 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.682703 25962 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.695520 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.705639 23620 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47784 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 882)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 940)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 714)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 715)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 720)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 929)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 939)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 945)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 891)
I20260709 13:09:53.711141 23652 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.712466 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.658318 26062 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:53.705025 26111 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:09:53.723907 25736 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:53.721028 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.666894 25978 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.725729 23650 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:53.730813 25978 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.732753 26014 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.734241 26014 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.737260 25917 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.740061 25917 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.740172 23656 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:53.745860 25974 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.747330 25974 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:53.776504 22827 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35496 (request call id 374) took 14147 ms (client timeout 15000 ms). Trace:
I20260709 13:09:53.776160 22825 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:53.781106 23072 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:53.782925 23074 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:53.784471 23077 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:53.784638 22971 leader_election.cc:336] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.954s (SENT)
I20260709 13:09:53.785713 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:53.777670 22827 rpcz_store.cc:269] 0709 13:09:39.482975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.485629 (+  2654us) service_pool.cc:224] Handling call
0709 13:09:53.630197 (+14144568us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:44.346269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:44.347077 (+   808us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:44.347117 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:09:44.347156 (+    39us) tablet.cc:662] Decoding operations
0709 13:09:44.354430 (+  7274us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:44.354524 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:44.354549 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:09:44.537397 (+182848us) tablet.cc:701] Row locks acquired
0709 13:09:44.537448 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:09:44.537621 (+   173us) write_op.cc:270] Start()
0709 13:09:44.537795 (+   174us) write_op.cc:276] Timestamp: P: 1783602584537556 usec, L: 0
0709 13:09:44.537819 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:09:44.538538 (+   719us) log.cc:844] Serialized 5860 byte log entry
0709 13:09:45.322916 (+784378us) op_driver.cc:464] REPLICATION: finished
0709 13:09:45.496356 (+173440us) write_op.cc:301] APPLY: starting
0709 13:09:45.496480 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:45.496846 (+   366us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:45.496970 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:45.513035 (+ 16065us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:45.902761 (+389726us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:09:45.902844 (+    83us) write_op.cc:312] APPLY: finished
0709 13:09:45.903398 (+   554us) log.cc:844] Serialized 101 byte log entry
0709 13:09:45.903619 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.903834 (+   215us) write_op.cc:454] Released schema lock
0709 13:09:45.903914 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:45.907557 (+  3643us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.907597 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3833114,"reported_tablets":26,"spinlock_wait_cycles":312704,"child_traces":[["op",{"apply.queue_time_us":134605,"apply.run_cpu_time_us":5145,"apply.run_wall_time_us":419302,"num_ops":14,"prepare.queue_time_us":48241,"prepare.run_cpu_time_us":52859,"prepare.run_wall_time_us":940759,"raft.queue_time_us":12396,"raft.run_cpu_time_us":24675,"raft.run_wall_time_us":104350,"replication_time_us":784928,"thread_start_us":843384,"threads_started":4,"wal-append.queue_time_us":628361,"wal-append.run_cpu_time_us":5208,"wal-append.run_wall_time_us":1740764}]]}
I20260709 13:09:53.798338 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:53.714641 23620 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47784 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 895)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 940)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 714)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 715)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 720)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 929)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 939)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 945)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 891)
I20260709 13:09:53.806530 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2228) took 1505 ms. Trace:
I20260709 13:09:53.806789 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:53.807894 23000 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.810415 23070 tablet_service.cc:1558] Processing DeleteTablet for tablet 590119d9a7e74f099c0a28550f4fb3f5 with delete_type TABLET_DATA_TOMBSTONED (TS b655449a388a41e3a606c6ea794825ad not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34256
I20260709 13:09:53.807123 22928 rpcz_store.cc:276] 0709 13:09:52.300802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.300999 (+   197us) service_pool.cc:224] Handling call
0709 13:09:52.301381 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.213731 (+912350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.805795 (+592064us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400346f54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:53.806223 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078089088}
I20260709 13:09:53.811789 22825 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 3, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 3 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.809306 22926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 701) took 1551 ms. Trace:
I20260709 13:09:53.816859 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:53.826037 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:53.829041 23076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2129) took 3810 ms (client timeout 1651 ms). Trace:
W20260709 13:09:53.829368 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.835203 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50841.2us
I20260709 13:09:53.836653 25861 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:53.836941 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.840212 25932 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:53.845139 22926 rpcz_store.cc:276] 0709 13:09:52.258046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.258168 (+   122us) service_pool.cc:224] Handling call
0709 13:09:53.808719 (+1550551us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54003ca5d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:53.809024 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254573312}
W20260709 13:09:53.845947 23076 rpcz_store.cc:269] 0709 13:09:50.018003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.521760 (+503757us) service_pool.cc:224] Handling call
0709 13:09:53.828536 (+3306776us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540010c554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:53.828759 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3734338944}
I20260709 13:09:53.858088 22825 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.859948 26014 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:53.860877 26014 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.861351 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.862376 23652 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:09:53.811287 22814 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adf5adaae5184191bdaff064d051da2a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b655449a388a41e3a606c6ea794825ad is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:53.863852 25974 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:53.864032 22814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53098.3us
I20260709 13:09:53.864709 25974 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.866012 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.867666 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:53.868695 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.869549 23656 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
W20260709 13:09:53.873317 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.874253 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.874555 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:53.874807 25969 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:53.875641 22927 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 3: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:53.876114 25969 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:53.876565 25969 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:53.877295 22927 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:53.877224 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.878207 23657 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:53.878494 25997 consensus_queue.cc:1059] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:53.879567 25997 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:53.880017 25997 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:53.880424 26003 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:53.868726 22922 raft_consensus.cc:2410] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:53.865618 25974 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.880038 26062 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:09:53.879207 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.881217 25997 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.870846 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.863163 22825 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:09:53.862390 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 45941.6us
I20260709 13:09:53.890995 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.897998 25841 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:53.899473 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:53.899961 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:53.906877 22925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2229) took 1602 ms. Trace:
I20260709 13:09:53.907970 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.909644 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.896093 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.910953 23654 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.898643 25841 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:53.913429 25841 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:53.914948 25841 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.916034 25987 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.920629 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.911247 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.907353 22925 rpcz_store.cc:276] 0709 13:09:52.304460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.304674 (+   214us) service_pool.cc:224] Handling call
0709 13:09:52.313544 (+  8870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.417470 (+103926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.417513 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.417612 (+    99us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:52.417664 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.906346 (+1488682us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000ce9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:53.906439 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.906698 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238539136}
I20260709 13:09:53.912065 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:53.907588 22971 leader_election.cc:336] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.166s (SENT)
I20260709 13:09:53.928607 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:53.932265 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.932442 26013 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:53.932273 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:53.940920 25994 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:53.941687 22825 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.942613 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.944069 23654 raft_consensus.cc:2393] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 4: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.937008 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:53.952504 22926 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:09:53.952919 22926 pending_rounds.cc:85] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 3
I20260709 13:09:53.953197 22926 pending_rounds.cc:107] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:09:53.953473 22926 raft_consensus.cc:2889] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.896646 26003 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.955123 26003 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.889323 25969 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.957125 25969 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.957849 26003 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.959146 26092 raft_consensus.cc:3055] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:53.961117 23650 raft_consensus.cc:2368] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4.
I20260709 13:09:53.962169 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.962906 23650 raft_consensus.cc:2376] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7. Re-sending same reply.
I20260709 13:09:53.964205 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.967276 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:53.974432 23071 raft_consensus.cc:2410] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:53.974349 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:53.974946 26098 log.cc:927] Time spent T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.618s	user 0.000s	sys 0.008s
I20260709 13:09:53.967404 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:53.970641 26100 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:53.970994 26092 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:53.976200 23649 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:53.976956 26092 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:53.972113 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:53.978366 23079 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:53.977367 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.979261 26024 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:53.971689 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.979620 23649 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:09:53.981458 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 667) took 1432 ms. Trace:
I20260709 13:09:53.981510 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.981988 23006 rpcz_store.cc:276] 0709 13:09:52.548527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.548701 (+   174us) service_pool.cc:224] Handling call
0709 13:09:52.572174 (+ 23473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.600552 (+ 28378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.980927 (+1380375us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5400096d54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:53.981267 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58461568}
I20260709 13:09:53.982981 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.978238 26092 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.988418 23651 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:53.989305 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.989970 23651 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.977552 25974 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:53.977890 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:53.997036 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.995165 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:53.998679 23654 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.944972 26014 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.002094 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:54.003384 22927 raft_consensus.cc:2410] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:54.004374 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.006438 23000 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:53.945276 22825 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 8, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.025558 25997 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.026085 23006 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:54.026280 23073 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:54.026450 23006 pending_rounds.cc:85] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 6
I20260709 13:09:54.026759 23006 pending_rounds.cc:107] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:54.026975 23006 raft_consensus.cc:2889] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.011644 26024 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:54.028872 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.034719 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:54.037767 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 141603us
I20260709 13:09:54.037223 23656 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:54.039252 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:54.040416 22929 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:54.042719 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.041201 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.038245 22825 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.046149 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:54.049724 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.050678 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:54.057444 23006 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:54.065249 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.067443 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:54.068010 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 82736.1us
I20260709 13:09:54.069108 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:54.070391 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 162897us
I20260709 13:09:54.068324 23655 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:54.072724 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:54.073412 23655 raft_consensus.cc:2376] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8. Re-sending same reply.
I20260709 13:09:54.074532 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.075575 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:54.076442 23071 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:54.077245 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:54.077782 25981 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.079250 23078 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:54.080356 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:54.080992 23080 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:54.079025 25470 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:54.081990 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:54.082554 25470 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:54.082947 25470 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:54.084049 25470 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.085306 25470 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.073559 23077 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:54.069239 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:54.089562 23655 raft_consensus.cc:1813] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Handling vote request from an unknown peer b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.081007 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.098996 23655 raft_consensus.cc:2368] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:54.099483 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 874) took 1044 ms. Trace:
I20260709 13:09:54.101884 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:54.073299 25851 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:54.107491 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.107995 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:54.099898 23655 rpcz_store.cc:276] 0709 13:09:53.055133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.074276 (+1019143us) service_pool.cc:224] Handling call
0709 13:09:54.099423 (+ 25147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.109894 23652 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:54.111032 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.113260 23006 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:54.115046 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:54.115798 23074 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:54.108239 22825 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.116792 23005 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:54.114905 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:54.116148 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:54.111135 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:54.110934 23002 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.118551 23650 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:54.129158 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 707) took 1013 ms. Trace:
I20260709 13:09:54.130584 23656 raft_consensus.cc:2410] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:54.129561 23650 rpcz_store.cc:276] 0709 13:09:53.115536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.024701 (+909165us) service_pool.cc:224] Handling call
0709 13:09:54.129088 (+104387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.145253 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:54.145556 26021 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:54.145939 26021 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:54.146292 26021 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:54.147178 22970 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:54.147542 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 66793us
I20260709 13:09:54.148945 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.149175 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:54.149477 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 80522.8us
I20260709 13:09:54.150591 25981 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:54.151012 25981 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:54.151386 25981 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.152616 26024 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:54.152719 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:54.154042 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:54.154145 26024 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:54.154654 26024 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:54.155123 26024 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.155588 23072 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:09:54.155766 26057 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.156302 26099 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:54.156397 26057 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.157352 26099 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:54.158320 26100 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:54.158890 26100 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:54.159945 26100 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.161664 26100 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.161890 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:54.163017 22922 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:54.156414 23046 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:54.164731 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57664.3us
I20260709 13:09:54.165285 26107 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:54.165717 26107 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:54.166473 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.166831 26107 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.167510 25979 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:54.167840 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:54.168011 25979 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:54.168440 25979 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.168881 25931 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:54.166491 23649 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:54.172319 23649 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:54.172889 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 877) took 1116 ms. Trace:
I20260709 13:09:54.173194 23649 rpcz_store.cc:276] 0709 13:09:53.056187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.171531 (+1115344us) service_pool.cc:224] Handling call
0709 13:09:54.171910 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.172667 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.172826 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.175799 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.176313 23649 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [2.5-4.7]
W20260709 13:09:54.176955 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 65153.7us
I20260709 13:09:54.177794 26082 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:54.179636 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.180040 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:54.180773 23078 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:54.181260 23657 raft_consensus.cc:2393] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:54.181329 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1816) took 1870 ms. Trace:
I20260709 13:09:54.167546 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:54.158366 23001 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:54.181831 22930 rpcz_store.cc:276] 0709 13:09:52.310723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.337702 (+ 26979us) service_pool.cc:224] Handling call
0709 13:09:52.338065 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.340569 (+  2504us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:52.516141 (+175572us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.976259 (+1460118us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180009ec80. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa23a 00007f3925014a2a
0709 13:09:54.082664 (+106405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.083398 (+   734us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.083625 (+   227us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:54.083672 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.083781 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.180931 (+ 97150us) raft_consensus.cc:1685] finished
0709 13:09:54.181031 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.181170 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48307,"prepare.queue_time_us":202503,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":26591,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":8408,"spinlock_wait_cycles":23887744,"thread_start_us":198624,"threads_started":2,"wal-append.queue_time_us":1639269}
I20260709 13:09:54.175791 25978 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:54.158914 26057 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:54.186190 23046 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.187170 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2242) took 1234 ms. Trace:
W20260709 13:09:54.158911 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.188110 23653 raft_consensus.cc:2410] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:09:54.189967 23653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 866) took 1196 ms (client timeout 1578 ms). Trace:
W20260709 13:09:54.190330 23653 rpcz_store.cc:269] 0709 13:09:52.993972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.994089 (+   117us) service_pool.cc:224] Handling call
0709 13:09:54.189770 (+1195681us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540076b954. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:54.189904 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700068736}
I20260709 13:09:54.191924 25971 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.192586 23080 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:54.192656 25971 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.157286 22999 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:54.156320 26119 tablet_replica.cc:333] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:09:54.167117 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:54.194926 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:54.195528 23080 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.168022 25711 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:54.199252 23650 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:54.199739 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 43913.5us
I20260709 13:09:54.199908 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 873) took 1145 ms. Trace:
I20260709 13:09:54.200222 23649 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:54.200485 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:54.200299 23650 rpcz_store.cc:276] 0709 13:09:53.054757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.198609 (+1143852us) service_pool.cc:224] Handling call
0709 13:09:54.198992 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.199679 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.199832 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.201965 23650 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:54.203341 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.205173 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.205796 26035 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:54.193398 25978 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:54.184212 23006 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:54.207456 23651 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:54.208125 23655 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:54.211428 26021 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:54.211994 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:54.212693 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 63877.9us
W20260709 13:09:54.213725 26121 log.cc:927] Time spent T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 13:09:54.163549 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:54.187548 22923 rpcz_store.cc:276] 0709 13:09:52.952757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.025136 (+ 72379us) service_pool.cc:224] Handling call
0709 13:09:53.039960 (+ 14824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.526717 (+486757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.186782 (+660065us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54002a2bd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:54.187004 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106303744}
I20260709 13:09:54.225872 23653 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:54.226277 23653 pending_rounds.cc:85] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 5
I20260709 13:09:54.226475 23653 pending_rounds.cc:107] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:54.226704 23653 raft_consensus.cc:2889] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.227728 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:54.231037 23000 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:54.218406 23654 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:54.182423 23657 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 4 LEARNER]: Advancing to term 5
I20260709 13:09:54.219457 23648 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:09:54.221038 23080 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:09:54.221675 22930 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:09:54.222012 22998 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:54.222081 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:54.222936 23006 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:54.135710 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:54.239493 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:54.241240 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:54.242110 23654 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:54.244109 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:54.245682 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 203127us
I20260709 13:09:54.246817 23652 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.250900 23649 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.257542 22997 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:54.261650 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:54.271804 25953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.006s	sys 0.015s
W20260709 13:09:54.272641 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 123541us
I20260709 13:09:54.256687 25711 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:54.272202 25953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.006s	sys 0.016s
I20260709 13:09:54.274644 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:54.324728 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 50065.9us
W20260709 13:09:54.329105 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.263139 26014 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.263371 25969 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:54.325568 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 48834us
W20260709 13:09:54.278765 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 207307us
I20260709 13:09:54.332619 23648 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:09:54.332962 23648 pending_rounds.cc:85] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 5
I20260709 13:09:54.333153 23648 pending_rounds.cc:107] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:54.333352 23648 raft_consensus.cc:2889] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.277261 25711 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.270686 25841 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:54.338934 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.343379 26021 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.343631 26003 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:54.402735 26035 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:54.404501 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 127812us
I20260709 13:09:54.348014 23648 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:54.348332 22971 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:54.350142 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.405360 25841 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.353108 26119 raft_consensus.cc:2243] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.406108 26092 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:54.353330 25987 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:54.353404 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 78832.8us
W20260709 13:09:54.354741 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.355294 26057 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:09:54.386955 26107 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:54.389514 26127 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:54.415783 26014 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.388509 25962 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:09:54.396732 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.436018 23002 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
W20260709 13:09:54.440294 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 104040us
I20260709 13:09:54.445525 23649 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2.
I20260709 13:09:54.409614 25971 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.347779 26059 consensus_queue.cc:1059] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 13:09:54.464680 26059 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:54.465086 26059 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:54.466080 26059 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:54.357419 22997 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:54.446542 26024 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:54.454371 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 106111us
I20260709 13:09:54.419559 25711 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.423928 25969 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.462478 26053 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:54.462637 23621 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:54.463625 25599 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:54.467914 25879 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.482125 25879 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:54.482900 22931 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:54.484203 25879 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.467993 26092 consensus_queue.cc:1243] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:54.485466 25879 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:54.469808 26024 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.488197 25879 raft_consensus.cc:3055] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:54.470377 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 197989us
I20260709 13:09:54.488656 25879 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:54.489189 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.489497 25841 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:54.490645 23620 leader_election.cc:400] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:09:54.472561 23005 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:54.486881 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 223528us
I20260709 13:09:54.471583 22971 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:54.467636 26059 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.490823 23648 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:54.494009 23652 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:54.475972 23045 leader_election.cc:400] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9.
I20260709 13:09:54.446434 25987 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.449649 26003 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:54.496800 23045 leader_election.cc:403] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:54.478152 25599 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:54.497588 23653 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:09:54.472153 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.477900 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:54.498853 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.477051 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 126960us
I20260709 13:09:54.475924 25969 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:54.452276 25978 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:54.447692 26099 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:54.476671 26119 raft_consensus.cc:2272] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.505551 22998 pending_rounds.cc:85] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 5
I20260709 13:09:54.514923 22998 pending_rounds.cc:107] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:54.515291 22998 raft_consensus.cc:2889] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.471261 25962 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:54.478981 26082 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:54.479923 26007 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.510673 23648 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:54.512102 23000 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:54.515322 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:54.499509 25987 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.514662 22923 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:54.502485 26003 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:54.520807 23657 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:09:54.528514 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 57048.2us
I20260709 13:09:54.504415 26035 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:54.530323 23652 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:54.536024 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 63978.9us
W20260709 13:09:54.537094 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.538408 23653 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:54.540988 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 721) took 1181 ms. Trace:
I20260709 13:09:54.536921 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:54.542428 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 66696.3us
I20260709 13:09:54.543514 23045 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:54.541512 23657 rpcz_store.cc:276] 0709 13:09:53.346644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.181925 (+835281us) service_pool.cc:224] Handling call
0709 13:09:54.182295 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.527516 (+345221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.527773 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.526667 26003 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:54.523976 25841 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.551977 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:54.552784 23649 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:54.489542 25879 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:54.533238 25981 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:54.533041 26082 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:54.589125 23654 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
W20260709 13:09:54.575119 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.582216 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.597954 22895 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:54.600924 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:54.595049 25931 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:54.608032 26079 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:09:54.608978 26107 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:54.609412 26079 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:54.609882 26079 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:54.609609 26107 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.591552 25974 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.611950 26107 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:54.612398 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.612455 26082 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.616007 25723 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:54.616493 25723 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:54.616874 25723 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:54.617508 22922 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:54.619961 25861 consensus_queue.cc:1059] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:54.621186 25861 raft_consensus.cc:3055] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:54.621573 25861 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:54.600046 25932 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.625236 25932 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:54.626361 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 104512us
I20260709 13:09:54.595921 25962 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.628654 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.629452 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:54.629475 26099 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:54.630424 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.631000 26099 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:54.630972 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:54.631927 26099 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:54.556119 25978 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.638396 25978 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:54.640223 26132 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:09:54.641052 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48393.4us
I20260709 13:09:54.641244 25470 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:54.596843 26035 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.643222 25989 consensus_queue.cc:1059] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:54.643855 25979 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.646039 25979 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:54.646498 22930 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:54.622625 25861 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.646615 26033 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9.
I20260709 13:09:54.631556 23620 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.628515 25962 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.589512 26014 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:54.651788 22927 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:54.652375 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.581019 25996 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:54.654963 25979 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.627406 25932 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:54.651396 25931 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:54.663722 26100 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:54.664284 26100 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:54.664744 25981 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.578693 25599 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.665238 26100 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.666193 25599 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.581682 26021 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:09:54.667786 26025 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:54.668186 26025 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.668527 26025 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.670691 25723 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:54.671860 25931 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:54.672834 25931 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.610891 26079 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.674180 26079 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:54.673286 25962 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:54.678496 26119 ts_tablet_manager.cc:1916] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:54.658218 25979 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.680663 25861 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.682266 25979 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:54.682812 26003 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:54.685550 22922 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:54.686676 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:54.687345 22923 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:54.649391 25841 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:54.687940 25841 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.688273 25841 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.688408 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:54.688961 26003 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:54.689014 22928 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:54.690006 25978 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:54.691814 25978 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:54.588486 25711 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:54.556438 25997 consensus_queue.cc:1059] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:09:54.710870 23046 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:54.713671 25849 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:54.714066 25849 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.714388 25849 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.714438 25711 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:54.715030 25932 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:54.716522 26035 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:54.720722 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 72093.3us
I20260709 13:09:54.662922 25879 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:54.726466 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 94965.2us
I20260709 13:09:54.752996 23620 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:54.806388 22896 leader_election.cc:336] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.262s (SENT)
I20260709 13:09:54.807034 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:54.718446 26014 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:54.743052 25996 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:54.872387 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 274473us
I20260709 13:09:54.865090 26035 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.874207 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.863755 26100 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:54.875476 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 274600us
I20260709 13:09:54.871452 26053 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:54.911170 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.908280 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 160460us
I20260709 13:09:54.875365 26014 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:54.925343 23651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.072s
W20260709 13:09:54.925700 23651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.012s	sys 0.072s
W20260709 13:09:54.931293 22971 leader_election.cc:336] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.209s (SENT)
I20260709 13:09:54.931794 22971 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.940887 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:54.934923 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 292110us
I20260709 13:09:54.926319 26014 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:54.928884 26035 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.928776 25711 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.983536 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 109510us
I20260709 13:09:54.984565 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:54.940475 25978 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.018795 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 945) took 1576 ms. Trace:
I20260709 13:09:55.019274 23656 rpcz_store.cc:276] 0709 13:09:53.432781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.206207 (+773426us) service_pool.cc:224] Handling call
0709 13:09:54.206581 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.254100 (+ 47519us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:54.754148 (+500048us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.009277 (+255129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.009323 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.009366 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.009427 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.009537 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6416,"prepare.queue_time_us":736123,"thread_start_us":658637,"threads_started":2}
I20260709 13:09:55.021123 25978 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:55.028306 26133 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:09:55.032889 26134 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:09:55.008515 25711 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:55.034731 25711 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:55.038662 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:55.040381 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:55.041769 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:55.042804 23002 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:09:55.044067 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:55.047713 25723 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:55.009611 26092 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:55.003182 26003 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:55.056720 25849 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.057850 26107 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.058359 26107 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.060391 26107 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:55.061601 26135 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:09:55.071964 25953 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:55.072690 25953 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:55.080636 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.080382 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 139597us
I20260709 13:09:55.004123 25962 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:55.088969 25974 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:55.089752 25974 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:55.092587 25974 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:55.094381 25953 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:55.095867 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.100669 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.075583 25987 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:09:55.043361 25841 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.169796 22927 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:55.100723 25962 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:55.176590 23620 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:55.178188 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.178617 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.128878 25969 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.001s
I20260709 13:09:55.171938 26082 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.184005 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:55.184798 22998 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 4: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:55.184959 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 946) took 1752 ms. Trace:
I20260709 13:09:55.184304 26082 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.185322 23655 rpcz_store.cc:276] 0709 13:09:53.432924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.209283 (+776359us) service_pool.cc:224] Handling call
0709 13:09:54.209628 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.210010 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.210040 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.210495 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.556771 (+346276us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:54.876716 (+319945us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.877117 (+   401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.877204 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.184738 (+307534us) raft_consensus.cc:1685] finished
0709 13:09:55.184766 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.184890 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466205,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":8166,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":14340,"thread_start_us":639188,"threads_started":2,"wal-append.queue_time_us":540475}
I20260709 13:09:55.187927 26082 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:55.183120 25962 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.189932 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:55.190272 26024 raft_consensus.cc:3055] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:55.190609 22998 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:55.190694 26024 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:55.192126 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:55.166520 25989 raft_consensus.cc:3055] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:55.198139 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 221672us
I20260709 13:09:55.200263 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:54.986049 25996 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.200956 26082 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.185415 26150 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:55.212831 26059 consensus_meta.cc:287] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.706s	user 0.005s	sys 0.005s
I20260709 13:09:55.176339 26025 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:55.161201 25987 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.195755 25969 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.309337 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:55.297065 25861 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:55.201881 25989 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:55.319986 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 267134us
I20260709 13:09:55.191620 26024 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:55.364985 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 170433us
I20260709 13:09:55.310513 26155 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.367033 25931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.004s	sys 0.004s
I20260709 13:09:55.345492 25974 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.386929 25997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.003s	sys 0.006s
I20260709 13:09:55.369653 26100 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:55.439879 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 52577.3us
I20260709 13:09:55.399993 25978 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:55.471469 25974 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.310134 26156 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.408s
I20260709 13:09:55.440907 22927 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:55.413321 22896 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.827s (SENT)
W20260709 13:09:55.410799 25931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.004s	sys 0.004s
W20260709 13:09:55.560832 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.476745 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.577637 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.578356 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:55.578982 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.581365 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:55.570875 25997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.003s	sys 0.007s
I20260709 13:09:55.504967 25994 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:55.586449 22997 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:55.587518 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:55.593787 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 673193us
I20260709 13:09:55.594321 23080 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:55.589291 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.590119 22922 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:55.590487 26160 log.cc:927] Time spent T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 13:09:55.590061 26153 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.290s
I20260709 13:09:55.590663 26099 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.578255 25849 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:55.591701 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:55.595554 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 226419us
I20260709 13:09:55.572464 26100 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.598956 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:55.593811 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 425492us
I20260709 13:09:55.606990 23006 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:55.590926 26164 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.599886 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:55.591715 26163 log.cc:927] Time spent T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:55.586076 26024 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:55.450932 26155 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.585749 25978 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:55.616649 23078 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:55.612022 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:55.616809 23072 raft_consensus.cc:2410] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:55.618744 26161 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:55.622393 26161 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.603698 26035 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:55.608798 26100 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:55.631908 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:55.635864 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:55.617905 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:55.626945 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:55.640630 22930 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:55.611230 25931 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.597684 25994 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:55.644021 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:55.691766 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:55.691994 22923 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:55.675287 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 277246us
I20260709 13:09:55.681183 23006 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:55.682128 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:55.611924 26164 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:55.609073 26099 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.631578 25974 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:55.682971 22930 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:55.683318 26158 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:09:55.714181 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:55.683816 22971 leader_election.cc:336] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.230s (SENT)
I20260709 13:09:55.683962 26177 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:55.716449 22997 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:55.635560 25849 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.714859 23079 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:55.705550 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:55.590942 25989 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.631887 26059 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.794917 25932 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:56.500005 26174 log.cc:927] Time spent T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.707s	user 0.000s	sys 0.006s
I20260709 13:09:55.887960 25599 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:56.532609 25932 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:56.533131 25599 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:56.428335 26173 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:09:56.533700 25932 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.534125 25599 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.534907 25932 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.535395 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 697) took 1906 ms. Trace:
I20260709 13:09:55.624234 25978 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:55.827312 25962 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.535982 23003 rpcz_store.cc:276] 0709 13:09:54.628419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.644659 (+ 16240us) service_pool.cc:224] Handling call
0709 13:09:54.644951 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.931093 (+286142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.931156 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.996713 (+ 65557us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.422630 (+425917us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:55.422690 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.422785 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.534981 (+1112196us) raft_consensus.cc:1685] finished
0709 13:09:56.535012 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.535173 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34474,"raft.queue_time_us":450319,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":49875,"thread_start_us":532080,"threads_started":2,"wal-append.queue_time_us":1029133}
I20260709 13:09:56.537851 25962 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:56.369940 25996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.007s	sys 0.011s
W20260709 13:09:56.546386 25996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.010s	sys 0.011s
I20260709 13:09:55.719830 25987 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.396548 25969 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:56.548430 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.746289 26141 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 13:09:56.535698 25599 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.134413 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.549966 26190 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.550209 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 693) took 2324 ms. Trace:
I20260709 13:09:56.529040 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1839) took 1830 ms. Trace:
I20260709 13:09:56.538388 25978 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:56.552207 25978 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:55.795598 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.554553 22922 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4.
I20260709 13:09:56.315578 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:55.961374 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.557580 25987 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.558107 25987 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.559717 26186 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.560139 25987 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.560400 26186 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:56.418542 23651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.016s	sys 0.023s
W20260709 13:09:56.561676 23651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.018s	sys 0.025s
I20260709 13:09:56.055490 22931 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:56.134872 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:56.562937 22926 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.555805 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.563834 22922 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:56.550633 26190 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:55.828706 26164 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:56.565876 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.566273 26190 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:55.749953 22814 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adf5adaae5184191bdaff064d051da2a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b655449a388a41e3a606c6ea794825ad is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:09:56.428843 26079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.014s
I20260709 13:09:55.894457 23071 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:55.737946 25849 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:56.027449 26143 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 1.085s	user 0.011s	sys 0.006s
W20260709 13:09:55.736936 26139 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:09:55.959693 26171 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:09:55.863019 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:56.544894 25962 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:56.531023 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:56.326382 23045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.013s	sys 0.017s
I20260709 13:09:55.969923 25861 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:56.548714 25969 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:55.857019 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 342108us
I20260709 13:09:56.550606 22999 rpcz_store.cc:276] 0709 13:09:54.225647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.225740 (+    93us) service_pool.cc:224] Handling call
0709 13:09:54.259734 (+ 33994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.359736 (+100002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.359778 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.360300 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.723647 (+363347us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:54.723701 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.723761 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.745557 (+1021796us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:56.549917 (+804360us) raft_consensus.cc:1685] finished
0709 13:09:56.549944 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.550132 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4109,"raft.queue_time_us":65190,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":50156,"spinlock_wait_cycles":6460160,"thread_start_us":362847,"threads_started":1,"wal-append.queue_time_us":1150283}
I20260709 13:09:56.550849 22928 rpcz_store.cc:276] 0709 13:09:54.698333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.698476 (+   143us) service_pool.cc:224] Handling call
0709 13:09:54.724441 (+ 25965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.729856 (+  5415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.729898 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.741827 (+ 11929us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.997390 (+255563us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:54.997727 (+   337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.997816 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.528796 (+1530980us) raft_consensus.cc:1685] finished
0709 13:09:56.528817 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.528974 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13075,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4400,"thread_start_us":132585,"threads_started":1,"wal-append.queue_time_us":566061}
I20260709 13:09:56.550444 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:55.882302 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2077) took 1729 ms. Trace:
W20260709 13:09:56.552845 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 413764us
W20260709 13:09:55.830629 25879 consensus_meta.cc:287] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 1.092s	user 0.005s	sys 0.005s
I20260709 13:09:56.554325 25978 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.564086 26192 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.567214 22814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 817246us
I20260709 13:09:55.805442 23080 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:09:56.568989 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.850880 23079 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:55.744946 25994 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:55.723541 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:56.571587 23000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2080) took 1942 ms. Trace:
W20260709 13:09:55.895380 26137 log.cc:927] Time spent T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.928s	user 0.007s	sys 0.042s
I20260709 13:09:56.135284 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:56.308766 26179 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.567s	user 0.013s	sys 0.000s
I20260709 13:09:55.720749 26025 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:55.891460 26007 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:56.659349 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 92809.1us
I20260709 13:09:56.543455 26099 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:55.640388 25841 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:56.618316 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 1.0007e+06us
W20260709 13:09:55.829519 26175 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.088s	user 0.006s	sys 0.003s
I20260709 13:09:55.717985 22927 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:55.814262 25974 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.599151 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2157) took 1014 ms. Trace:
I20260709 13:09:56.546458 26191 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:56.620446 23045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.013s	sys 0.024s
I20260709 13:09:56.620496 22930 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:09:55.714210 25953 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:55.792989 26177 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:56.584141 26079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.022s	sys 0.017s
I20260709 13:09:56.624161 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:09:56.587307 26100 consensus_meta.cc:287] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.923s	user 0.006s	sys 0.005s
I20260709 13:09:56.027879 25979 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:56.135831 26152 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:56.624889 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:56.628473 22924 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:09:56.585597 26024 consensus_meta.cc:287] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.968s	user 0.004s	sys 0.008s
I20260709 13:09:55.737260 26181 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.185185 26092 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.635289 26035 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:56.628118 25962 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:09:55.813035 26155 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:55.892148 26161 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.585904 26189 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.645817 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.647603 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 698) took 2000 ms. Trace:
W20260709 13:09:56.731292 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.650952 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2159) took 1058 ms. Trace:
I20260709 13:09:56.650949 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:56.654065 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.654482 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:56.732807 23077 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:09:56.732985 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 78587us
I20260709 13:09:56.648620 23000 rpcz_store.cc:276] 0709 13:09:54.629108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.630214 (+  1106us) service_pool.cc:224] Handling call
0709 13:09:54.630573 (+   359us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:54.630970 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.631003 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:54.631637 (+   634us) log.cc:844] Serialized 78 byte log entry
0709 13:09:54.881855 (+250218us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:54.881961 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.882106 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.586897 (+704791us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4800212358. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3929f33aa1 00007f3929f2ab37 00007f3929f2a9ca 00007f392a02226f 00007f392a021f37 00007f392a03655c 00007f392a036508 00007f392a036488 00007f392a036443 00007f392a0356ec 00007f3928f5fa96
0709 13:09:55.828573 (+241676us) raft_consensus.cc:1685] finished
0709 13:09:55.828602 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.571519 (+742917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17674,"raft.queue_time_us":1653,"raft.run_cpu_time_us":22368,"raft.run_wall_time_us":961159,"spinlock_wait_cycles":38506368,"thread_start_us":151399,"threads_started":1,"wal-append.queue_time_us":438485}
I20260709 13:09:56.617339 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:56.733664 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 939) took 3299 ms. Trace:
I20260709 13:09:55.711493 25931 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.734041 23074 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:56.736389 22926 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:56.736590 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2171) took 1089 ms. Trace:
I20260709 13:09:56.693948 26147 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:56.623265 25861 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:09:56.645814 26188 log.cc:927] Time spent T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:09:56.674124 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:56.734030 23650 rpcz_store.cc:276] 0709 13:09:53.428912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.202551 (+773639us) service_pool.cc:224] Handling call
0709 13:09:54.240402 (+ 37851us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:54.337382 (+ 96980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.337417 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:54.419038 (+ 81621us) log.cc:844] Serialized 52 byte log entry
0709 13:09:54.854034 (+434996us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.123585 (+269551us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.150343 (+ 26758us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.150610 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.150711 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.559880 (+409169us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b18001eae40. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:09:56.026567 (+466687us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:56.728084 (+701517us) raft_consensus.cc:1685] finished
0709 13:09:56.728108 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.728230 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4632,"prepare.queue_time_us":194406,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":23530,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":63440,"spinlock_wait_cycles":60587136,"thread_start_us":703479,"threads_started":2,"wal-append.queue_time_us":460862}
I20260709 13:09:56.673240 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:56.629142 23004 rpcz_store.cc:276] 0709 13:09:54.152963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.168776 (+ 15813us) service_pool.cc:224] Handling call
0709 13:09:54.169113 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.169541 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.169574 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.170139 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.518766 (+348627us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:54.518801 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.518864 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.878232 (+1359368us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b24001095c8. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921da39c4 00007f3921da1acb 00007f3921f5cdc9 00007f3921f5ca55 00007f3921f5bfb0 00007f3924bd2488 00007f3924bd2be8 00007f3924baa398 00007f3924ba576a 00007f3924ba4bb6
0709 13:09:55.881951 (+  3719us) raft_consensus.cc:1685] finished
0709 13:09:55.881978 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.882228 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1234,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":25809664,"thread_start_us":348168,"threads_started":1,"wal-append.queue_time_us":796829}
I20260709 13:09:56.682089 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:55.963299 26014 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:56.725386 26100 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.651904 26190 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:56.745720 23075 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:56.625674 26059 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:56.741699 26183 log.cc:927] Time spent T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
I20260709 13:09:56.685884 23071 rpcz_store.cc:276] 0709 13:09:55.584851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.585004 (+   153us) service_pool.cc:224] Handling call
0709 13:09:55.893847 (+308843us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:09:55.894035 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.583869 (+689834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.599063 (+ 15194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13149440}
I20260709 13:09:56.722208 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:56.648761 25981 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:56.724690 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:56.761471 23078 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:56.660262 25879 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:56.659858 26007 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:56.681496 26156 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.636956 25969 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.732514 23080 rpcz_store.cc:276] 0709 13:09:55.587100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.587235 (+   135us) service_pool.cc:224] Handling call
0709 13:09:56.645645 (+1058410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.686944 26186 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:56.730626 23045 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.941s (SENT) [suppressed 29 similar messages]
I20260709 13:09:56.660857 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:56.737030 23074 rpcz_store.cc:276] 0709 13:09:55.646943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.647198 (+   255us) service_pool.cc:224] Handling call
0709 13:09:56.736547 (+1089349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.660612 26192 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.723358 25979 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:56.690026 26195 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.746488 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:56.747316 23079 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:56.800776 23000 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.723837 26191 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:56.731233 23001 rpcz_store.cc:276] 0709 13:09:54.647343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.647623 (+   280us) service_pool.cc:224] Handling call
0709 13:09:54.656751 (+  9128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.890324 (+233573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.890361 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.925695 (+ 35334us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.295878 (+370183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.295920 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.295992 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.959180 (+663188us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b2400109778. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921da39c4 00007f3921da1acb 00007f3921f5cdc9 00007f3921f5ca55 00007f3921f5c09d 00007f3924b8e10e 00007f3924ba588c 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221
0709 13:09:56.636276 (+677096us) raft_consensus.cc:1685] finished
0709 13:09:56.636297 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.647531 (+ 11234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62898,"raft.queue_time_us":489325,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7095,"spinlock_wait_cycles":127228672,"thread_start_us":485087,"threads_started":2,"wal-append.queue_time_us":695520}
I20260709 13:09:56.728439 26152 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:56.740595 22896 connection.cc:256] RPC call timeout handler was delayed by -1.3029774750001479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23090000000000002s for a response
W20260709 13:09:56.804685 22896 connection.cc:256] RPC call timeout handler was delayed by -1.2943690070001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:09:56.758692 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:56.806169 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 1.12229e+06us
W20260709 13:09:56.806865 22971 leader_election.cc:336] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.305s (SENT)
I20260709 13:09:56.807224 22971 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:56.807785 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 150783us
I20260709 13:09:56.808621 26161 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:56.693611 25974 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.809788 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:56.810495 26205 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:56.811486 25974 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.765101 25981 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:56.812603 22971 leader_election.cc:336] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.564s (SENT)
I20260709 13:09:56.813005 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:56.813441 25981 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.767946 23046 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:56.814222 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 46364.8us
I20260709 13:09:56.769063 25849 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.742655 26035 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.772640 26099 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.815821 26099 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.772516 25861 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:56.773681 25978 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.773900 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:56.814790 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:56.775501 25931 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.774911 25879 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.775879 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1831) took 2548 ms. Trace:
I20260709 13:09:56.742486 26164 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:09:56.705056 25953 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.648607 25996 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.783883 23005 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:56.793905 22927 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:56.836141 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 1840) took 1193 ms. Trace:
I20260709 13:09:56.797421 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:56.733523 26092 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.752736 26190 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.803705 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:56.817124 23071 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.815220 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:56.821185 23073 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:09:56.825085 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.839764 22926 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.816702 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.783557 26024 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.726034 26181 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.858767 23071 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:56.776695 26119 ts_tablet_manager.cc:1929] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
W20260709 13:09:56.830365 22896 connection.cc:256] RPC call timeout handler was delayed by -1.1035690070000328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 13:09:56.745530 26147 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:56.742774 26189 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:56.829453 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 46326.6us
I20260709 13:09:56.859469 26119 log.cc:1199] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/wals/590119d9a7e74f099c0a28550f4fb3f5
I20260709 13:09:56.837091 23075 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.861241 23076 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.838629 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:56.840673 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:56.826977 26186 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.829110 22929 rpcz_store.cc:276] 0709 13:09:54.212708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.212854 (+   146us) service_pool.cc:224] Handling call
0709 13:09:54.213141 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.213528 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.213561 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.214067 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.554673 (+340606us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:54.554929 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.555028 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.894569 (+1339541us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:56.753778 (+859209us) raft_consensus.cc:1685] finished
0709 13:09:56.753807 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.760763 (+  6956us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":39505152,"thread_start_us":340195,"threads_started":1,"wal-append.queue_time_us":658018}
I20260709 13:09:56.846242 26207 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.846773 25953 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.834553 25981 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.802829 26156 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.832557 26177 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.834470 26153 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.851276 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.852808 26035 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.853019 26191 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:56.853400 26024 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.913612 26156 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.913789 26024 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.891157 26207 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.915620 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:56.916281 26207 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:56.854383 26152 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:56.854409 26164 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:56.855971 25599 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:56.881740 25974 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:56.856746 23073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:09:56.856920 26190 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:56.858897 26181 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:56.859416 25996 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.861382 22928 raft_consensus.cc:2393] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:56.835487 22997 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:09:56.926206 23073 raft_consensus.cc:606] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:56.836500 22927 rpcz_store.cc:276] 0709 13:09:55.642733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.661107 (+ 18374us) service_pool.cc:224] Handling call
0709 13:09:56.836084 (+1174977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.843047 23000 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:56.828544 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.862632 23046 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:56.831808 25849 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:56.932817 25849 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:56.932958 26198 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:09:56.933214 25849 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.934391 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1841) took 1223 ms. Trace:
I20260709 13:09:56.866053 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:56.934753 22923 rpcz_store.cc:276] 0709 13:09:55.710572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.710731 (+   159us) service_pool.cc:224] Handling call
0709 13:09:55.711067 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:56.568891 (+857824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.568920 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:56.586454 (+ 17534us) log.cc:844] Serialized 52 byte log entry
0709 13:09:56.693799 (+107345us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:56.693836 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.693914 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.934154 (+240240us) raft_consensus.cc:1685] finished
0709 13:09:56.934175 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.934332 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26966,"raft.queue_time_us":867101,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":39142,"thread_start_us":57705,"threads_started":1,"wal-append.queue_time_us":138158}
W20260709 13:09:56.936195 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 70435.3us
I20260709 13:09:56.936430 25969 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:56.936992 25969 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:56.891185 26186 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.938126 25969 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:56.890184 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 217628us
W20260709 13:09:56.939136 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 76579.6us
I20260709 13:09:56.941630 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:56.943257 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.945950 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.898052 22926 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:09:56.940512 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.947932 22928 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:56.892139 26153 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.867079 26161 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:09:56.862706 25978 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:56.864311 26205 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.920966 23078 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:56.856109 23003 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:56.924088 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 111483us
I20260709 13:09:56.887595 25981 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.882233 26100 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:56.884964 26202 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.033528 26202 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:56.926982 22922 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:56.923092 25599 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:56.927690 26207 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:56.928402 26181 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.930133 25996 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:56.931942 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 71213.3us
I20260709 13:09:56.932287 26119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34256 (request call id 93) took 3130 ms. Trace:
I20260709 13:09:56.938275 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:56.889739 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 163337us
I20260709 13:09:56.900755 22924 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:56.954748 23076 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:56.978205 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:56.980089 23046 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:57.060276 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 80296us
I20260709 13:09:56.981724 26099 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:56.983826 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1813) took 1373 ms. Trace:
I20260709 13:09:56.926034 25974 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:56.951577 26153 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.941277 26152 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:56.988404 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.077612 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:57.078107 23000 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
W20260709 13:09:56.987743 23005 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2079) took 2357 ms (client timeout 1842 ms). Trace:
I20260709 13:09:56.986285 26192 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.020597 25879 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.020519 26186 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.021059 26059 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.024441 26092 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:56.891603 25979 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.079303 26202 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.091359 25979 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.925573 26007 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.091892 26214 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:57.092778 26204 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:09:56.955899 26155 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:57.043944 22971 leader_election.cc:336] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.717s (SENT)
I20260709 13:09:57.053463 22999 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:57.093931 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:57.054339 23075 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:09:57.063768 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 225192us
I20260709 13:09:57.035737 25981 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.066460 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.067607 23002 rpcz_store.cc:276] 0709 13:09:55.610922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.611061 (+   139us) service_pool.cc:224] Handling call
0709 13:09:55.626483 (+ 15422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.796404 (+1169921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.796448 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.796496 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:56.796532 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.983511 (+186979us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000ef6d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:56.983574 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.983754 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":405,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3067,"spinlock_wait_cycles":2689823616}
I20260709 13:09:57.042109 25969 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.076460 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 138266us
I20260709 13:09:57.078161 22998 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:56.977212 25978 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:57.078938 23005 rpcz_store.cc:269] 0709 13:09:54.628780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.629178 (+   398us) service_pool.cc:224] Handling call
0709 13:09:56.985638 (+2356460us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400098654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:56.985734 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4654699776}
I20260709 13:09:57.088757 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.092715 26007 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.977046 26185 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:57.075168 25974 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.071487 25932 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.036262 26212 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:57.112324 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.112818 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.113374 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.075363 26181 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:57.116340 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.117843 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.118548 23002 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:57.119350 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.120635 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:57.121878 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.085239 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 218465us
I20260709 13:09:57.098491 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:57.105907 23003 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:57.105208 23621 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:57.088367 26099 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:09:57.102391 25978 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.173463 23005 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:57.174947 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 899) took 3238 ms. Trace:
W20260709 13:09:57.175678 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 45701.6us
I20260709 13:09:57.106252 26152 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:57.182426 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.116122 26192 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:57.094734 26024 consensus_queue.cc:1175] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 7 } }
I20260709 13:09:57.193653 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:57.182950 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 139127us
I20260709 13:09:57.189777 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.110504 25932 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:57.189980 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.193708 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.196019 23003 raft_consensus.cc:2410] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:57.197118 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.197997 23003 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:57.199177 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.180975 23651 rpcz_store.cc:276] 0709 13:09:53.946356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.260916 (+314560us) service_pool.cc:224] Handling call
0709 13:09:54.323316 (+ 62400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:54.353865 (+ 30549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.353894 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:54.354437 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 13:09:54.926095 (+571658us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.300064 (+373969us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.688792 (+1388728us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.174628 (+485836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.174700 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.174739 (+    39us) raft_consensus.cc:1685] finished
0709 13:09:57.174752 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.174894 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56767,"prepare.queue_time_us":338942,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":367138,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":7142,"thread_start_us":2749523,"threads_started":6,"wal-append.queue_time_us":943479,"wal-append.run_cpu_time_us":2499,"wal-append.run_wall_time_us":1274390}
I20260709 13:09:57.127064 26164 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.126818 25879 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.185360 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:57.119751 26185 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:57.177979 26155 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:57.205502 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.203933 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.177385 25953 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:57.102454 25969 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:57.209283 22971 connection.cc:256] RPC call timeout handler was delayed by -1.2456846540000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.41630000000000006s for a response
I20260709 13:09:57.191022 25989 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:57.218508 23045 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.097s (SENT)
W20260709 13:09:57.221889 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 85908us
I20260709 13:09:57.227254 23078 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
W20260709 13:09:57.229597 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.230181 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.215894 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:57.200126 26186 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:57.236405 22896 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.026s (SENT)
I20260709 13:09:57.097102 25599 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:57.241712 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.206543 25932 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:57.329233 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 110758us
W20260709 13:09:57.290269 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 185126us
W20260709 13:09:57.298228 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.260118 26199 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:57.233970 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:57.056846 26119 rpcz_store.cc:276] 0709 13:09:53.802392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.809907 (+  7515us) service_pool.cc:224] Handling call
0709 13:09:53.950023 (+140116us) ts_tablet_manager.cc:1151] Deleting tablet 590119d9a7e74f099c0a28550f4fb3f5
0709 13:09:54.004588 (+ 54565us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:56.135405 (+2130817us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:56.776483 (+641078us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:56.932205 (+155722us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157194,"tablet-delete.queue_time_us":116708,"thread_start_us":37413,"threads_started":1}
I20260709 13:09:57.230052 26192 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:09:57.343919 26189 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:57.256114 26155 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.317037 26185 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.349306 25969 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.228861 25879 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.261929 26224 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:57.352521 26224 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.352980 26224 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.355319 25849 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:57.355932 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 119555us
I20260709 13:09:57.356657 23003 raft_consensus.cc:2410] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:09:57.357070 22896 leader_election.cc:336] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.233s (SENT)
I20260709 13:09:57.357479 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:57.358186 26202 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:57.359345 22896 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.309s (SENT)
I20260709 13:09:57.359745 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:57.360416 25932 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.362035 25974 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.258277 26201 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:57.363322 26201 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:57.257833 26193 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:57.364125 26193 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.364348 26201 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.258054 26222 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.365881 26222 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.220053 26164 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.368599 26222 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.316584 26147 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.369735 26164 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.246428 26186 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.370565 26186 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.329282 26181 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.260351 26152 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.377000 25599 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.378084 23002 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:57.362424 26153 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:09:57.380105 22997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1818) took 1669 ms (client timeout 1555 ms). Trace:
W20260709 13:09:57.380622 22997 rpcz_store.cc:269] 0709 13:09:55.756652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.585327 (+828675us) service_pool.cc:224] Handling call
0709 13:09:57.378952 (+793625us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540030e654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:57.380002 (+  1050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262427008}
I20260709 13:09:57.382015 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.382913 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:57.311051 26205 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:57.383759 22999 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
W20260709 13:09:57.419284 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.339361 22998 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:57.257676 26208 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.341704 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.013s	sys 0.019s
W20260709 13:09:57.424736 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.013s	sys 0.019s
I20260709 13:09:57.341854 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:57.425045 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 779006us
I20260709 13:09:57.427121 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:57.427927 22923 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.429833 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:09:57.256260 26215 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:57.439384 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.440203 22927 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:09:57.431396 23006 raft_consensus.cc:2410] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:57.428067 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:57.433892 23045 connection.cc:256] RPC call timeout handler was delayed by -1.1790847480000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25670000000000004s for a response
W20260709 13:09:57.318207 26198 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:09:57.435889 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.358237 25879 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.357970 25849 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:57.380956 26153 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.232268 25953 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.452883 22926 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:57.362450 25932 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.426318 26202 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:57.456898 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.433540 26191 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:57.434784 26199 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.461038 26233 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
W20260709 13:09:57.491892 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 275969us
W20260709 13:09:57.466188 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0689058230000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:09:57.490583 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.490649 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 131306us
W20260709 13:09:57.496121 22896 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.777s (SENT)
I20260709 13:09:57.461463 26186 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:57.497170 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.498759 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.495283 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:57.499814 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 71845.3us
I20260709 13:09:57.500766 22895 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:57.501901 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:57.503288 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:57.503410 22895 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:57.503926 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:57.459774 25981 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.502008 22814 catalog_manager.cc:5028] TS b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): tablet 590119d9a7e74f099c0a28550f4fb3f5 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:09:57.384171 26205 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.510076 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:57.510258 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.510667 22927 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.510952 22926 raft_consensus.cc:2393] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:57.509802 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:57.443073 26208 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.499859 26007 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:57.504918 26202 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.543838 26202 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:57.544344 26202 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.493335 26191 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.533324 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.538130 25981 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.543098 26199 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.466030 25978 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.548964 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.554839 26035 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:57.546942 26185 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.556469 26186 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:57.500090 26153 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:09:57.552392 26194 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:57.555456 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:57.575343 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:57.559710 26007 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.545528 25953 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:57.520417 25974 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:57.531994 26201 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.573307 26238 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.573531 26205 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:57.656062 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 75999.8us
I20260709 13:09:57.585817 22922 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:09:57.576879 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:57.590876 22927 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:57.620792 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.538157 26237 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.658694 25953 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:57.658619 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 81813.7us
I20260709 13:09:57.659432 25953 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.659919 25953 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.659937 26237 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:57.660548 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:57.661866 26234 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:57.662321 26234 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:57.662725 26234 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.662777 26237 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:57.664955 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.665928 23071 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:57.666044 26191 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:57.667223 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 163828us
I20260709 13:09:57.571110 26199 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:57.669059 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:57.670595 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:57.670595 22895 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:57.687042 23078 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:57.578775 26035 raft_consensus.cc:697] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:57.693651 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.699193 23077 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:57.696211 23074 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:57.580201 25932 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.698411 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.639973 26238 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.751899 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.754331 23071 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:57.638257 26155 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:57.763779 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2087) took 1023 ms. Trace:
I20260709 13:09:57.764262 23004 rpcz_store.cc:276] 0709 13:09:56.740092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.746993 (+  6901us) service_pool.cc:224] Handling call
0709 13:09:57.379095 (+632102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.379328 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.379363 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.379417 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:57.379470 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.379541 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.763586 (+384045us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540030e650. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:57.763721 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452979968}
I20260709 13:09:57.766461 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.767172 23078 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:57.770547 23080 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:09:57.694664 25974 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:57.805698 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:57.656338 26194 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:09:57.667644 26201 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:57.819236 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.804296 25974 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.762316 26238 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:57.821178 26235 log.cc:927] Time spent T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:09:57.822763 26205 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.576771 26185 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:57.861802 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.820638 26244 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:09:57.900897 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 378805us
I20260709 13:09:57.901718 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:57.859302 26194 consensus_queue.cc:1243] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:57.879079 25974 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:57.945621 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 43978us
I20260709 13:09:57.954000 26247 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:57.954088 26233 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.954604 26035 consensus_queue.cc:237] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.954939 26233 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:57.964313 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 293764us
I20260709 13:09:57.989246 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:58.001091 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.002413 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:58.002787 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.004338 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:58.005028 22928 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:58.006306 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.946424 25979 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:57.989305 26179 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:57.920282 26199 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:58.020376 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:57.992633 26235 log.cc:927] Time spent T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:58.035596 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.032929 22929 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
W20260709 13:09:58.021888 22923 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.003s
I20260709 13:09:58.037776 22923 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:58.033983 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.038609 22926 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:58.033912 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.034888 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.040616 22925 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:58.031834 22922 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 3.
I20260709 13:09:58.043078 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:57.901858 26205 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:57.991786 26021 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:57.997978 26247 raft_consensus.cc:697] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:58.021224 26186 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.054167 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:58.053731 26201 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:58.047024 26242 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 13:09:58.094983 22929 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:58.045066 25996 raft_consensus.cc:2764] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:09:58.067106 22897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.027s	sys 0.034s
I20260709 13:09:58.080348 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.021400 26249 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.058087 26233 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:58.096779 22897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.028s	sys 0.034s
W20260709 13:09:58.105337 26236 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:58.105403 25841 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:58.112720 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.098644 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 146233us
W20260709 13:09:58.113286 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.116566 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.098275 26227 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.100306 25978 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.096786 26021 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:09:58.116015 26202 consensus_meta.cc:287] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.007s
I20260709 13:09:58.123340 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:58.128764 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 424467us
I20260709 13:09:58.131508 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.131634 23622 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:58.132347 22929 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:58.121393 25841 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:58.096438 26186 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.120158 25861 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.139026 23622 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:58.144096 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 74558.6us
I20260709 13:09:58.145676 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.146507 23651 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:58.133384 26233 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.146747 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.149861 22929 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:58.112336 26249 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:58.154938 26250 log.cc:927] Time spent T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:09:58.137370 25979 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:58.136189 26007 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.159806 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.164039 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.164505 23656 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:58.164717 23654 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:58.160444 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.134218 26202 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.128971 26227 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.165573 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.159900 26233 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.235482 22929 raft_consensus.cc:2393] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:58.236395 26253 log.cc:927] Time spent T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:09:58.126206 26199 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.184295 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.199347 22928 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
W20260709 13:09:58.220996 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 82037.2us
I20260709 13:09:58.213990 23649 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:58.185038 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.241068 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 91934.6us
I20260709 13:09:58.237002 26233 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:58.243399 22928 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:09:58.169045 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.231926 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.245385 23656 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:58.245523 23654 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.219311 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.246773 23657 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:58.243810 22928 pending_rounds.cc:85] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 7
I20260709 13:09:58.251077 22928 pending_rounds.cc:107] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:58.251570 22928 raft_consensus.cc:2889] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:58.212448 26156 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.036s	sys 0.028s
I20260709 13:09:58.232648 26270 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:58.183360 26254 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:58.254029 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:58.257388 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:09:58.254313 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.258782 22924 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:58.259071 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.259842 23652 raft_consensus.cc:2393] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:58.258299 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:09:58.254091 26156 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.040s	sys 0.028s
I20260709 13:09:58.141959 26247 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.265977 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.268649 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.269146 23652 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:58.269698 23654 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:58.253345 26274 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:58.262275 26269 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:58.237823 26021 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.244889 25841 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.279765 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.266712 26203 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.281371 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.281445 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.268041 26205 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:58.270074 25932 consensus_meta.cc:287] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.003s
I20260709 13:09:58.178238 25979 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.275277 26270 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:58.286743 26262 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:58.291978 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.293249 26262 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:58.184087 26271 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:58.295670 26270 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.296084 26270 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:58.300118 26224 consensus_meta.cc:287] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.947s	user 0.010s	sys 0.000s
I20260709 13:09:58.300525 26224 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.303004 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:58.303893 23046 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:58.306385 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.306514 26249 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:58.307574 26185 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.307793 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.307896 25978 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:58.308173 26185 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:58.308332 23005 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:58.308491 25978 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:58.308696 26185 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:58.309387 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:58.263811 26272 consensus_queue.cc:1059] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:09:58.309978 22997 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.309473 25978 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.310084 23076 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:58.310420 26272 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:58.310789 26272 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:58.311945 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:58.312079 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.312485 23002 raft_consensus.cc:2376] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5. Re-sending same reply.
I20260709 13:09:58.312811 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.313107 25932 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:58.313589 22931 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:58.303041 26259 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:09:58.314368 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.315068 22931 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:58.317864 23005 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:58.274407 26274 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.320600 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.328686 22997 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:09:58.311540 26272 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.330299 23002 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:09:58.330947 26272 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:58.329897 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.332417 23655 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:09:58.334491 25974 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.335570 23075 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:58.330971 23000 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:58.329841 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.330039 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.336867 26227 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:58.337780 26234 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.674s	user 0.004s	sys 0.008s
I20260709 13:09:58.338279 26234 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.274533 26267 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:58.345279 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.348191 23076 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:58.340601 25953 consensus_meta.cc:287] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.005s
I20260709 13:09:58.360227 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.361507 23001 raft_consensus.cc:2410] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 9 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:58.340277 23077 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:58.363319 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.340269 26274 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:58.369254 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.367938 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 56183.1us
I20260709 13:09:58.347321 26267 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.288280 26277 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 13:09:58.372236 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.373107 25974 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.374625 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.374763 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.375102 25861 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:58.376000 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.409714 23654 raft_consensus.cc:1813] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Handling vote request from an unknown peer b655449a388a41e3a606c6ea794825ad
I20260709 13:09:58.377202 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.388237 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.319379 26263 consensus_queue.cc:1059] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:09:58.410269 23654 raft_consensus.cc:2368] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 5.
I20260709 13:09:58.413378 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:58.413764 26059 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:58.414103 22999 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.414243 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.415096 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:58.414327 26059 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.415793 23000 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:58.415864 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.416627 22998 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:58.416985 26059 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.280808 26269 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.408193 23656 raft_consensus.cc:2376] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 4. Re-sending same reply.
I20260709 13:09:58.417647 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.414644 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:58.418192 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:58.396507 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 112287us
I20260709 13:09:58.418803 23656 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:09:58.419626 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:58.418725 26205 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:58.419723 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.360872 26186 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:58.420493 23656 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.418192 23002 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:09:58.423422 22999 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:09:58.420522 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:58.422349 22970 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:58.390381 26267 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:58.422907 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.430764 23648 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:09:58.428494 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.428494 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.432071 23078 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:58.428768 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.390374 26024 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.433033 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:58.309578 26185 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.437131 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:58.435578 23076 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:58.437992 23078 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:58.437131 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.438910 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:58.439575 23072 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.442278 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.443826 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.444623 23071 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:58.444730 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.445509 23652 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:58.446739 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.365746 25953 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.451756 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.455076 22896 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:09:58.456465 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.459458 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.457031 23648 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:58.429226 26205 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.461483 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.462105 26241 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:58.463014 23071 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:09:58.465365 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.465557 26241 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:58.465988 26241 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:58.466536 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.467101 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.466005 23657 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 2.
I20260709 13:09:58.424104 25861 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.470345 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.470907 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.472223 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.472802 26270 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.473641 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.491430 23653 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:58.478278 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:58.478960 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:09:58.487383 26238 consensus_meta.cc:287] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.587s	user 0.004s	sys 0.000s
I20260709 13:09:58.488979 25953 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.499514 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.500355 23657 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:58.492189 22925 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.463181 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.497988 23648 raft_consensus.cc:2368] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6.
I20260709 13:09:58.498026 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.501811 23652 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:09:58.460697 26025 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.510852 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.511684 23657 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
W20260709 13:09:58.515522 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.445741 26024 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.513865 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.519265 23657 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:58.519630 23004 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:09:58.520443 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.521165 23653 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.463820 26153 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.525655 22927 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:09:58.517886 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49137.7us
I20260709 13:09:58.531577 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:58.532545 23078 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:58.522773 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:58.534535 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.536120 26279 log.cc:927] Time spent T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:09:58.537896 26283 log.cc:927] Time spent T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:58.538575 26255 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:58.539088 26255 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:58.539940 26255 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.541039 26272 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:58.544030 26280 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:09:58.502759 26202 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.549957 25861 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:58.508970 26025 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:58.557428 26025 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.528383 26234 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:58.558822 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 172832us
I20260709 13:09:58.559055 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.531203 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:58.561312 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.562184 23648 raft_consensus.cc:2368] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6.
I20260709 13:09:58.498919 26059 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.569773 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.571136 23001 raft_consensus.cc:2410] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:58.567823 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.571818 23076 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:09:58.568904 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 46225.2us
I20260709 13:09:58.503360 26281 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:58.577979 22970 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:58.517669 26201 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:58.579595 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.580403 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.582527 22927 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:09:58.582091 22970 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:58.585834 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.586598 23657 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:58.589394 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:58.569730 26258 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.570744 25599 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.589041 25861 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:58.621546 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.599359 26270 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:58.620561 22925 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
W20260709 13:09:58.625859 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 58389.3us
I20260709 13:09:58.604089 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.584015 26161 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:58.567008 26153 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.628147 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.579782 26271 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:09:58.622668 22928 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.631870 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.672452 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.631588 23653 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:09:58.523816 26238 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.641099 22927 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:58.634863 25599 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.644611 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.584553 26281 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:58.642326 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1824) took 1516 ms. Trace:
I20260709 13:09:58.687754 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:58.688035 23003 rpcz_store.cc:276] 0709 13:09:57.126286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.198874 (+ 72588us) service_pool.cc:224] Handling call
0709 13:09:58.642100 (+1443226us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002e36d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:58.642250 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358390144}
I20260709 13:09:58.688475 22929 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:58.592417 23046 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:58.689307 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 96950.7us
I20260709 13:09:58.614423 26231 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.658061 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.603686 26156 raft_consensus.cc:3055] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:58.621193 22924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 1861) took 1119 ms. Trace:
I20260709 13:09:58.657321 26207 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:58.622138 26024 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:58.602190 26269 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:58.607256 26241 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.667100 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:58.648756 26161 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.668793 26205 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.641194 26278 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:09:58.811646 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.669771 26025 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.659875 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:58.581465 26186 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:09:58.674304 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.622267 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:58.673130 23657 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:09:58.641287 25861 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:58.827879 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 1.02352e+06us
I20260709 13:09:58.689883 25599 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.703926 25953 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.763268 23651 raft_consensus.cc:2368] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9.
I20260709 13:09:58.687511 26199 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.763481 22896 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.002s (SENT)
I20260709 13:09:58.833905 22896 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:58.634460 26201 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.617942 26267 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.766964 23078 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.767584 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:58.768592 23072 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
W20260709 13:09:58.770743 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 188696us
I20260709 13:09:58.767318 22924 rpcz_store.cc:276] 0709 13:09:57.501982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.502256 (+   274us) service_pool.cc:224] Handling call
0709 13:09:58.621030 (+1118774us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54001c9b54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:58.621142 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687869312}
W20260709 13:09:58.776382 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 148743us
I20260709 13:09:58.837133 22972 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:58.776957 23650 raft_consensus.cc:2376] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 2. Re-sending same reply.
I20260709 13:09:58.777603 23656 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:09:58.807140 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.807140 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.811921 23076 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.825898 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:58.825996 23071 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:58.827527 22930 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.841112 26153 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:58.694785 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:58.768013 26156 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:58.842900 26024 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:58.792641 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:09:58.832468 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 172664us
I20260709 13:09:58.843869 26156 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.845111 26156 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.845227 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:58.845407 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:58.846448 26295 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:58.846755 26203 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.846848 26295 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.847363 26295 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.772630 26277 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.853096 26024 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:58.853705 26024 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:58.854723 26024 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:58.841965 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:58.882182 26203 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.883473 22930 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:58.806905 26161 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.888489 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:58.891022 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 127571us
I20260709 13:09:58.892961 23079 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:09:58.892380 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45215.2us
I20260709 13:09:58.853744 26277 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.898757 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:58.898860 23045 leader_election.cc:336] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.818s (SENT)
I20260709 13:09:58.901014 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:58.883781 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 89805.9us
I20260709 13:09:58.909365 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:58.932265 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.933523 22930 raft_consensus.cc:2410] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:58.934227 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.935722 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.936643 22924 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:58.969741 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:58.830526 25861 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.978212 23655 raft_consensus.cc:2368] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 4.
I20260709 13:09:58.972258 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.973261 23002 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:58.974237 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 76739.1us
I20260709 13:09:58.937525 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:58.776577 26207 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.834934 25953 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.982275 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:09:58.981881 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 80939.9us
W20260709 13:09:58.985745 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 94799.5us
I20260709 13:09:58.986829 26014 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.989791 26152 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:58.990283 26152 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:58.992125 23003 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:58.994197 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:58.996132 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.000489 22927 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:58.994980 23074 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:58.885296 26153 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.894748 26214 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.038250 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:09:59.039594 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.040118 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:58.990782 26152 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.050073 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.050865 23079 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:58.773535 26231 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.052976 23648 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:59.061008 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:59.061560 22999 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.828958 26205 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:59.001770 26263 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.995187 25953 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.892292 26199 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:58.999972 26035 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:59.076393 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:59.077951 23653 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:09:59.071046 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.079248 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.028728 26271 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:09:59.050282 26274 consensus_meta.cc:287] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 13:09:59.082387 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:59.064059 26153 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:59.054378 26247 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:59.076860 26208 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.097936 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:59.055352 25978 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:09:59.095870 26238 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:59.106365 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 197073us
I20260709 13:09:59.114576 23653 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.114565 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:59.123955 22971 leader_election.cc:400] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6.
I20260709 13:09:59.124279 22971 leader_election.cc:403] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.087373 26271 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.096643 26153 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:59.127501 23682 heartbeater.cc:646] Failed to heartbeat to 127.21.67.254:36129 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.21.67.254:36129 timed out after 15.000s (SENT)
I20260709 13:09:59.128408 26153 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.133302 26300 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:59.133754 26300 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:09:59.134200 26300 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.094602 25979 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:09:59.136188 26207 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:09:59.106101 26261 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.116s	user 0.010s	sys 0.000s
I20260709 13:09:59.099315 26156 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.144049 23653 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:59.099815 26208 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.082002 26035 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.149592 22999 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:09:59.128428 26271 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.151105 26216 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.168360 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.169142 23074 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.173027 22970 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.157544 26241 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.159430 26025 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.182452 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.161777 26267 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.187244 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:59.187158 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.187879 23648 raft_consensus.cc:2376] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6. Re-sending same reply.
I20260709 13:09:59.188360 23071 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
W20260709 13:09:59.186830 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 63717us
I20260709 13:09:59.154810 26208 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.130530 26295 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.089493 26274 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.182024 26305 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.195875 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:09:59.205020 23648 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:09:59.190119 26201 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.193523 22971 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.019459 26281 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.183732 26232 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:09:59.202477 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:59.211977 23655 raft_consensus.cc:2376] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10. Re-sending same reply.
I20260709 13:09:59.206517 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:59.202987 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 907) took 1024 ms. Trace:
I20260709 13:09:59.214506 23649 rpcz_store.cc:276] 0709 13:09:58.178863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.182983 (+  4120us) service_pool.cc:224] Handling call
0709 13:09:58.183365 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.242608 (+ 59243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.202764 (+960156us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b54000a4bd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:09:59.202926 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69425920}
W20260709 13:09:59.198276 26297 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:09:59.197960 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:59.193748 26306 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:59.219054 26306 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.197580 26309 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.219753 26199 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.220293 22972 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.221062 26274 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.202765 26301 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:59.222713 26295 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:09:59.222822 26299 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:09:59.223369 26295 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.224334 23648 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:59.205042 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:09:59.219483 26304 log.cc:927] Time spent T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:09:59.254647 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 49714.8us
W20260709 13:09:59.198406 26292 log.cc:927] Time spent T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:09:59.255398 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.258445 23000 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:59.259783 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.264029 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.267752 26193 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.206177 26305 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:59.253042 26303 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:09:59.201479 26277 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:59.219506 26201 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.209996 25599 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.210122 25953 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.261837 26206 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.257182 26316 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.219524 26306 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:59.282140 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 283721us
W20260709 13:09:59.277469 26294 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 13:09:59.285597 23075 raft_consensus.cc:2368] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9.
I20260709 13:09:59.277469 26241 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:59.285786 26201 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.308813 25953 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.296753 26231 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.295960 26241 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.310555 26241 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.312510 25599 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:59.315155 26284 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.857s	user 0.000s	sys 0.002s
I20260709 13:09:59.300935 26035 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.321275 26311 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:59.323249 26224 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:09:59.324347 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:59.325306 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:09:59.337411 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 143983us
I20260709 13:09:59.338606 23074 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:59.340823 23080 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:59.344260 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:09:59.333065 26260 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 1.215s	user 0.000s	sys 0.005s
I20260709 13:09:59.346364 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:59.347309 23072 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:59.348337 22922 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.349291 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:59.336094 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 80776.1us
I20260709 13:09:59.350427 22970 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.354101 26059 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:59.354465 26059 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:59.354801 26059 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.355597 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.284211 26206 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.336222 26309 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6.
I20260709 13:09:59.361120 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.298393 26234 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:09:59.363023 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.373358 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.373936 22927 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:09:59.374274 23074 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.364465 23076 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:09:59.365381 22922 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:09:59.378175 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.378734 23072 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:09:59.349061 25841 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:59.385306 22930 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:09:59.389075 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 347186us
I20260709 13:09:59.364357 26301 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:59.357544 26324 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:59.392537 23000 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:59.396102 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:59.373334 26208 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.400694 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.407457 23074 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:09:59.451884 22999 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:09:59.440927 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.476907 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 739) took 1459 ms. Trace:
I20260709 13:09:59.477907 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:59.491991 22924 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.457388 25841 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:59.456568 26312 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:09:59.481110 26241 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.481110 26152 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.415815 26301 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:09:59.487646 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.491438 22928 rpcz_store.cc:276] 0709 13:09:58.017109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.260699 (+243590us) service_pool.cc:224] Handling call
0709 13:09:58.622441 (+361742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.671336 (+ 48895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.476711 (+805375us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54001c9b50. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:59.476841 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831272704}
W20260709 13:09:59.496721 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 171480us
I20260709 13:09:59.501169 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.471189 25861 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.498339 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:59.502600 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 163501us
I20260709 13:09:59.511174 22997 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:59.489470 26161 consensus_meta.cc:287] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.005s
I20260709 13:09:59.504946 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:59.505081 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:59.487812 26305 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.512900 22928 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.503407 26295 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.515996 23045 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:59.508574 22998 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:59.523053 22928 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:09:59.523834 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.524907 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.507892 26322 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:59.527352 26322 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.527626 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:59.511204 25996 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:09:59.528811 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:59.529672 26189 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.530314 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.530808 26189 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.531795 26234 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.532502 26234 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:59.532831 26234 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.533167 26234 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.533802 26306 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.535347 26320 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:59.535930 26320 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.537998 26320 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.527750 26322 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.540385 26234 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.542218 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.509771 26201 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.511021 26267 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:59.543000 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:59.556075 26234 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.557920 25841 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.516223 23648 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:09:59.560091 26322 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:09:59.569759 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.570336 23080 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.573724 22924 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:09:59.514464 26277 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:59.563869 26301 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.585685 26322 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.586977 26152 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.587145 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.587692 23077 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.591367 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.581449 26267 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:09:59.581957 26334 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:59.586395 23650 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.516500 26161 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.596671 23077 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:59.535929 26306 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.605229 26206 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.567461 26201 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.607728 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.634130 23002 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:09:59.575982 26320 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.518088 26059 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.639626 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.599462 26300 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.611642 26267 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.599694 26334 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.612970 26241 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.580546 25931 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.614063 23045 leader_election.cc:400] T 590119d9a7e74f099c0a28550f4fb3f5 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 3. Current term is 5.
I20260709 13:09:59.613943 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.618578 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1830) took 1206 ms. Trace:
I20260709 13:09:59.620445 23078 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.621940 23074 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:59.662540 23077 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.632411 23080 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:09:59.636960 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.662559 23001 rpcz_store.cc:276] 0709 13:09:58.412515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.412728 (+   213us) service_pool.cc:224] Handling call
0709 13:09:59.618394 (+1205666us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003534d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:59.618523 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293754624}
I20260709 13:09:59.641637 22895 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.654220 23073 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:59.657322 26206 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:59.666002 25841 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.667783 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.678514 23077 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:59.680948 23077 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:59.689693 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:09:59.691936 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.693562 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 79605.7us
I20260709 13:09:59.695214 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:59.696326 26327 log.cc:927] Time spent T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:09:59.696867 26059 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.698469 26300 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.647831 26320 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.700325 26320 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.701234 22924 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:59.668704 26334 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.701862 26189 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:59.706135 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 754) took 1098 ms. Trace:
I20260709 13:09:59.706645 23649 rpcz_store.cc:276] 0709 13:09:58.607402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.215915 (+608513us) service_pool.cc:224] Handling call
0709 13:09:59.216361 (+   446us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:59.216902 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:59.256778 (+ 39876us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.386479 (+129701us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:59.405223 (+ 18744us) log.cc:844] Serialized 78 byte log entry
0709 13:09:59.405437 (+   214us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:59.406803 (+  1366us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.415133 (+  8330us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.426864 (+ 11731us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.429518 (+  2654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.429617 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.705874 (+276257us) raft_consensus.cc:1685] finished
0709 13:09:59.705902 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.706066 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7844,"prepare.queue_time_us":71328,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":127,"raft.queue_time_us":12986,"raft.run_cpu_time_us":487,"raft.run_wall_time_us":39214,"spinlock_wait_cycles":3989632,"thread_start_us":108427,"threads_started":1,"wal-append.queue_time_us":239722}
I20260709 13:09:59.712559 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.716925 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.719832 23002 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:09:59.666731 26281 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:59.716869 26325 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:09:59.726974 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.727360 26325 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:59.727759 26325 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:09:59.722708 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.728716 26325 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:09:59.729971 26325 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.730827 26205 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.717880 25841 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.732036 23002 raft_consensus.cc:1217] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-8.8]   Dedup: 3.6->[6.7-8.8]
I20260709 13:09:59.732877 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:09:59.733273 23655 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:59.733680 23001 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:59.732493 23002 pending_rounds.cc:85] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 6
I20260709 13:09:59.735059 23002 pending_rounds.cc:107] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:59.735284 23002 raft_consensus.cc:2889] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:59.732887 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 749) took 1126 ms. Trace:
I20260709 13:09:59.709998 26216 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.735739 23653 rpcz_store.cc:276] 0709 13:09:58.606147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.086183 (+480036us) service_pool.cc:224] Handling call
0709 13:09:59.732725 (+646542us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b540046e6d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:09:59.732837 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35061504}
I20260709 13:09:59.696357 26201 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:09:59.737717 26330 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:09:59.735723 26190 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:59.739068 26190 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:09:59.739975 26190 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.740274 26216 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.742883 26216 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.721400 26021 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:59.750526 26334 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.752136 26277 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.753938 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 760) took 1061 ms. Trace:
I20260709 13:09:59.753096 26277 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.757748 22923 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:59.716504 26255 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:09:59.754304 23648 rpcz_store.cc:276] 0709 13:09:58.692446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.225319 (+532873us) service_pool.cc:224] Handling call
0709 13:09:59.226080 (+   761us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:59.227240 (+  1160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.227288 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:59.273574 (+ 46286us) log.cc:844] Serialized 590 byte log entry
0709 13:09:59.516101 (+242527us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:59.626547 (+110446us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.660090 (+ 33543us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.660294 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.660367 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.753724 (+ 93357us) raft_consensus.cc:1685] finished
0709 13:09:59.753742 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.753875 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27906,"prepare.queue_time_us":4722,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":38258,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":19145,"thread_start_us":228599,"threads_started":1,"wal-append.queue_time_us":353627}
I20260709 13:09:59.761763 23076 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.759153 23620 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.756135 25932 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.779349 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.779075 25932 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:09:59.785792 25932 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.791581 23001 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:59.795303 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.795586 25932 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:09:59.796583 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.797390 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.797708 25932 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.797994 22922 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:09:59.799060 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:59.799614 22928 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.378563 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:59.784202 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.806599 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.808202 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.811030 22928 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:09:59.811210 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:59.811293 22825 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 258) took 15724 ms (client timeout 15000 ms). Trace:
I20260709 13:09:59.818797 23620 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:59.822135 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:59.825291 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:59.782475 26181 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:59.828936 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:59.835239 22925 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.781073 26193 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.836360 23620 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.779363 26320 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:09:59.868153 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:59.877804 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:09:59.879894 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0200667810000823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:09:59.861142 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:09:59.891590 22999 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:09:59.884594 22924 raft_consensus.cc:2410] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:09:59.892793 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:59.859540 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.893775 26059 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:09:59.937680 26059 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:09:59.938437 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 79008.4us
I20260709 13:09:59.939023 26161 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.939790 26193 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.940709 26193 consensus_queue.cc:1059] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:59.895064 22999 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:59.942417 26277 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:09:59.856252 23046 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:59.857264 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:59.952555 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.960299 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.961124 23078 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:09:59.961467 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:09:59.962402 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 69694us
W20260709 13:09:59.963475 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 107333us
I20260709 13:09:59.964550 23046 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:09:59.968705 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:09:59.968034 23620 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:09:59.971565 22925 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:09:59.970517 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.933665 25861 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:09:59.973546 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:09:59.886749 26214 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.974140 23073 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.974768 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:59.962706 26277 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.837026 25932 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:59.985533 22923 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:59.859172 26224 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:59.934767 26014 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:59.961639 25978 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:09:59.975342 26331 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.978844 26274 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.980643 25974 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.975342 26099 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:59.975467 26189 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.975571 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:09:59.976672 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:09:59.984189 23073 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:09:59.984635 22972 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:09:59.988520 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:09:59.973987 26278 raft_consensus.cc:3055] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:59.880784 26232 consensus_queue.cc:1059] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:09:59.977634 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:00.015427 23078 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.837517 26266 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:09:59.988931 23620 leader_election.cc:400] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9.
I20260709 13:10:00.017879 23620 leader_election.cc:403] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.005290 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:09:59.835180 26201 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:09:59.978444 26324 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:00.018627 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:09:59.891296 26270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.045s	user 0.051s	sys 0.097s
I20260709 13:10:00.020459 23045 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:09:59.987636 26014 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:00.024124 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:59.988476 26224 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.834817 26249 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 13:10:00.027328 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.035287 23045 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.032207 26267 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.036830 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.038568 23651 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:00.036964 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.036844 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.039446 23650 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.041005 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:09:59.976538 26181 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:00.013567 26099 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.051479 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.045854 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.047897 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.006486 26278 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:09:59.815260 22825 rpcz_store.cc:269] 0709 13:09:44.085265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.085587 (+   322us) service_pool.cc:224] Handling call
0709 13:09:44.093847 (+  8260us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5400002490. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee60b2 00007f392ae5fa89 00007f392adf7da6 00007f392adc9088 00007f392aec737e 00007f39293882a4 00007f3929388232 00007f3929388161 00007f39293880dc
0709 13:09:59.795646 (+15701799us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:55.090916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:55.091794 (+   878us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:55.091854 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:09:55.091880 (+    26us) tablet.cc:662] Decoding operations
0709 13:09:55.093009 (+  1129us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:55.093085 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:55.093114 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:55.093906 (+   792us) tablet.cc:701] Row locks acquired
0709 13:09:55.093949 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:09:55.094111 (+   162us) write_op.cc:270] Start()
0709 13:09:55.094250 (+   139us) write_op.cc:276] Timestamp: P: 1783602595094051 usec, L: 0
0709 13:09:55.094269 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:09:55.164048 (+ 69779us) log.cc:844] Serialized 3273 byte log entry
0709 13:09:56.136502 (+972454us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:09:57.091534 (+955032us) op_driver.cc:464] REPLICATION: finished
0709 13:09:57.463300 (+371766us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3921f000ac 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3928a40ef0
0709 13:09:57.685892 (+222592us) write_op.cc:301] APPLY: starting
0709 13:09:57.686011 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:57.701332 (+ 15321us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:57.701379 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:57.822330 (+120951us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:57.822728 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:09:57.822795 (+    67us) write_op.cc:312] APPLY: finished
0709 13:09:57.823207 (+   412us) log.cc:844] Serialized 65 byte log entry
0709 13:09:57.823422 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:57.823562 (+   140us) write_op.cc:454] Released schema lock
0709 13:09:57.823641 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:57.953880 (+130239us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:57.953914 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3246350,"reported_tablets":17,"spinlock_wait_cycles":8578432,"child_traces":[["op",{"apply.queue_time_us":563912,"apply.run_cpu_time_us":4112,"apply.run_wall_time_us":252034,"num_ops":8,"prepare.queue_time_us":686894,"prepare.run_cpu_time_us":24343,"prepare.run_wall_time_us":490343,"raft.queue_time_us":311475,"raft.run_cpu_time_us":20859,"raft.run_wall_time_us":429620,"replication_time_us":1997067,"spinlock_wait_cycles":37704960,"thread_start_us":1276484,"threads_started":4,"wal-append.queue_time_us":494526,"wal-append.run_cpu_time_us":34040,"wal-append.run_wall_time_us":3348085}]]}
I20260709 13:10:00.049467 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.061785 23657 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:10:00.029938 26270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.051s	sys 0.098s
I20260709 13:10:00.050704 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.069612 23654 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.050763 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.032449 25861 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.076823 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.063797 22971 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.077410 23656 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.022218 26059 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:00.032954 26305 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:00.058907 26255 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.038344 26224 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.022557 26241 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.068758 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.092962 23651 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.077495 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.078253 22971 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:00.079047 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.094097 23649 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:00.038439 25974 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:00.036626 26322 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:10:00.037947 26334 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:00.038113 26324 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:00.082155 23078 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:00.079790 26161 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.091966 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.094064 23648 raft_consensus.cc:2376] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10. Re-sending same reply.
I20260709 13:10:00.038763 26189 raft_consensus.cc:2764] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:00.015192 25978 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.064690 26099 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.080741 26305 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.112653 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.117735 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.125270 23648 raft_consensus.cc:2376] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6. Re-sending same reply.
I20260709 13:10:00.084183 25861 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.108726 26331 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.098837 26190 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.112972 26205 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:00.113013 26241 raft_consensus.cc:697] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.134850 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.136812 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.137462 23651 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:00.129628 26305 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.140781 23654 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:10:00.099335 26255 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:00.140020 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 161094us
I20260709 13:10:00.084730 26014 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.151561 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.141629 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.139144 23656 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:00.133625 26205 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.154245 23651 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:10:00.155314 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.157315 23656 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:00.157459 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.158921 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:00.168501 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 122957us
I20260709 13:10:00.143625 26206 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.170939 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:00.167049 26334 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:10:00.171527 23073 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.169433 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.170478 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:00.173491 23076 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.173971 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.152685 25932 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:00.161540 26205 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.187121 23073 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:10:00.193511 26270 raft_consensus.cc:3055] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:00.193549 26205 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.194247 26270 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.175153 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.175227 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.176113 23656 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:00.178399 26340 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:10:00.178623 26343 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:10:00.179268 26341 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:00.183980 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:00.204623 23073 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:00.184804 26255 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:00.197647 23651 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
W20260709 13:10:00.222273 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 144122us
I20260709 13:10:00.224138 23651 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:00.198144 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.225508 23654 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:00.200438 23006 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:00.227479 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2099) took 1918 ms. Trace:
I20260709 13:10:00.227927 23006 rpcz_store.cc:276] 0709 13:09:58.308830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.311766 (+  2936us) service_pool.cc:224] Handling call
0709 13:10:00.200049 (+1888283us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:10:00.200219 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.227194 (+ 26975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.227417 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9930368}
I20260709 13:10:00.208822 26190 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.209410 25953 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:00.212546 22926 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:00.138397 26278 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.215313 25978 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:00.216562 26339 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:10:00.218981 26325 raft_consensus.cc:3055] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:00.220219 26342 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:10:00.234550 23076 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:00.205482 26258 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.239773 22971 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.240218 23651 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:00.254676 23076 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:00.240229 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:00.241866 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 67423.2us
I20260709 13:10:00.164135 26185 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:10:00.239331 25953 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:00.248400 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:00.248448 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:00.260919 23073 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:00.197431 26206 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.257182 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.263070 23651 raft_consensus.cc:2368] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
W20260709 13:10:00.257417 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.257836 23045 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.941s (SENT)
I20260709 13:10:00.258656 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:00.215005 26329 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.670s	user 0.002s	sys 0.000s
I20260709 13:10:00.259611 26258 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.253232 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:00.274077 23649 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:00.274848 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:00.260367 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:00.275588 23071 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:00.264596 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.276710 25953 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.279284 23071 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.280676 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:00.281221 22927 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.195363 26270 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.285117 26258 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:00.255827 26322 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:00.267876 23650 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:00.268581 25932 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.269569 26205 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:00.270644 26206 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:00.271570 26248 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:00.272073 26267 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9.
I20260709 13:10:00.247920 26325 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:00.284802 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:00.345522 26325 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.292263 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:00.297806 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:00.348294 22924 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:00.349881 22924 raft_consensus.cc:1275] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:00.300630 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:00.295646 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.301621 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.352573 23656 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:10:00.352412 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 56860.6us
I20260709 13:10:00.301918 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:00.287448 26270 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.303969 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2294) took 1372 ms. Trace:
I20260709 13:10:00.167794 26324 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.175184 25861 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.347009 26325 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:00.363855 26352 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:10:00.365933 26359 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:00.368204 26352 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:00.368531 26352 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:00.339857 26234 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:00.336541 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 78728.8us
I20260709 13:10:00.283077 26099 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.338670 23072 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:00.340355 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:00.308126 22927 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:00.287185 26224 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.293222 25953 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:00.353761 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 51954.5us
I20260709 13:10:00.353929 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:00.205116 26241 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.380618 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.382047 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.358363 22930 rpcz_store.cc:276] 0709 13:09:58.931329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.979407 (+ 48078us) service_pool.cc:224] Handling call
0709 13:09:58.979765 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.385692 (+405927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.303673 (+917981us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400373a54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:00.303896 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931949312}
I20260709 13:10:00.365702 26205 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:00.338177 26248 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.372817 23650 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.261904 25974 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:10:00.255410 26278 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:00.364461 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 66750.5us
I20260709 13:10:00.361774 26100 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:00.386497 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.385232 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:00.384756 26353 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:00.444643 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 58225.5us
I20260709 13:10:00.436210 22927 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:00.447366 23650 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:00.369455 26206 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:00.440231 23648 raft_consensus.cc:2393] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 5: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:10:00.447688 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 62512us
I20260709 13:10:00.447901 23652 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
W20260709 13:10:00.449441 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.460536 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.461683 23622 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.462657 26201 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:00.462836 26206 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:00.447583 26205 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.463277 26201 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.394721 26359 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:00.394553 25978 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:00.467720 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.477680 23622 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:00.464087 26206 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.391013 26190 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 13:10:00.467685 26302 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 1.336s	user 0.000s	sys 0.005s
I20260709 13:10:00.452082 26216 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.482133 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.448371 26234 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.443861 26007 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:00.394901 26232 consensus_queue.cc:1059] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:10:00.396978 26092 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:10:00.485311 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.476632 26353 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.369273 26352 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.480692 26266 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.396739 26300 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:10:00.498996 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:00.483501 26307 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.347s	user 0.005s	sys 0.000s
I20260709 13:10:00.504396 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:00.480794 26249 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:00.464236 26201 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.495599 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.486249 26269 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:00.511175 22929 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:00.466099 26100 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.492650 26214 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:00.507761 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:00.508747 22927 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:00.509604 26099 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:00.510234 26249 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:00.453125 26355 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:00.514555 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.524942 23622 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.524580 26214 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:00.547425 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:00.547839 26214 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:00.488301 26248 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.552167 26248 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.503259 26359 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:00.517230 26234 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.555861 26359 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:00.556324 26359 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.492014 26205 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.528573 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:00.492682 26216 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.505865 25978 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:10:00.530526 26349 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:10:00.531095 26356 log.cc:927] Time spent T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:10:00.531014 26014 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.536391 26353 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:00.537869 26360 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:10:00.537922 22896 leader_election.cc:336] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.838s (SENT)
I20260709 13:10:00.540571 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:00.542683 23001 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:00.578817 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 79918.4us
I20260709 13:10:00.579192 23004 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:00.579777 23045 leader_election.cc:400] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:00.544679 26249 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.547243 26224 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:00.562335 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47888us
I20260709 13:10:00.522349 26266 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:00.570493 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45640.5us
I20260709 13:10:00.573490 25996 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.543126 22999 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:00.580119 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.580134 23045 leader_election.cc:403] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.567072 26352 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.588078 26100 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.597868 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.616093 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:00.616752 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.616703 22926 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.612984 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.618469 26232 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:00.619831 26351 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:00.620704 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:00.621272 22928 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.618304 22970 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.622918 26205 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:00.623373 26205 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.624117 23076 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.624200 26205 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:00.626812 26161 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:00.598260 26281 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:00.620623 22931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 748) took 1981 ms. Trace:
I20260709 13:10:00.629536 26281 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.616278 26181 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:10:00.629992 22931 rpcz_store.cc:276] 0709 13:09:58.639298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.769942 (+130644us) service_pool.cc:224] Handling call
0709 13:09:58.808149 (+ 38207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.810322 (+  2173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.810364 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.810916 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.088043 (+277127us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:59.097410 (+  9367us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.097626 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.097747 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.337031 (+1239284us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:00.615262 (+278231us) raft_consensus.cc:1685] finished
0709 13:10:00.620392 (+  5130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.620557 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1685,"prepare.queue_time_us":9087,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":4207,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":38323,"spinlock_wait_cycles":48403328,"thread_start_us":193520,"threads_started":1,"wal-append.queue_time_us":302472}
W20260709 13:10:00.637200 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 99315us
W20260709 13:10:00.649472 22896 leader_election.cc:336] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.853s (SENT)
I20260709 13:10:00.632902 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 725) took 1663 ms. Trace:
I20260709 13:10:00.646196 22928 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:00.650556 22997 rpcz_store.cc:276] 0709 13:09:58.969523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.969668 (+   145us) service_pool.cc:224] Handling call
0709 13:09:59.018561 (+ 48893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.511595 (+493034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.632672 (+1121077us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54000bb3d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:00.632828 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132471040}
I20260709 13:10:00.650043 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.651959 23622 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:00.650207 23076 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
W20260709 13:10:00.653400 22896 leader_election.cc:336] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.892s (SENT)
I20260709 13:10:00.654279 22896 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.611961 26224 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.606750 25996 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:00.603986 26372 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:00.614527 25978 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:00.662883 22896 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.631596 26281 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:00.634841 26295 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:00.627576 26161 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.664319 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.660971 26255 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.686342 26325 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.665814 26021 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.664631 26224 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.688797 26021 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.648469 26258 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:00.653666 26358 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.690189 26224 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:00.666312 25841 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:00.666630 26361 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 13:10:00.690776 25841 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:00.670655 26274 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:00.681466 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 63262.9us
I20260709 13:10:00.682632 22926 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:10:00.657873 26232 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:00.686110 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 172875us
W20260709 13:10:00.666750 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.695832 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.686980 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.694857 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:00.699002 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.698993 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.691226 25841 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.704798 22970 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.681034 26269 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.706595 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:00.693087 26274 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.692863 26372 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:00.704202 26305 consensus_meta.cc:287] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.004s
I20260709 13:10:00.702340 26325 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.712260 26035 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:00.711218 26281 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.707851 26320 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:00.711347 26258 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.704644 26232 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.719348 26359 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.720333 26305 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.702901 26153 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:00.714612 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:00.727859 25861 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.692166 26214 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.779596 26274 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.780689 26214 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:00.780858 26274 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.784909 26372 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.785382 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:00.788292 26368 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:00.789605 26153 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.790573 26153 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.795732 26206 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.797963 26206 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:00.798616 26376 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.800683 26269 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.758425 26161 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.826336 23078 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:00.832391 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 752) took 2218 ms. Trace:
I20260709 13:10:00.832975 23655 rpcz_store.cc:276] 0709 13:09:58.606867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.212713 (+605846us) service_pool.cc:224] Handling call
0709 13:09:59.732862 (+520149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.733752 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.825422 (+1091670us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540046e6d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:00.825580 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180570496}
I20260709 13:10:00.840095 26232 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.840952 25996 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:00.842432 25996 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.850147 23622 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:00.851312 26277 raft_consensus.cc:3055] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:00.851847 26277 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.852967 26277 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.772064 26320 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:00.869422 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 164678us
I20260709 13:10:00.870922 22970 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:00.885629 25861 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:00.886262 25861 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:00.887115 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:00.888055 22998 raft_consensus.cc:1275] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:00.887179 25861 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.891837 25953 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.892544 25953 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:00.866199 26059 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:00.866477 26278 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:00.838366 26249 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:00.894338 26277 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.910064 26278 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:00.922329 26305 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:00.929042 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:00.932443 26359 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:00.937788 26376 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.939697 26249 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:00.940384 26384 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:10:00.941427 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:00.923501 26021 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:00.927321 22829 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.998390 26270 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Committing config change with OpId 8.10: config changed from index 8 to 10, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:01.006538 23079 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:01.008114 26376 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:01.003894 22931 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 8 to 10, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:01.013499 26387 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
W20260709 13:10:01.020431 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.029786 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.030400 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.031215 26278 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.035746 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:01.036526 22999 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:01.038853 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:01.040339 23004 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:01.045641 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:01.048444 23656 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:01.049692 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:01.051920 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:01.037716 23621 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.053831 23652 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:01.000244 22829 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 5 to 7, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 7 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:01.054623 23653 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:00.995260 26205 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.060750 23649 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:01.061146 26334 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:01.062094 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2101) took 2496 ms. Trace:
I20260709 13:10:01.068877 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:01.069764 23650 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.068596 23005 rpcz_store.cc:276] 0709 13:09:58.565631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.565775 (+   144us) service_pool.cc:224] Handling call
0709 13:09:58.566084 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.580230 (+ 14146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.580256 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.580674 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.002627 (+421953us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:59.002662 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.002720 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.463165 (+1460445us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:01.044102 (+580937us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5400381920. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f7fdbe 00007f3924f8a930 00007f3924f8a8d8 00007f3924f8a858 00007f3924f8a813 00007f3924f89a9c 00007f392ae75626 00007f392ae6fdd8 00007f3924fc67cb 00007f3924fc92c0
0709 13:10:01.061874 (+ 17772us) raft_consensus.cc:1685] finished
0709 13:10:01.061897 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.062034 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13794,"raft.queue_time_us":15050,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":5548,"spinlock_wait_cycles":144903808,"thread_start_us":363744,"threads_started":1,"wal-append.queue_time_us":539223}
W20260709 13:10:01.073143 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 367075us
W20260709 13:10:01.092658 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 381972us
I20260709 13:10:01.093461 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:01.094591 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:01.095683 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.056877 26185 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:01.096450 23650 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:01.097522 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.103152 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.105280 22931 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:01.115877 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:01.112159 22829 catalog_manager.cc:5697] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 4 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.137838 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.067974 26359 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:10:01.103020 26021 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.154328 26021 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:01.073218 26205 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.152127 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.155455 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:01.156255 26214 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.104614 26325 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:01.157721 26325 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:01.154758 26021 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.158126 26325 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.158913 22931 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:01.159771 26205 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.100006 26355 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.160691 26232 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:01.161059 25953 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:01.156023 26224 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:01.104285 26270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51516 (request call id 0) took 1504 ms. Trace:
I20260709 13:10:01.135161 26035 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:01.104472 26193 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.186164 22829 catalog_manager.cc:5697] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 4 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.106927 25841 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.175973 26396 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:01.105249 26376 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.201094 22924 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:01.177567 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:01.139190 26281 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:01.104095 26014 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:01.198801 22829 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 5, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.176235 26375 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:01.209411 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:01.149982 26258 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:10:01.183369 25996 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:01.217772 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 63497.3us
I20260709 13:10:01.150812 25979 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:10:01.237634 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:01.207188 26277 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.210151 26092 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.240339 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:01.242429 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:01.199615 26355 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:10:01.304080 23657 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:01.443948 25861 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:01.440343 26400 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 13:10:01.448253 25861 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.450608 25861 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:01.451145 26409 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.306298 22829 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 5, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.451623 26409 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.453560 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:01.200718 26035 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.454843 22927 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:01.185429 26270 rpcz_store.cc:276] 0709 13:09:59.584029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.584182 (+   153us) service_pool.cc:224] Handling call
0709 13:09:59.601547 (+ 17365us) log.cc:844] Serialized 501 byte log entry
0709 13:10:01.088180 (+1486633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14751,"raft.queue_time_us":15110,"raft.run_cpu_time_us":1240,"raft.run_wall_time_us":33451,"thread_start_us":367640,"threads_started":1,"wal-append.queue_time_us":491102}
I20260709 13:10:01.212375 26376 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.455596 26035 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.200156 26396 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:01.261139 26395 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:01.457149 26376 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:01.457863 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.389878 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 146154us
I20260709 13:10:01.458894 26325 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.459856 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet adf5adaae5184191bdaff064d051da2a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:10:01.460974 26325 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.461278 26274 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:01.244447 26277 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.461714 26274 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:01.409863 26339 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:10:01.447643 26407 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.443895 26401 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.280s	user 0.004s	sys 0.006s
I20260709 13:10:01.464004 26407 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:01.417881 26404 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:10:01.466147 26407 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.466667 26407 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.416333 26405 log.cc:927] Time spent T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:10:01.459100 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.468570 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.469947 25996 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:01.470095 26156 raft_consensus.cc:3055] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:01.417074 26403 log.cc:927] Time spent T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:10:01.472497 26234 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:01.472982 26234 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.473771 26334 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:01.474332 26334 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.474907 26234 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.475533 22927 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:01.475831 25953 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:01.463229 26277 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:01.453159 22829 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 3 to 4, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 4 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:01.476853 26334 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.476680 25953 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.477411 26334 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:01.477933 26334 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.477806 22829 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 5 to 7, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 7 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.463127 26274 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.481078 26274 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.481669 26181 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:01.453562 26409 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:01.486363 26380 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.686s	user 0.004s	sys 0.000s
I20260709 13:10:01.475405 26234 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.479436 22829 catalog_manager.cc:5697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.494184 23079 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:10:01.496511 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:01.497664 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:01.498198 23076 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.501339 23074 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:01.502801 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.505721 23074 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.493335 22829 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 5 to 6, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 6 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.467141 26407 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:01.518903 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.470574 26156 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:01.523723 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:01.488528 26399 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.312s	user 0.003s	sys 0.007s
I20260709 13:10:01.530838 22829 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.531843 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:01.532408 22997 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:01.532752 22829 catalog_manager.cc:5697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 2 to 3, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.487900 26234 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.525619 23655 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:01.525748 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.479527 25953 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:01.524348 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:01.542654 23076 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:01.522480 22896 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:01.550820 26152 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:01.489912 26021 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.551383 26152 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.553290 26021 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.517155 26359 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:01.523363 26396 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.528703 25841 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.565914 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.535151 25861 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.571385 23653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "492dd607be6348c79999243a8383806d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:10:01.600970 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:01.602288 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:01.604669 23653 raft_consensus.cc:606] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:01.525365 26206 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:01.562407 26409 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:01.597849 26359 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.597333 26152 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:01.598136 26334 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:01.617981 22971 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:01.618103 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.620079 23072 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:01.620366 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.597031 26258 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:10:01.614184 26409 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:01.566466 25953 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.653003 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:01.609651 25861 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.642406 26376 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:01.652486 26409 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.649063 25979 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:01.682503 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:01.686956 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:01.688092 22922 raft_consensus.cc:2410] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:01.666975 26376 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:01.701553 22928 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:01.706363 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:01.697182 26408 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:10:01.715823 23072 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:01.717435 23076 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:01.718781 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:01.719980 26014 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:01.720515 26014 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.720999 26014 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.725838 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.726922 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:01.727487 23652 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:01.729022 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.729768 23076 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:01.680455 26350 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:01.697863 25969 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:01.701452 26258 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:01.734572 23079 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:01.677768 25979 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.737991 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.739774 23073 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:01.695776 26352 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:01.749440 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:01.750946 23071 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:10:01.755577 26241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.205s	user 0.002s	sys 0.006s
W20260709 13:10:01.756011 26241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.002s	sys 0.006s
I20260709 13:10:01.748088 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:01.759954 23076 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:01.762336 23076 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:10:01.795588 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47225.7us
I20260709 13:10:01.737550 26269 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.799008 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 90801.2us
I20260709 13:10:01.733521 26234 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:01.800611 23073 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:01.800704 22928 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:01.812942 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:01.813880 23652 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:01.815778 23076 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:01.757486 26407 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:01.767921 25996 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:01.823161 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:01.757429 26258 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.748828 25969 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:01.831519 26411 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:10:01.812247 26269 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:01.892514 26413 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.002s
I20260709 13:10:01.893491 26430 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.893326 26422 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:01.893843 25979 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:01.894394 26418 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 13:10:01.822306 26376 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.894332 23071 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:01.895318 26352 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.746857 26324 consensus_queue.cc:1059] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:10:01.898922 26270 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.950392 26270 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.952641 26270 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:01.954033 26248 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.954463 26248 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.958101 22924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 764) took 1017 ms. Trace:
I20260709 13:10:01.958442 22924 rpcz_store.cc:276] 0709 13:10:00.940972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.941115 (+   143us) service_pool.cc:224] Handling call
0709 13:10:01.957896 (+1016781us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54003b97d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:01.958047 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571991424}
I20260709 13:10:01.959805 26433 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:01.960392 22931 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:01.960319 26433 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.961814 26409 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:01.962390 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:01.963488 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:01.899770 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:01.964663 22922 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:10:01.964975 22922 pending_rounds.cc:85] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 3
I20260709 13:10:01.965018 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:01.965384 26269 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:01.944581 26432 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:01.965673 26352 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.966171 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:01.900286 23648 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.966332 26432 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.900767 26234 consensus_queue.cc:1059] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:01.906818 25953 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.918982 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:01.919323 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:01.921272 26407 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.917930 26385 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:01.939962 26258 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:01.943884 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:01.947098 26430 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:01.962118 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:01.965281 22922 pending_rounds.cc:107] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:10:01.906332 26216 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.962118 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:01.970311 22924 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:10:01.899559 26412 log.cc:927] Time spent T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.251s	user 0.003s	sys 0.000s
I20260709 13:10:01.970348 22926 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:01.901711 26419 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:01.901942 26416 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:01.981325 23005 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:01.920506 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:01.981956 23648 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
W20260709 13:10:01.980218 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 173940us
I20260709 13:10:01.962539 26433 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.937151 22923 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:01.951327 26014 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:02.077250 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 86940.5us
I20260709 13:10:02.425545 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:01.990460 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:02.427364 23074 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:02.428408 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:02.403194 23619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.005s	sys 0.009s
W20260709 13:10:02.429173 23619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.005s	sys 0.009s
I20260709 13:10:02.430090 22924 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:02.430387 22922 raft_consensus.cc:2889] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.431566 22922 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:02.431927 22922 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:02.111023 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:02.436460 22929 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:02.437268 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 516833us
I20260709 13:10:02.422451 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:02.441437 23071 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:02.428541 23004 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:02.002476 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:02.433557 22931 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:01.967862 26352 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:02.424575 26185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.002s	sys 0.014s
I20260709 13:10:02.510010 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:02.412992 26190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.011s	sys 0.010s
I20260709 13:10:02.432844 22922 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:02.066500 26152 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.544s
I20260709 13:10:02.105032 26409 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:02.423828 26432 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:02.060461 25953 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:02.514927 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 512477us
I20260709 13:10:02.669298 22970 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:02.634177 22922 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.604822 26014 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:02.636444 26378 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.831s	user 0.003s	sys 0.000s
W20260709 13:10:02.636500 26190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.016s	sys 0.011s
I20260709 13:10:02.713362 26190 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.714066 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 760) took 2080 ms. Trace:
I20260709 13:10:02.714004 26190 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:02.493710 26007 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.633509 22931 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:02.656442 26430 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:01.983995 25861 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:02.321305 26426 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.548902 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:02.042619 26353 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.668s
W20260709 13:10:02.869424 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 198596us
I20260709 13:10:02.715947 26007 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.045276 25861 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.045949 25861 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:02.500030 26407 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.050508 26407 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:02.525475 26385 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:02.605517 25969 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:02.787385 26248 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:02.494828 26324 consensus_queue.cc:1059] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.557s
I20260709 13:10:02.533665 26433 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:02.838542 22922 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:03.054893 23648 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:10:02.714593 22930 rpcz_store.cc:276] 0709 13:10:00.633222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.633829 (+   607us) service_pool.cc:224] Handling call
0709 13:10:00.634250 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.648211 (+ 13961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.648258 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.656169 (+  7911us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.707635 (+ 51466us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:00.707697 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.707774 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.372695 (+1664921us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:02.713703 (+341008us) raft_consensus.cc:1685] finished
0709 13:10:02.713732 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.713992 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5685,"raft.queue_time_us":14501,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":5810,"spinlock_wait_cycles":21602176,"thread_start_us":51074,"threads_started":1,"wal-append.queue_time_us":149172}
W20260709 13:10:02.870756 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 448284us
I20260709 13:10:03.058369 22924 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:02.549226 26185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.002s	sys 0.014s
I20260709 13:10:02.494241 26416 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:02.573280 26423 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.604866 25978 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.045318 26007 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:03.077005 23622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.000s	sys 0.014s
I20260709 13:10:03.080287 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:03.077009 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 958) took 1335 ms. Trace:
W20260709 13:10:03.110903 23622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.000s	sys 0.014s
I20260709 13:10:02.736698 26432 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:03.076179 26334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.015s
W20260709 13:10:02.766348 26421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.009s	sys 0.019s
I20260709 13:10:02.710727 25953 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:03.111830 23648 rpcz_store.cc:276] 0709 13:10:01.741686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.426594 (+684908us) service_pool.cc:224] Handling call
0709 13:10:03.076942 (+650348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:02.938326 26152 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.188s
W20260709 13:10:03.179481 26334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.013s	sys 0.015s
I20260709 13:10:03.210485 26152 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:03.132946 26432 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:03.211856 26435 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:03.212175 26432 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.212313 26435 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:03.212862 25861 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.213281 26435 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.214527 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 943) took 2957 ms. Trace:
I20260709 13:10:03.215134 23651 rpcz_store.cc:276] 0709 13:10:00.257130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.271575 (+ 14445us) service_pool.cc:224] Handling call
0709 13:10:00.271879 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.333326 (+ 61447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.333373 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.333916 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.489993 (+156077us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:00.525244 (+ 35251us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.542283 (+ 17039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.542355 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.206231 (+2663876us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b1800084640. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:03.214188 (+  7957us) raft_consensus.cc:1685] finished
0709 13:10:03.214300 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.214458 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57602,"prepare.queue_time_us":64041,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":24,"raft.queue_time_us":51234,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":8913,"spinlock_wait_cycles":5750656,"thread_start_us":140068,"threads_started":2,"wal-append.queue_time_us":205552}
I20260709 13:10:03.217682 26385 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.218065 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:03.111274 23074 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
W20260709 13:10:03.176946 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 130777us
I20260709 13:10:03.219619 26416 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:02.494390 26419 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:02.938053 26437 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.879215 26350 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:03.081919 26407 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.074983 26216 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.076851 26431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.169s	user 0.010s	sys 0.019s
I20260709 13:10:03.111099 26206 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.132189 26190 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.072077 26426 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.204809 25953 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.206318 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:03.211999 26353 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:03.214622 26435 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:03.220782 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 780) took 1300 ms. Trace:
I20260709 13:10:03.076355 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2337) took 1115 ms. Trace:
I20260709 13:10:03.222553 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:03.169571 23652 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:03.076069 26433 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.225414 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:03.072916 26409 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:03.201102 26421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.303s	user 0.010s	sys 0.020s
I20260709 13:10:03.107887 26248 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:10:03.125013 25978 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.246553 25861 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.247360 23648 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:03.293352 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 959) took 1551 ms. Trace:
I20260709 13:10:03.125197 26423 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.232079 26385 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.254326 22922 rpcz_store.cc:276] 0709 13:10:01.961231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.431238 (+470007us) service_pool.cc:224] Handling call
0709 13:10:02.431466 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.076111 (+644645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.076305 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.308826 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:03.309543 22922 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:10:03.268853 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 46374.7us
W20260709 13:10:03.313319 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.313787 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.270023 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2338) took 1308 ms. Trace:
W20260709 13:10:03.245299 26431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.010s	sys 0.021s
I20260709 13:10:03.267694 25953 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.287037 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 646) took 1791 ms. Trace:
I20260709 13:10:03.314908 22927 rpcz_store.cc:276] 0709 13:10:01.961470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.433141 (+471671us) service_pool.cc:224] Handling call
0709 13:10:02.433394 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.052338 (+618944us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:03.204195 (+151857us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.269547 (+ 65352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.269618 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:03.269688 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.269781 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.269942 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":618595,"prepare.queue_time_us":213734,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":18304,"raft.queue_time_us":631007,"spinlock_wait_cycles":4422912,"thread_start_us":213616,"threads_started":2}
I20260709 13:10:03.288398 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 634) took 3123 ms. Trace:
I20260709 13:10:03.293730 23648 rpcz_store.cc:276] 0709 13:10:01.741996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.206021 (+1464025us) service_pool.cc:224] Handling call
0709 13:10:03.293295 (+ 87274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.246358 26152 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:03.254189 23651 rpcz_store.cc:276] 0709 13:10:01.920069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.217753 (+1297684us) service_pool.cc:224] Handling call
0709 13:10:03.220660 (+  2907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.325397 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:03.325847 23651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:10:03.326326 22927 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:03.298903 25978 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.300326 26248 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.245126 26216 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.302786 26419 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:03.233680 26437 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.245852 26206 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.265975 26433 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.302923 26007 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.304703 25861 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.255509 26334 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:03.285303 26355 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.318414 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:03.321676 22922 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:03.326639 23651 raft_consensus.cc:606] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:03.340585 23651 raft_consensus.cc:630] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Rejecting request to transfer leadership because tablet server 216ff6323e434e399d196d8ba262c8f3 is not a voter in the active config
I20260709 13:10:03.252532 26451 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:03.322758 23080 rpcz_store.cc:276] 0709 13:10:01.495572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.495758 (+   186us) service_pool.cc:224] Handling call
0709 13:10:01.526668 (+ 30910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.662357 (+135689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.662388 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.663259 (+   871us) log.cc:844] Serialized 501 byte log entry
0709 13:10:01.896475 (+233216us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:01.896522 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.286532 (+1390010us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540038a4d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:03.286597 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.286662 (+    65us) raft_consensus.cc:1685] finished
0709 13:10:03.286682 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.286941 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311286400,"thread_start_us":187806,"threads_started":1,"wal-append.queue_time_us":198906,"wal-append.run_cpu_time_us":2071,"wal-append.run_wall_time_us":1029865}
I20260709 13:10:03.240688 26407 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.341564 26451 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.325158 23078 rpcz_store.cc:276] 0709 13:10:00.165153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.165305 (+   152us) service_pool.cc:224] Handling call
0709 13:10:00.165659 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.826933 (+661274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.287575 (+2460642us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b5400294854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:03.288301 (+   726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518730496}
I20260709 13:10:03.293141 26324 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:03.240418 26350 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.343453 22924 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:03.270161 26409 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.345680 22924 raft_consensus.cc:2410] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:03.357374 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:03.346210 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:03.349402 26007 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.359498 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 775) took 1623 ms. Trace:
I20260709 13:10:03.360050 23648 rpcz_store.cc:276] 0709 13:10:01.736019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.331179 (+1595160us) service_pool.cc:224] Handling call
0709 13:10:03.359420 (+ 28241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.352262 25861 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.352447 26355 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.353832 26334 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.354178 26206 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:03.349776 26414 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 1.546s	user 0.005s	sys 0.024s
I20260709 13:10:03.360136 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60272 (request call id 13) took 1508 ms. Trace:
I20260709 13:10:03.366541 23651 rpcz_store.cc:276] 0709 13:10:01.832880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.325727 (+1492847us) service_pool.cc:224] Handling call
0709 13:10:03.341227 (+ 15500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.317662 26185 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:03.365137 23648 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:03.365082 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:03.370998 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 996) took 1672 ms. Trace:
I20260709 13:10:03.371469 23648 rpcz_store.cc:276] 0709 13:10:01.698662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.361178 (+1662516us) service_pool.cc:224] Handling call
0709 13:10:03.365027 (+  3849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.370775 (+  5748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.370941 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.333463 26459 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:03.323144 26385 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:03.382668 26449 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:10:03.383263 26443 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:10:03.383497 26437 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.345106 26324 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:03.384847 26350 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.362244 26460 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.332654 26248 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.371876 25978 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.332415 26152 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.369907 26249 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.379822 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:03.368017 26442 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:03.395617 26434 consensus_queue.cc:1059] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:10:03.380370 26459 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:03.610025 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 230280us
I20260709 13:10:03.470140 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1901) took 1487 ms. Trace:
I20260709 13:10:03.530186 26454 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.624384 22929 rpcz_store.cc:276] 0709 13:10:01.983149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.444429 (+461280us) service_pool.cc:224] Handling call
0709 13:10:02.604506 (+160077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.231668 (+627162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.231701 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.240698 (+  8997us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.364553 (+123855us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:03.364588 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.364652 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.469902 (+105250us) raft_consensus.cc:1685] finished
0709 13:10:03.469922 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.470069 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":448819,"raft.queue_time_us":470205,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":29482,"thread_start_us":271657,"threads_started":2,"wal-append.queue_time_us":213869}
I20260709 13:10:03.625379 26454 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.626322 26152 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.515606 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.515157 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.627347 23001 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:03.627722 26454 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.385241 26462 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.611367 26205 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:10:03.400712 23651 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:03.446938 26355 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.483207 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 993) took 2431 ms. Trace:
I20260709 13:10:03.629678 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 999) took 1930 ms. Trace:
I20260709 13:10:03.628471 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.452602 26409 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.555721 26453 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:03.514258 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:03.567235 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.510459 26181 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.431627 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 997) took 1732 ms. Trace:
I20260709 13:10:03.488227 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.397331 26324 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.482372 26450 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.523515 22923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 1896) took 1837 ms (client timeout 1901 ms). Trace:
I20260709 13:10:03.475446 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 947) took 2433 ms. Trace:
I20260709 13:10:03.506456 26334 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.633594 26450 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.476580 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 994) took 1783 ms. Trace:
I20260709 13:10:03.634158 23655 rpcz_store.cc:276] 0709 13:10:01.041568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.041687 (+   119us) service_pool.cc:224] Handling call
0709 13:10:01.041934 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.561744 (+519810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.475220 (+1913476us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54005b36d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:03.475387 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111873408}
I20260709 13:10:03.514159 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.488623 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.445770 26472 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:03.636423 23002 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:03.636245 23655 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:03.637019 26472 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.454172 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:03.489053 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.638504 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1001) took 1938 ms. Trace:
I20260709 13:10:03.633417 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.536684 22972 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:03.639633 26472 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:03.514482 23622 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.898s (SENT) [suppressed 23 similar messages]
W20260709 13:10:03.640156 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 103538us
I20260709 13:10:03.640444 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.640890 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.453694 26470 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:03.516278 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.641278 26455 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:03.642010 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.641844 26470 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.643335 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.634708 23649 rpcz_store.cc:276] 0709 13:10:01.695496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.700965 (+  5469us) service_pool.cc:224] Handling call
0709 13:10:01.724910 (+ 23945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.975181 (+250271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.975223 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.975277 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:01.975325 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.476364 (+1501039us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54006a1654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:03.476411 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.476520 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575037312}
I20260709 13:10:03.643689 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.643894 26455 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:03.644678 26455 consensus_queue.cc:1243] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:03.644799 23649 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:03.645813 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 776) took 1909 ms. Trace:
I20260709 13:10:03.646113 26459 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.630664 23001 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:03.646353 23649 rpcz_store.cc:276] 0709 13:10:01.736286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.644124 (+1907838us) service_pool.cc:224] Handling call
0709 13:10:03.644580 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.645520 (+   940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.645754 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.647251 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.470964 26426 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.477572 26451 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:03.451128 26407 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.657867 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.650554 26249 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.647791 26455 consensus_queue.cc:1059] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:03.648825 26295 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:03.482227 22926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1899) took 1499 ms. Trace:
W20260709 13:10:03.650496 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.641243 23005 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:03.638873 22999 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:03.630234 23651 rpcz_store.cc:276] 0709 13:10:01.699549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.399895 (+1700346us) service_pool.cc:224] Handling call
0709 13:10:03.400269 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.629412 (+229143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.629623 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.652391 26322 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:03.664893 22926 rpcz_store.cc:276] 0709 13:10:01.982459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.435089 (+452630us) service_pool.cc:224] Handling call
0709 13:10:02.435441 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.052906 (+617465us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:03.220116 (+167210us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.290004 (+ 69888us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.291048 (+  1044us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.291314 (+   266us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:03.291383 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.291521 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.482033 (+190512us) raft_consensus.cc:1685] finished
0709 13:10:03.482059 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.482171 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71638,"prepare.queue_time_us":250567,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4225,"raft.queue_time_us":723631,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":5218,"thread_start_us":236097,"threads_started":2,"wal-append.queue_time_us":232530}
I20260709 13:10:03.632395 26181 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.638903 23655 rpcz_store.cc:276] 0709 13:10:01.700201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.635593 (+1935392us) service_pool.cc:224] Handling call
0709 13:10:03.635934 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.638119 (+  2185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.638361 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.628383 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.669062 23655 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:03.637763 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.669811 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 955) took 1930 ms. Trace:
I20260709 13:10:03.655865 26433 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:03.501520 26410 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 1.834s	user 0.022s	sys 0.000s
W20260709 13:10:03.462705 26444 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:03.652632 26021 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:03.652886 26190 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:03.633823 22923 rpcz_store.cc:269] 0709 13:10:01.686253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.688744 (+  2491us) service_pool.cc:224] Handling call
0709 13:10:03.523325 (+1834581us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400373554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:03.523451 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528880896}
I20260709 13:10:03.698606 26181 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.698781 26190 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.701653 26190 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:03.701963 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 1.26367e+06us
I20260709 13:10:03.663477 26334 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:03.704890 26334 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.705425 22997 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:10:03.707806 26334 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.481112 26248 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:03.628916 26462 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.669710 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:03.632365 23648 rpcz_store.cc:276] 0709 13:10:01.698989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.372337 (+1673348us) service_pool.cc:224] Handling call
0709 13:10:03.374189 (+  1852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.431257 (+ 57068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.431289 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.431334 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:03.431363 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.431436 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.431569 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56753,"raft.queue_time_us":192645,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103}
W20260709 13:10:03.739779 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 70181.1us
I20260709 13:10:03.742715 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1002) took 1877 ms. Trace:
I20260709 13:10:03.670583 23655 rpcz_store.cc:276] 0709 13:10:01.739603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.668299 (+1928696us) service_pool.cc:224] Handling call
0709 13:10:03.668629 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.669565 (+   936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.669760 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.637833 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:03.644963 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:03.746088 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.746419 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.648736 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.677868 25953 raft_consensus.cc:3055] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:03.536582 26156 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.530112 26201 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.757802 26156 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.754344 26351 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:03.758396 26351 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.758740 26351 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.630080 23656 rpcz_store.cc:276] 0709 13:10:01.051349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.052202 (+   853us) service_pool.cc:224] Handling call
0709 13:10:01.052543 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:01.071723 (+ 19180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.071769 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:01.072407 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 13:10:01.484038 (+411631us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b180040b340. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa0d1 00007f3924fc5a0f
0709 13:10:01.659944 (+175906us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:01.661253 (+  1309us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.661476 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.661568 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.953809 (+292241us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4800210b58. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3929f33aa1 00007f3929f2ab37 00007f3929f2a9ca 00007f392a02226f 00007f392a021f37 00007f392a03655c 00007f392a036508 00007f392a036488 00007f392a036443 00007f392a0356ec 00007f3928f5fa96
0709 13:10:03.349037 (+1395228us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:03.483003 (+133966us) raft_consensus.cc:1685] finished
0709 13:10:03.483026 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.483147 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18658,"prepare.queue_time_us":1108,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":44177,"raft.run_cpu_time_us":2664,"raft.run_wall_time_us":850808,"spinlock_wait_cycles":74060800,"thread_start_us":175679,"threads_started":1,"wal-append.queue_time_us":627928}
I20260709 13:10:03.685246 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.564829 26376 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.477572 26359 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.504588 26471 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:03.483790 26216 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.609292 25978 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.513339 26320 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.477016 26385 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.709903 22997 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:03.752426 25953 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:03.686668 26470 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:03.713624 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.715102 26249 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:03.534559 26353 consensus_queue.cc:1059] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.175s
I20260709 13:10:03.716553 23654 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:03.505369 26432 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.651487 26460 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.724717 26433 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.585444 26442 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.743173 23648 rpcz_store.cc:276] 0709 13:10:01.865799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.739928 (+1874129us) service_pool.cc:224] Handling call
0709 13:10:03.742649 (+  2721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.755242 23000 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:03.757668 26201 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:03.679183 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.815297 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:03.761853 26376 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.564924 25861 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.763206 23655 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:10:03.762302 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 86169.4us
I20260709 13:10:03.731491 26324 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.771939 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.777827 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.781471 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:03.711731 26427 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.735s	user 0.009s	sys 0.033s
W20260709 13:10:03.785857 22895 connection.cc:256] RPC call timeout handler was delayed by -1.5836614759999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:10:03.788719 25932 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.787003 26407 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:03.789398 26334 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.790949 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 960) took 2045 ms. Trace:
I20260709 13:10:03.767187 26450 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:03.767288 26021 raft_consensus.cc:697] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:03.781772 25978 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.759747 23001 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:03.819118 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:03.631016 26453 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.775915 26014 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:03.788276 26423 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:03.828235 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1003) took 1918 ms. Trace:
I20260709 13:10:03.786584 26471 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.029523 26443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.025s	sys 0.038s
W20260709 13:10:04.147142 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.822122 26190 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.239945 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:04.240586 26258 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.240476 26190 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:03.821800 26181 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:04.241650 26181 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.241844 26258 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:04.242686 26190 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:04.243319 23655 rpcz_store.cc:276] 0709 13:10:01.910117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.745310 (+1835193us) service_pool.cc:224] Handling call
0709 13:10:03.760909 (+ 15599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.823842 (+ 62933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.828161 (+  4319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.243793 26181 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:04.244701 26258 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:03.949779 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:03.822305 26305 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:03.880478 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:03.976653 26281 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:03.822046 26333 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.246577 26281 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:04.247723 26324 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:04.248260 26014 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.248762 26281 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:04.002599 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 187361us
I20260709 13:10:04.223063 26430 raft_consensus.cc:3055] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:04.135862 25979 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:04.251123 26471 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:04.251082 26014 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:03.918560 26152 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.333s
I20260709 13:10:04.251832 26334 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.252799 26407 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.253865 23073 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:04.253927 25932 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:03.980796 25953 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:04.232653 26385 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:03.815629 26442 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.035401 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:03.951838 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:04.247187 26333 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.239537 26443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.032s	sys 0.085s
I20260709 13:10:04.239543 23654 rpcz_store.cc:276] 0709 13:10:01.745558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.716009 (+1970451us) service_pool.cc:224] Handling call
0709 13:10:03.716345 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.790659 (+ 74314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.790887 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.245924 26305 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.270227 23652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 773) took 2473 ms (client timeout 2024 ms). Trace:
I20260709 13:10:04.245170 26462 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:03.919272 25861 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.429646 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.324436 26201 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:04.284420 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 956) took 2543 ms. Trace:
I20260709 13:10:04.454293 25861 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:04.454164 23657 rpcz_store.cc:276] 0709 13:10:01.741135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.678442 (+1937307us) service_pool.cc:224] Handling call
0709 13:10:04.209182 (+530740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.209410 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.209447 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.209498 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.209552 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.209623 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.284227 (+ 74604us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54006301d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:04.284360 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219863936}
W20260709 13:10:04.369207 26402 log.cc:927] Time spent T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 3.125s	user 0.019s	sys 0.015s
I20260709 13:10:04.369626 26432 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:04.456543 23072 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:04.457357 23071 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:04.457690 23073 raft_consensus.cc:2410] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:10:04.458225 23652 rpcz_store.cc:269] 0709 13:10:01.735387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.965955 (+230568us) service_pool.cc:224] Handling call
0709 13:10:04.208980 (+2243025us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54006301d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:04.209095 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2766058880}
I20260709 13:10:04.452332 23075 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:04.282594 26430 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:04.468160 23657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "defec66b69804f8c85671fbdd904172d"
dest_uuid: "01988c2c817947859340a730b7f1247d"
mode: GRACEFUL
new_leader_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:60272
I20260709 13:10:04.457544 26385 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:04.477939 23657 raft_consensus.cc:606] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Received request to transfer leadership to TS 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:04.328143 26156 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.570s	user 0.002s	sys 0.009s
I20260709 13:10:04.390369 26453 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:04.332280 26376 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:04.501544 26153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.708s	user 0.048s	sys 0.068s
I20260709 13:10:04.283002 26258 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:04.418339 26021 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.506431 26358 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.539059 26205 raft_consensus.cc:3055] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:04.534581 26258 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.581079 26205 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:04.539240 26358 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.597373 26351 consensus_meta.cc:287] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.838s	user 0.007s	sys 0.004s
I20260709 13:10:04.600298 26460 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:04.603260 26334 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:04.639822 26407 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:04.537525 26385 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:04.641197 26385 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.652197 26442 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:04.694943 22928 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:04.775275 26156 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.696667 22930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.329s	user 0.027s	sys 0.028s
W20260709 13:10:04.776639 22930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.413s	user 0.027s	sys 0.028s
I20260709 13:10:04.776794 26156 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.217890 22931 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:04.698423 22998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1850) took 3802 ms. Trace:
I20260709 13:10:04.779484 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:04.779636 22931 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:04.700119 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:10:04.245730 22895 connection.cc:256] RPC call timeout handler was delayed by -1.3200674819998994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:10:04.702911 23619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.017s	sys 0.050s
W20260709 13:10:04.239019 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 376207us
I20260709 13:10:04.602571 26351 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.268319 23004 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:10:04.289439 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.704031 23651 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.000s	sys 0.004s
W20260709 13:10:04.704465 23046 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.345s	user 0.005s	sys 0.015s
I20260709 13:10:04.706337 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:04.706838 25932 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:04.708099 23620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.346s	user 0.012s	sys 0.008s
I20260709 13:10:04.708788 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:04.530018 26153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.736s	user 0.049s	sys 0.068s
W20260709 13:10:04.774784 26161 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.000s	sys 0.014s
I20260709 13:10:04.775420 26473 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:04.780475 23622 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.007s	sys 0.006s
W20260709 13:10:04.701009 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.786736 23619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.018s	sys 0.050s
I20260709 13:10:04.257058 23003 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
W20260709 13:10:04.803015 23651 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.000s	sys 0.004s
W20260709 13:10:04.771746 26185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.344s	user 0.005s	sys 0.017s
W20260709 13:10:04.807904 26185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.006s	sys 0.017s
I20260709 13:10:04.808544 23075 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:04.799536 23046 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.006s	sys 0.015s
W20260709 13:10:04.809470 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 1.45073e+06us
W20260709 13:10:04.803287 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.801326 23620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.439s	user 0.012s	sys 0.008s
I20260709 13:10:04.813663 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:04.814002 26483 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.786911 26325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.009s	sys 0.026s
I20260709 13:10:04.815022 22924 raft_consensus.cc:2410] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:04.815852 22972 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:04.816412 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:04.817297 23652 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.817478 26300 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:04.818029 26300 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:04.802938 22895 connection.cc:256] RPC call timeout handler was delayed by -1.2300674819999813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 13:10:04.818480 26300 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.818589 22972 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:04.819862 23622 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.007s	sys 0.007s
I20260709 13:10:04.820369 26014 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:04.821317 26014 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:04.814937 26483 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.820441 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 1.30587e+06us
I20260709 13:10:04.824285 26153 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:04.824858 26153 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:04.825310 26153 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.604444 26205 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.828079 26205 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.828433 23078 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:10:04.807963 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.819581 22895 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:04.782097 22931 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.805579 26258 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:04.804349 25932 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.841565 25932 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.842015 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:04.842223 26351 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:04.814949 26325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.009s	sys 0.027s
I20260709 13:10:04.844417 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:04.845098 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:04.845293 23648 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:04.846901 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:04.457046 25979 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.848837 23077 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:04.850219 25979 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:04.852447 26479 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.853144 26479 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.853598 26460 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:04.854579 26460 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.856446 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:04.857401 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:04.860339 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:04.861126 22924 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:04.861235 26407 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.862200 26407 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.865096 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45823.4us
W20260709 13:10:04.865996 26161 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.000s	sys 0.015s
I20260709 13:10:04.866580 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:04.867326 26325 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:04.868196 26325 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:04.869017 26325 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.872174 26014 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:04.871991 26473 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:04.844455 23653 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [2.5-6.8]
I20260709 13:10:04.875216 26473 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:04.804024 23649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.003s	sys 0.003s
I20260709 13:10:04.803973 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 768) took 1032 ms. Trace:
I20260709 13:10:04.920493 23003 rpcz_store.cc:276] 0709 13:10:03.771821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.777562 (+  5741us) service_pool.cc:224] Handling call
0709 13:10:04.803711 (+1026149us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:04.936057 23649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.004s	sys 0.003s
I20260709 13:10:04.871507 26325 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:04.918545 23080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.014s	sys 0.018s
W20260709 13:10:04.937400 23074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.006s
W20260709 13:10:04.930079 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 62609.2us
W20260709 13:10:04.932528 22896 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.022s	sys 0.014s
W20260709 13:10:04.945160 23046 connection.cc:256] RPC call timeout handler was delayed by -1.4186003380000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:10:04.939079 23045 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.003s	sys 0.007s
W20260709 13:10:04.939448 23006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.000s	sys 0.007s
I20260709 13:10:04.918629 25932 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:04.942610 23002 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.002s	sys 0.005s
W20260709 13:10:04.950098 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 66272.5us
W20260709 13:10:04.952796 22896 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.022s	sys 0.016s
W20260709 13:10:04.953979 23080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.015s	sys 0.019s
W20260709 13:10:04.954558 23045 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.003s	sys 0.007s
I20260709 13:10:04.963166 22931 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:04.961330 23006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.000s	sys 0.008s
W20260709 13:10:04.945775 23079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.011s	sys 0.010s
W20260709 13:10:04.958263 23074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.001s	sys 0.006s
W20260709 13:10:04.966353 23002 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.002s	sys 0.005s
I20260709 13:10:04.963472 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2237) took 1135 ms. Trace:
I20260709 13:10:04.975842 26442 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:04.975994 26351 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.976969 26351 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:04.977583 26494 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:04.978276 22923 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:04.980211 26306 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:04.980803 26479 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:04.960088 23650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.001s	sys 0.008s
I20260709 13:10:04.969905 23076 rpcz_store.cc:276] 0709 13:10:03.822643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.791206 (+968563us) service_pool.cc:224] Handling call
0709 13:10:04.830749 (+ 39543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.944915 (+114166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.944940 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.945001 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:04.953666 (+  8665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.953750 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.957632 (+  3882us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:04.987170 23079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.012s	sys 0.011s
I20260709 13:10:04.989383 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:04.995116 23622 connection.cc:256] RPC call timeout handler was delayed by -1.2034685789999457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:10:04.998176 23650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.002s	sys 0.009s
I20260709 13:10:05.000248 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:04.779842 22998 rpcz_store.cc:276] 0709 13:10:00.895711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.896284 (+   573us) service_pool.cc:224] Handling call
0709 13:10:00.896670 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:00.897757 (+  1087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.897796 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:00.898478 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 13:10:01.096788 (+198310us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:01.117110 (+ 20322us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.139625 (+ 22515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.139720 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.353673 (+2213953us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b18004655e0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:04.368615 (+1014942us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:04.697428 (+328813us) raft_consensus.cc:1685] finished
0709 13:10:04.697484 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.698043 (+   559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24244,"prepare.queue_time_us":37763,"prepare.run_cpu_time_us":338,"prepare.run_wall_time_us":1304,"raft.queue_time_us":60075,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":11402,"spinlock_wait_cycles":87678592,"thread_start_us":183037,"threads_started":1,"wal-append.queue_time_us":268957}
I20260709 13:10:04.992113 26351 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.023720 26156 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.024528 26450 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.025213 25996 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:05.025707 26185 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.026798 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.026537 26185 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.025332 26450 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.029084 26185 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.029776 26450 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.025812 25996 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.030516 23000 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:05.030733 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.032325 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:05.033497 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.034126 23076 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:10:05.034960 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.029662 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.024585 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1903) took 1771 ms. Trace:
I20260709 13:10:05.036028 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.036651 26460 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.037140 23000 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:05.037884 26426 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.035948 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:05.010813 26479 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.038897 26479 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.040431 23075 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:05.041199 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2240) took 1024 ms. Trace:
I20260709 13:10:05.029718 26484 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.041303 26479 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:05.041627 23075 rpcz_store.cc:276] 0709 13:10:04.016859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.708153 (+691294us) service_pool.cc:224] Handling call
0709 13:10:05.041128 (+332975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:05.042171 26484 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.042910 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:05.044524 26484 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:05.045411 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 954) took 3306 ms. Trace:
I20260709 13:10:05.046211 25996 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.047142 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.048082 22923 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:05.048538 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.049880 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:05.050982 26460 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:05.051493 26460 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.051940 26460 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.053071 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.053426 23621 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:05.054299 26482 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:05.009040 26442 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.054894 26482 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.055500 26482 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.055742 23005 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:05.056850 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2227) took 1240 ms. Trace:
I20260709 13:10:05.057261 23080 rpcz_store.cc:276] 0709 13:10:03.816692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.818170 (+  1478us) service_pool.cc:224] Handling call
0709 13:10:03.950438 (+132268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.004885 (+ 54447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.004937 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.139538 (+134601us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.012506 (+872968us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:05.018732 (+  6226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.018867 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.018907 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:05.018926 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.056759 (+ 37833us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68704,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":110835,"thread_start_us":760701,"threads_started":1,"wal-append.queue_time_us":645814}
W20260709 13:10:05.019512 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 1.27776e+06us
I20260709 13:10:05.060518 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:05.061870 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:05.062426 26460 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.063278 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2231) took 1245 ms. Trace:
I20260709 13:10:05.063694 23072 rpcz_store.cc:276] 0709 13:10:03.817682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.818363 (+   681us) service_pool.cc:224] Handling call
0709 13:10:03.818599 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.457011 (+638412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.062807 (+605796us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540010d454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:05.063123 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466152320}
I20260709 13:10:05.064337 22924 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:10:05.064505 26351 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.064982 26460 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.066577 26460 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.067042 26460 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.067605 26460 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.064355 23046 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.045804 23651 rpcz_store.cc:276] 0709 13:10:01.739375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.667257 (+1927882us) service_pool.cc:224] Handling call
0709 13:10:03.667627 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.762487 (+ 94860us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:04.806323 (+1043836us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.966036 (+159713us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.976834 (+ 10798us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.977056 (+   222us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.977103 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.977208 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.045143 (+ 67935us) raft_consensus.cc:1685] finished
0709 13:10:05.045174 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.045330 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251169,"prepare.queue_time_us":874402,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":119846,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":10232,"thread_start_us":1191728,"threads_started":2,"wal-append.queue_time_us":230513}
W20260709 13:10:05.046756 25978 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.007s
W20260709 13:10:05.020303 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.25589e+06us
I20260709 13:10:05.074823 23652 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:05.059314 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.072518 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:05.080447 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 65874.9us
I20260709 13:10:05.083410 23653 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:05.084144 26479 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.067608 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.064895 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.085897 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:05.093287 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 771) took 1319 ms. Trace:
I20260709 13:10:05.093709 22997 rpcz_store.cc:276] 0709 13:10:03.773683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.239650 (+465967us) service_pool.cc:224] Handling call
0709 13:10:05.067368 (+827718us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:10:05.093231 (+ 25863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54373888}
I20260709 13:10:05.055394 26442 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.095924 26300 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.097321 26442 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:05.098459 26300 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.099956 23072 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:05.101284 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.102200 23072 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:05.104373 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1861) took 1591 ms. Trace:
I20260709 13:10:05.104709 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.105647 22923 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:05.104774 23006 rpcz_store.cc:276] 0709 13:10:03.513262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.513375 (+   113us) service_pool.cc:224] Handling call
0709 13:10:03.513690 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.513883 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:03.761680 (+247797us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.068101 (+1306421us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.103630 (+ 35529us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.103828 (+   198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.103890 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:05.103981 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.104092 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.104276 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282500,"prepare.queue_time_us":279301,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":101,"thread_start_us":1202070,"threads_started":1,"wal-append.queue_time_us":1264642}
I20260709 13:10:05.106837 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.085615 25978 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.108453 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.109505 22922 raft_consensus.cc:2410] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:05.109860 25978 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:05.110705 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.111347 23076 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:05.116489 23654 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:05.116977 23080 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:05.103221 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.116394 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:05.122159 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57936.5us
I20260709 13:10:05.122998 26437 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:05.123397 26437 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:05.124670 26437 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.125936 26437 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:05.127686 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 158313us
I20260709 13:10:05.128993 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 957) took 3387 ms. Trace:
I20260709 13:10:05.129997 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:05.107039 26153 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:05.138895 26498 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
W20260709 13:10:05.139137 22928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2336) took 3178 ms (client timeout 2292 ms). Trace:
I20260709 13:10:05.140029 22999 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:05.141626 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2226) took 1325 ms. Trace:
I20260709 13:10:05.142001 26021 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.142153 23078 rpcz_store.cc:276] 0709 13:10:03.816440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.816678 (+   238us) service_pool.cc:224] Handling call
0709 13:10:03.816967 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.828950 (+1011983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.141221 (+312271us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540042dbd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:05.141548 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324360960}
I20260709 13:10:05.135408 26507 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:05.139751 22928 rpcz_store.cc:269] 0709 13:10:01.960994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.963270 (+  2276us) service_pool.cc:224] Handling call
0709 13:10:05.138854 (+3175584us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b540033e854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:05.139029 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6279026432}
I20260709 13:10:05.150511 23072 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:05.155232 22931 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:05.156137 26334 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:05.129423 23650 rpcz_store.cc:276] 0709 13:10:01.741424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.687270 (+1945846us) service_pool.cc:224] Handling call
0709 13:10:03.687574 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.765658 (+ 78084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.765691 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.777294 (+ 11603us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.998969 (+1221675us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:04.999060 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.128564 (+129504us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b54006a22d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:05.128609 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.128649 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:05.128665 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.128932 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104202,"raft.queue_time_us":92267,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":2703,"spinlock_wait_cycles":9535232,"thread_start_us":1176154,"threads_started":1,"wal-append.queue_time_us":1312607}
I20260709 13:10:05.158094 26334 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.159952 26334 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.160035 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.161067 22925 raft_consensus.cc:2410] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:05.161804 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.162299 22925 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:10:05.164108 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.164731 22929 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.167836 26153 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.172535 22927 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:05.173272 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.173651 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.174487 22927 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:05.174947 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.177287 25953 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.179365 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.180917 22923 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:05.184795 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.183758 22925 pending_rounds.cc:85] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 3
I20260709 13:10:05.187717 22931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1904) took 1932 ms. Trace:
I20260709 13:10:05.188091 22931 rpcz_store.cc:276] 0709 13:10:03.254940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.255118 (+   178us) service_pool.cc:224] Handling call
0709 13:10:03.255520 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.217769 (+962249us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b540001cfa0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f81dc0 00007f392500c1c0 00007f392500d231 00007f3925009d8f 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c
0709 13:10:05.159070 (+941301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.187643 (+ 28573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53141248}
W20260709 13:10:05.189931 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 60122.3us
I20260709 13:10:05.186733 22925 pending_rounds.cc:107] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:10:05.200906 22925 raft_consensus.cc:2889] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.208612 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.185786 26153 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:05.225548 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.229091 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2228) took 1412 ms. Trace:
I20260709 13:10:05.231606 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:05.232714 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.228839 22928 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.238929 25996 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.239935 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.240772 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:05.241504 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.242895 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.243245 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.244041 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.244596 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.245170 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2238) took 1367 ms. Trace:
I20260709 13:10:05.245442 26507 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:05.246832 22896 connection.cc:256] RPC call timeout handler was delayed by -1.387355867999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:10:05.242929 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.193504 25978 consensus_queue.cc:1059] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:10:05.254813 23006 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:05.258474 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.245566 23071 rpcz_store.cc:276] 0709 13:10:03.878101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.851017 (+972916us) service_pool.cc:224] Handling call
0709 13:10:04.851641 (+   624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.852448 (+   807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.852489 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.853203 (+   714us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.935153 (+ 81950us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:04.935201 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.935385 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.244940 (+309555us) raft_consensus.cc:1685] finished
0709 13:10:05.244958 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.245090 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2857,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"thread_start_us":81398,"threads_started":1,"wal-append.queue_time_us":236201}
I20260709 13:10:05.246294 26205 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:05.359766 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:05.366726 22928 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
W20260709 13:10:05.368220 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.370535 22928 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:05.379880 22931 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:05.381310 22931 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:05.382692 22931 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.385602 26153 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:05.387003 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.387441 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.387930 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.388262 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.388710 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.389066 22896 connection.cc:256] RPC call timeout handler was delayed by -1.2948203670000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 13:10:05.389358 22896 connection.cc:256] RPC call timeout handler was delayed by -1.287734465000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2513s for a response
W20260709 13:10:05.389631 22896 connection.cc:256] RPC call timeout handler was delayed by -1.287734465000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2513s for a response
W20260709 13:10:05.390370 22896 connection.cc:256] RPC call timeout handler was delayed by -1.276612258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 13:10:05.390689 22896 connection.cc:256] RPC call timeout handler was delayed by -1.276612258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 13:10:05.392040 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 133327us
I20260709 13:10:05.393079 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.229457 23074 rpcz_store.cc:276] 0709 13:10:03.816931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.817122 (+   191us) service_pool.cc:224] Handling call
0709 13:10:03.817568 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:03.818002 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.818035 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:03.958062 (+140027us) log.cc:844] Serialized 532 byte log entry
0709 13:10:05.061306 (+1103244us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:05.061408 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.061515 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.137977 (+ 76462us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:05.223277 (+ 85300us) raft_consensus.cc:1685] finished
0709 13:10:05.223303 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.229035 (+  5732us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53038,"raft.queue_time_us":4501,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":91823,"spinlock_wait_cycles":28137856,"thread_start_us":816669,"threads_started":1,"wal-append.queue_time_us":752305}
W20260709 13:10:05.394670 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 127600us
W20260709 13:10:05.395633 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.395922 23046 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.398079 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.399255 25978 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:05.265190 26442 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:05.399840 25978 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.399957 26442 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.400650 26205 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.401460 26442 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:05.404302 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.400584 25978 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.231024 26482 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.418781 26482 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:05.419725 26482 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:05.420202 26482 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.420647 26482 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:05.424057 26497 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:10:05.425680 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 777) took 3689 ms. Trace:
I20260709 13:10:05.427969 26396 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:05.428680 26396 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.430670 26482 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.395964 22895 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:05.426101 23649 rpcz_store.cc:276] 0709 13:10:01.737282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.647311 (+1910029us) service_pool.cc:224] Handling call
0709 13:10:03.647645 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.761613 (+113968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.761648 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.762149 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.037179 (+1275030us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:05.037248 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.037361 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.425403 (+388042us) raft_consensus.cc:1685] finished
0709 13:10:05.425427 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.425614 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339571,"raft.queue_time_us":114403,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":3420,"thread_start_us":1151170,"threads_started":1,"wal-append.queue_time_us":1339855}
I20260709 13:10:05.431198 26396 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.445253 22929 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:05.446339 22931 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:05.484189 26007 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:05.484952 26007 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.485885 26482 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:05.486596 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 90749.9us
I20260709 13:10:05.487224 26007 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.487356 26482 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.492095 26205 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.492297 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.492549 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:05.492889 26021 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.493548 26305 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:05.493680 22972 connection.cc:256] RPC call timeout handler was delayed by -1.0915799899999001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2292s for a response
I20260709 13:10:05.494683 26430 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.418774 26442 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.519409 26434 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.035938 22930 rpcz_store.cc:276] 0709 13:10:03.252756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.252904 (+   148us) service_pool.cc:224] Handling call
0709 13:10:03.253278 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.253547 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:03.361417 (+107870us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.963530 (+1602113us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.014312 (+ 50782us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.019100 (+  4788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.024085 (+  4985us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:05.024179 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.024291 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.024495 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13234,"prepare.queue_time_us":341837,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":4366,"raft.run_cpu_time_us":693,"raft.run_wall_time_us":4193,"thread_start_us":1687454,"threads_started":3,"wal-append.queue_time_us":1250430}
W20260709 13:10:05.582787 26484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.024s	sys 0.023s
I20260709 13:10:05.532023 26426 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:05.559515 26333 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:05.540658 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.582922 26482 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:05.543805 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.548180 26483 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:05.599434 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.557029 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 769) took 1784 ms. Trace:
I20260709 13:10:05.564993 26153 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.567165 26334 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.578428 22931 pending_rounds.cc:85] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 4
W20260709 13:10:05.581316 23002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.010s	sys 0.038s
I20260709 13:10:05.583319 22927 raft_consensus.cc:2368] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12.
I20260709 13:10:05.609669 22931 pending_rounds.cc:107] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 13:10:05.585322 23621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.018s	sys 0.031s
I20260709 13:10:05.610160 22931 raft_consensus.cc:2889] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:05.534126 23077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2232) took 1716 ms (client timeout 2072 ms). Trace:
I20260709 13:10:05.541422 26479 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:05.597802 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 114968us
I20260709 13:10:05.586549 26305 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.592310 26484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.025s	sys 0.024s
I20260709 13:10:05.600852 23004 rpcz_store.cc:276] 0709 13:10:03.772623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.240859 (+468236us) service_pool.cc:224] Handling call
0709 13:10:04.267783 (+ 26924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.791787 (+524004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.556667 (+764880us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54003aaa50. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:05.556845 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61236992}
W20260709 13:10:05.609825 23002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.010s	sys 0.038s
W20260709 13:10:05.582962 23079 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.013s	sys 0.035s
I20260709 13:10:05.617233 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.616964 26305 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.527627 26407 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:05.610661 23077 rpcz_store.cc:269] 0709 13:10:03.817930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.818830 (+   900us) service_pool.cc:224] Handling call
0709 13:10:05.533839 (+1715009us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400276854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:05.534041 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340370688}
I20260709 13:10:05.594745 26426 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.600380 26482 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:05.616601 23079 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.013s	sys 0.035s
W20260709 13:10:05.610306 23621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.018s	sys 0.031s
I20260709 13:10:05.621698 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.623346 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.623737 22929 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:05.623303 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 570133us
I20260709 13:10:05.614025 26479 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.632897 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2230) took 1815 ms. Trace:
I20260709 13:10:05.637990 26430 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.620878 26434 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.634197 26021 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:05.645161 25932 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.017s	sys 0.041s
I20260709 13:10:05.683981 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2128) took 2118 ms. Trace:
I20260709 13:10:05.635591 23079 rpcz_store.cc:276] 0709 13:10:03.817442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.818307 (+   865us) service_pool.cc:224] Handling call
0709 13:10:04.205297 (+386990us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:04.205682 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.205721 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:04.206412 (+   691us) log.cc:844] Serialized 52 byte log entry
0709 13:10:05.063718 (+857306us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:05.622933 (+559215us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.627574 (+  4641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.632618 (+  5044us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.632673 (+    55us) raft_consensus.cc:1685] finished
0709 13:10:05.632691 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.632834 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4196,"raft.queue_time_us":59593,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7869,"spinlock_wait_cycles":48000,"thread_start_us":1339558,"threads_started":2,"wal-append.queue_time_us":951024}
I20260709 13:10:05.670503 26305 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.718093 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:05.720614 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 72020.2us
W20260709 13:10:05.684708 25932 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.017s	sys 0.041s
W20260709 13:10:05.715844 26351 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.034s	sys 0.103s
W20260709 13:10:05.722836 26193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.050s	sys 0.101s
W20260709 13:10:05.723132 26351 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.034s	sys 0.103s
I20260709 13:10:05.637204 25978 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.723718 26358 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:05.724539 25953 consensus_meta.cc:287] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
W20260709 13:10:05.724660 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.725268 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.725462 25978 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:05.655819 23045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.016s
W20260709 13:10:05.727905 23045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.005s	sys 0.017s
W20260709 13:10:05.729862 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 668080us
I20260709 13:10:05.734009 23075 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:05.740804 23045 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:05.745111 26434 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:05.680799 26152 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:05.750352 26152 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.752736 26185 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.753358 26185 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:05.754330 26152 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.747777 26334 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:05.723344 26193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.050s	sys 0.101s
I20260709 13:10:05.757891 26334 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.758260 26442 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:05.761066 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:05.768625 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 51186.9us
I20260709 13:10:05.682755 26021 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:05.701902 26450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.011s	sys 0.012s
I20260709 13:10:05.695390 23002 rpcz_store.cc:276] 0709 13:10:03.559173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.700530 (+141357us) service_pool.cc:224] Handling call
0709 13:10:03.700790 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.701657 (+   867us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:05.019813 (+1318156us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.628239 (+608426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.638814 (+ 10575us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:05.646007 (+  7193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.671774 (+ 25767us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.676873 (+  5099us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74315,"prepare.queue_time_us":575439,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":1891,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4346,"thread_start_us":1766513,"threads_started":2}
I20260709 13:10:05.774766 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:05.801950 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.797796 22924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.027s
W20260709 13:10:05.804512 22924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.008s	sys 0.027s
I20260709 13:10:05.795782 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:05.795006 26450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.012s	sys 0.013s
I20260709 13:10:05.796553 26021 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:05.806792 22926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.005s	sys 0.026s
I20260709 13:10:05.811416 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:05.811982 22926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.005s	sys 0.027s
I20260709 13:10:05.816488 26511 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:05.817121 26511 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.817627 26511 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:05.819267 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:05.817780 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 134415us
I20260709 13:10:05.817857 26358 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:05.818385 22925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.000s	sys 0.030s
I20260709 13:10:05.806702 26205 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:10:05.826501 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 65545.8us
W20260709 13:10:05.827072 22925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.030s
I20260709 13:10:05.814882 26442 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:05.836333 22922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.017s	sys 0.010s
W20260709 13:10:05.840310 22922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.017s	sys 0.010s
I20260709 13:10:05.838248 26014 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.826427 26358 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:05.836345 26185 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:05.840229 26507 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:05.853416 23619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.014s
I20260709 13:10:05.844367 26007 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:05.872334 23619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.007s	sys 0.014s
I20260709 13:10:05.842063 26407 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:05.853224 23620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.000s	sys 0.021s
I20260709 13:10:05.860411 22929 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:10:05.878150 23620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.000s	sys 0.021s
W20260709 13:10:05.883761 22928 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.023s
W20260709 13:10:05.884879 22928 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.012s	sys 0.023s
I20260709 13:10:05.863232 26358 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:05.894528 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 496440us
I20260709 13:10:05.899016 26507 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:05.899636 26507 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.902367 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.902899 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:05.903611 23075 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:05.905210 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:05.905277 23075 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:05.905985 23079 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:05.881505 26460 consensus_meta.cc:287] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.813s	user 0.012s	sys 0.000s
I20260709 13:10:05.878070 26407 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:05.877707 26007 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:05.914855 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.918846 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.927424 22895 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.929652 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.917716 26407 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.917471 26007 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.935485 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:05.936563 23073 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:05.941942 26510 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:05.942692 26510 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:05.941028 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 889302us
I20260709 13:10:05.946664 22895 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.915148 26460 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:05.958711 22972 leader_election.cc:400] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12.
I20260709 13:10:05.959167 22972 leader_election.cc:403] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.924961 26014 consensus_queue.cc:1059] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:05.943593 26334 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:05.962940 22970 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.003s	sys 0.022s
W20260709 13:10:05.976125 22970 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.003s	sys 0.024s
W20260709 13:10:05.976930 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 741821us
I20260709 13:10:05.979528 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.989583 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:05.989828 26478 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.373s	user 0.012s	sys 0.032s
W20260709 13:10:05.990309 26478 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.012s	sys 0.033s
I20260709 13:10:05.990358 22930 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:05.991479 26420 consensus_queue.cc:1059] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:10:05.992686 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.993335 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.994555 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:05.995285 22924 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:05.995774 26516 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:10:05.996354 26508 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:10:05.997311 26460 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:05.998409 26152 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:05.998996 26514 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:06.001173 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:05.991520 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.949862 26510 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:06.007939 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.045012 22926 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:05.960872 26458 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.022s	sys 0.014s
I20260709 13:10:06.012372 26007 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.030891 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:05.999806 26426 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.032110 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2239) took 2113 ms. Trace:
I20260709 13:10:05.974941 25996 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.032240 26479 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.015002 26507 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:06.037156 26021 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.040477 26460 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:06.041081 26528 raft_consensus.cc:993] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: : Instructing follower 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:10:06.041639 26523 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:06.032384 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 53526.9us
I20260709 13:10:06.048897 23076 rpcz_store.cc:276] 0709 13:10:03.919156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.112049 (+1192893us) service_pool.cc:224] Handling call
0709 13:10:05.498146 (+386097us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b5800212798. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5e9c 00007f3921ee5a5b 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:10:05.498459 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:05.499149 (+   690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.499200 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:05.500148 (+   948us) log.cc:844] Serialized 52 byte log entry
0709 13:10:05.834544 (+334396us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:05.841660 (+  7116us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.841967 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.842078 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.031819 (+189741us) raft_consensus.cc:1685] finished
0709 13:10:06.031900 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.032054 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14617,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":20063,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9192,"spinlock_wait_cycles":19056128,"thread_start_us":333872,"threads_started":1,"wal-append.queue_time_us":527843}
W20260709 13:10:06.052675 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 72812.1us
I20260709 13:10:05.937189 26185 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
W20260709 13:10:06.086301 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 439760us
W20260709 13:10:06.052584 26458 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.022s	sys 0.014s
I20260709 13:10:06.045457 26334 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:06.049372 26437 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.091360 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.094614 26007 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.097482 26528 raft_consensus.cc:1081] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Signalling peer 216ff6323e434e399d196d8ba262c8f3 to start an election
I20260709 13:10:06.089182 26523 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:06.097869 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.100036 26482 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:06.053423 25996 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.100421 26507 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:06.093587 26426 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:06.104656 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:06.105530 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.107312 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 73526.4us
W20260709 13:10:06.108642 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 170218us
I20260709 13:10:06.112279 22926 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:06.084203 26442 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.123366 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.124897 23046 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:06.126368 22927 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:06.128976 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 187110us
I20260709 13:10:06.117655 26205 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.117650 26437 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.148502 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:06.148725 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44204.7us
I20260709 13:10:06.087499 26460 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.157203 23074 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:06.158463 23076 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 4.
I20260709 13:10:06.158551 26152 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12.
I20260709 13:10:06.159373 26152 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.138458 25996 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.152619 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.153236 26531 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.153048 26334 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:06.155793 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.182331 23075 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:06.156143 26407 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.156940 26014 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.138582 26007 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.151542 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2345) took 1041 ms. Trace:
I20260709 13:10:06.161286 23077 raft_consensus.cc:2368] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10.
I20260709 13:10:06.172112 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.174517 26358 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.176333 26507 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:06.183497 23073 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:06.148434 26430 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.148268 26437 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.120363 26522 consensus_queue.cc:1059] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:10:06.164400 26152 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.145834 26511 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.216403 23071 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:06.212407 23621 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:06.194104 22922 rpcz_store.cc:276] 0709 13:10:05.110564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.119128 (+  8564us) service_pool.cc:224] Handling call
0709 13:10:05.183000 (+ 63872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.222898 (+ 39898us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:05.842217 (+619319us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.147001 (+304784us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.147055 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:06.151230 (+  4175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.151319 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.151476 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":296635,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":833499,"threads_started":2}
I20260709 13:10:06.184438 26014 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:06.150484 26205 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.229462 26358 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.230127 26460 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:06.231869 22895 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:06.232758 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:06.234836 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.235361 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.236234 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.236720 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.238611 26407 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.213146 26507 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:06.240413 26507 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.241740 26507 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.243167 26482 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:06.245385 23074 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:06.246646 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.248153 22926 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:06.249428 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:06.249917 26524 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:06.250134 23075 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:06.197317 26007 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:06.252192 26007 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:06.252472 26153 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:06.252875 26153 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:06.253760 26153 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:06.255105 26153 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.255733 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:06.255913 22925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2349) took 1102 ms. Trace:
I20260709 13:10:06.256948 26511 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:06.193573 26531 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.260165 26531 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:06.225929 26014 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.262063 26541 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:06.262599 26541 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:06.263456 26541 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:06.264159 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.266690 26205 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.267132 26007 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:06.215471 26430 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.267635 26007 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:06.268020 26430 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.223631 26021 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.268626 26007 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.235478 22924 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:06.218806 26152 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:06.288825 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.256338 22925 rpcz_store.cc:276] 0709 13:10:05.153167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.162809 (+  9642us) service_pool.cc:224] Handling call
0709 13:10:05.163408 (+   599us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:05.211582 (+ 48174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.211619 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:05.232376 (+ 20757us) log.cc:844] Serialized 532 byte log entry
0709 13:10:05.836840 (+604464us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:05.836904 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.837118 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.255712 (+418594us) raft_consensus.cc:1685] finished
0709 13:10:06.255731 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.255857 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":760,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":23989,"thread_start_us":603986,"threads_started":1,"wal-append.queue_time_us":852962}
W20260709 13:10:06.299535 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 115444us
W20260709 13:10:06.329263 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.346824 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 228797us
I20260709 13:10:06.319152 26531 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.357949 26543 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.365512 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:06.369927 23002 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:10:06.365901 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:06.374925 23004 raft_consensus.cc:2410] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:06.377257 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1927) took 1200 ms. Trace:
W20260709 13:10:06.383307 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 238441us
W20260709 13:10:06.384114 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 127557us
I20260709 13:10:06.353646 26531 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.377800 22928 rpcz_store.cc:276] 0709 13:10:05.176666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.371395 (+194729us) service_pool.cc:224] Handling call
0709 13:10:05.371757 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.372090 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:05.886325 (+514235us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.376865 (+490540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.376931 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:06.376991 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.377071 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.377198 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12691,"prepare.queue_time_us":164427,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":128975,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":931838,"threads_started":3,"wal-append.queue_time_us":270836}
I20260709 13:10:06.392306 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:06.393968 23046 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:06.375361 26537 raft_consensus.cc:3055] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:06.395916 26537 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:06.396895 26537 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.398226 26537 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:06.400015 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.400869 22925 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.403017 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.374460 26557 consensus_queue.cc:1059] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:06.360354 26511 consensus_queue.cc:1059] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:06.408973 26482 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:06.361531 26460 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:06.409400 26483 raft_consensus.cc:3055] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:06.409544 26482 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:06.409960 26483 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:06.410645 26482 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.410854 26483 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.412114 26483 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:06.412191 23005 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.419849 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:06.400081 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:06.420634 22999 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:06.362265 25996 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.423784 22997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "defec66b69804f8c85671fbdd904172d"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
 from {username='slave'} at 127.0.0.1:41504
I20260709 13:10:06.424422 22997 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.424760 22997 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:06.425066 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.426978 25996 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.389868 26531 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.428934 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:06.430171 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:06.430723 23002 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:10:06.432126 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.436702 22925 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:06.432415 23621 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:06.444383 22997 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.456897 23006 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:06.458833 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 92677.2us
I20260709 13:10:06.366041 26437 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:06.459081 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 51598.5us
I20260709 13:10:06.482122 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:06.512321 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 65548.4us
W20260709 13:10:06.471095 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 82548.2us
I20260709 13:10:06.464697 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.464232 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:06.520265 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 136279us
I20260709 13:10:06.523873 22997 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.525730 22972 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:06.568993 22924 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:06.486295 26533 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:10:06.532598 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:06.563396 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.485343 26536 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
I20260709 13:10:06.525210 26205 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:06.566502 22928 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:06.483541 26543 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.581664 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.465071 26483 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:06.588575 23073 raft_consensus.cc:2368] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:10:06.590129 22922 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:06.505831 26549 raft_consensus.cc:3055] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:06.584626 23002 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
W20260709 13:10:06.568362 26550 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:06.587942 22923 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:06.598740 26358 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:06.598987 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.600970 26523 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.602130 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.612339 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.494912 26430 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:06.603838 23076 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:06.604405 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.578970 26300 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:06.605304 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.582515 26531 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.605968 26014 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.606549 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.618687 23072 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:06.619069 22926 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:06.607969 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.562120 26537 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:06.602834 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.616813 22931 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:06.616851 23045 connection.cc:256] RPC call timeout handler was delayed by -1.1977167799999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:10:06.588698 26483 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.617242 26358 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.621654 23075 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:10:06.612140 22929 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:06.650962 22927 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:06.626287 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.627249 26430 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:06.627777 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.628093 26523 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.628711 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.632017 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.632099 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:06.614885 26557 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:10:06.633028 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.633708 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.634217 26531 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:06.635895 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.636363 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:06.599550 26479 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:06.639923 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.593005 26543 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.688988 26152 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.691113 26152 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.610229 26549 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:06.692287 26549 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.688627 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.694271 22928 raft_consensus.cc:2410] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:10:06.695006 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.653285 23071 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:06.653791 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.659832 26450 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:10:06.681435 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.682235 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.683013 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:06.726284 23075 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.683143 26014 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.684316 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:06.691423 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:06.727756 23080 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:06.704094 23074 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:06.704532 23072 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:06.651383 26483 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.738425 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:06.740025 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 122669us
I20260709 13:10:06.741348 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.743291 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.747156 23071 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:06.750337 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.742226 26407 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:06.755559 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.755807 26407 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.756191 26407 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:06.756610 22931 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:06.756716 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.757843 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.757987 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:06.758502 23078 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:06.758749 23071 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:06.759457 23078 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:06.760202 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.768420 23621 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:06.767601 26450 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:06.774780 22929 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:06.741541 26430 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.785259 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 163911us
I20260709 13:10:06.783375 23622 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:06.811791 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.773912 26450 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:06.815196 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.784543 26193 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:06.776006 26479 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:10:06.822813 22926 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:06.828114 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.827230 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.821991 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:06.828923 23650 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:06.824545 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.836362 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.837770 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.834288 23649 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:06.845800 23075 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:06.847877 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 202838us
I20260709 13:10:06.835175 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.818665 26300 raft_consensus.cc:697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:06.849033 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 77217.7us
I20260709 13:10:06.820377 26511 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.792586 26430 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:06.851270 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:06.888990 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 67076.2us
I20260709 13:10:06.876080 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.893092 22929 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:06.894747 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:06.836787 26531 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.895551 23652 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:06.833263 26437 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:06.897471 23622 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:06.898168 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.899863 23649 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:06.937408 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:06.855341 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.956712 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.931088 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:06.956704 22929 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:06.849185 26507 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.976233 23650 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:10:06.976943 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 84930.3us
I20260709 13:10:06.992462 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:06.998059 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:06.998709 22997 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.999398 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:06.904930 26193 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:06.836341 26561 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:06.934161 26531 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.076615 23649 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:07.099068 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.000120 23651 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
W20260709 13:10:07.002554 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 109880us
I20260709 13:10:07.002478 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:07.076337 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 56333.4us
W20260709 13:10:07.111994 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.120086 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.129686 22925 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:07.129806 26193 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.130642 26407 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.066074 26205 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:10:07.134239 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:07.136258 26205 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:07.136689 26205 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:07.137050 26205 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:07.021216 26571 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:10:07.138309 26571 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:07.138675 26571 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:07.139391 26571 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:07.140751 26571 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:07.131337 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:06.835618 26420 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:10:06.996739 26511 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:07.106470 26570 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:07.136092 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:07.066155 26554 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:10:07.087252 26537 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.149063 23654 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:07.021672 26507 raft_consensus.cc:2764] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:07.159530 23656 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:07.163717 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.151232 23622 leader_election.cc:336] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.898s (SENT)
I20260709 13:10:07.072963 26185 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:07.133229 26407 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:07.167491 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.171303 23622 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:07.170301 26576 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.166091 26574 raft_consensus.cc:2764] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:07.178262 26531 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:07.178812 26568 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:10:07.181324 26460 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:07.182993 26567 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.450s	user 0.001s	sys 0.005s
I20260709 13:10:07.185694 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.196880 23650 raft_consensus.cc:2368] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
I20260709 13:10:07.187984 22970 leader_election.cc:400] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10.
I20260709 13:10:07.197252 22970 leader_election.cc:403] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.188699 23649 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:07.194941 23080 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:07.196219 26511 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:07.196390 26460 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:06.977365 26450 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.209980 22997 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:07.211751 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:07.220171 23652 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:07.223094 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.225042 23649 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:07.033092 26300 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.172106 26537 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.147737 26561 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:07.191301 26185 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:07.237365 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 119135us
W20260709 13:10:07.239542 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 77694.4us
I20260709 13:10:07.225134 26574 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.236690 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.224150 26450 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:07.244781 22972 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:07.250525 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:07.236207 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.252521 23650 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:07.194736 26576 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:07.259182 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 108006us
I20260709 13:10:07.258306 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:07.259771 22922 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:07.260699 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:07.260743 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:07.246888 26542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.025s	sys 0.006s
I20260709 13:10:07.265091 23076 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:07.266217 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.245260 26458 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.263710 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:07.225318 26483 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:07.265151 26542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.026s	sys 0.006s
I20260709 13:10:07.269176 23653 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 5. Ops: []
I20260709 13:10:07.268119 23077 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:07.270493 26483 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:07.281059 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:07.283192 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.249135 26482 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:07.335992 26482 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.338404 23074 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:07.339242 23074 raft_consensus.cc:2410] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:07.286615 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.311157 26152 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:07.348438 26152 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.348827 26152 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.349553 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.349762 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.350500 23005 raft_consensus.cc:2410] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:07.351612 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.352051 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.352370 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.352843 23006 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.355966 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:07.313010 23622 leader_election.cc:336] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.613s (SENT)
I20260709 13:10:07.352042 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:07.356787 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 43832.9us
W20260709 13:10:07.358333 23622 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.631s (SENT)
I20260709 13:10:07.358865 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:07.315452 26581 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:07.316776 26458 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.320557 26185 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:07.212734 26460 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:07.344326 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 61938.1us
I20260709 13:10:07.356029 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.364634 23003 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:10:07.362830 26458 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:07.366775 23000 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:07.312773 26537 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:07.428457 23079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2250) took 1516 ms (client timeout 1777 ms). Trace:
I20260709 13:10:07.442348 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.429064 23071 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:07.484563 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.342521 26572 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:07.485981 26572 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.417423 26543 consensus_meta.cc:287] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:10:07.486387 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.485234 22997 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:07.264434 26557 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.440819 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:07.430119 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.508397 23652 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
W20260709 13:10:07.493099 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.442833 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.448695 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.430886 23078 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:07.457559 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.428375 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.417236 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:07.480923 23622 leader_election.cc:336] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.716s (SENT)
I20260709 13:10:07.390991 23651 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:07.456202 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.430243 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:07.500597 23079 rpcz_store.cc:269] 0709 13:10:05.912510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.918157 (+  5647us) service_pool.cc:224] Handling call
0709 13:10:07.428276 (+1510119us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b540010c054. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:07.428402 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194295552}
I20260709 13:10:07.486521 26572 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:07.446853 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:07.517472 23076 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.508482 23006 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
W20260709 13:10:07.524875 26541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.024s	sys 0.018s
W20260709 13:10:07.525405 26541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.024s	sys 0.018s
W20260709 13:10:07.526978 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.408272 26152 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:07.533581 26460 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.516263 23648 raft_consensus.cc:2376] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10. Re-sending same reply.
I20260709 13:10:07.533934 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.534837 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:07.534943 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.535238 26152 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:07.369634 26205 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:07.536164 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.570053 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 45632.3us
I20260709 13:10:07.570289 23075 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.573743 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.367210 26193 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:07.536164 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.516242 23649 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:07.573210 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:07.576359 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 95487us
W20260709 13:10:07.587381 23622 leader_election.cc:336] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.918s (SENT)
I20260709 13:10:07.576305 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.571352 23621 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:07.577041 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.587956 23622 leader_election.cc:336] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.977s (SENT)
I20260709 13:10:07.588433 23651 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:07.587590 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.588011 23652 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:07.590790 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.591929 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.403162 26576 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:07.593231 23656 raft_consensus.cc:2393] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:07.486639 26543 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.601653 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.603464 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.605801 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 148369us
I20260709 13:10:07.616304 23078 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:07.616472 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:07.613094 23075 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:07.617420 23649 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.617713 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.612807 23006 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:10:07.585711 26482 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:07.621084 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.621878 23651 raft_consensus.cc:2410] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:07.622076 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.628463 22997 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:07.573118 26562 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:10:07.630170 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.634713 22928 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:07.639930 23005 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.640837 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.674186 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 215273us
I20260709 13:10:07.648413 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.729138 26574 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10.
I20260709 13:10:07.607982 26583 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:07.723069 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.629495 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.784263 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.679232 22896 connection.cc:256] RPC call timeout handler was delayed by -1.9378256790000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 13:10:07.791034 22999 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:07.816905 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.817660 23003 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:07.783908 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.824796 26594 log.cc:927] Time spent T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:10:07.826599 26591 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:10:07.827450 26592 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:10:07.798750 26430 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:07.831763 26543 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:07.835850 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.840057 22997 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.838092 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.858444 23006 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:07.845974 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:07.847296 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:07.789345 22971 consensus_peers.cc:597] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5adc1058fd2948e382bcd0ee2213ab3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.859459 23080 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:07.859524 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 70343.4us
I20260709 13:10:07.837395 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.865170 23005 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
W20260709 13:10:07.866130 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 178226us
I20260709 13:10:07.821224 23652 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
W20260709 13:10:07.877638 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 57399.2us
I20260709 13:10:07.878827 23006 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:10:07.879747 22929 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:07.676466 26205 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:07.886643 23080 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:07.882813 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:07.892715 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:07.893280 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:07.893489 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:07.893863 22931 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:07.894148 22926 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:07.883873 22925 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:07.893252 22924 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.899438 22922 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:07.902523 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:07.903031 22971 connection.cc:256] RPC call timeout handler was delayed by -1.2022882129999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 13:10:07.788560 26540 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:10:07.907732 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.908344 23652 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:10:07.908391 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:07.863096 26583 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:07.906858 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:07.909389 23080 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.904390 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:07.910938 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.911188 22997 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:07.912482 23621 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:07.914149 23005 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:07.887717 26185 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.922588 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:07.924443 23006 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:07.926682 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.934211 22971 connection.cc:256] RPC call timeout handler was delayed by -1.1212882129999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:10:07.934312 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:07.936574 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 416119us
I20260709 13:10:07.939208 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:07.901974 26483 consensus_queue.cc:1059] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:07.939805 23073 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:07.922659 26537 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:07.942361 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:07.944870 22930 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:07.943217 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.928172 26511 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:07.905577 26571 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:07.954509 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:07.956642 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:07.959685 22929 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:07.994247 23073 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:07.926049 26479 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:10:07.914145 26460 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:07.936455 26430 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:07.997653 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 75791.5us
I20260709 13:10:07.999396 23005 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:07.995748 23076 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:07.934577 26561 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:08.003990 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:07.946633 26334 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:08.014925 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.016104 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:08.000512 22896 connection.cc:256] RPC call timeout handler was delayed by -1.7686256790000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:10:08.016964 22896 connection.cc:256] RPC call timeout handler was delayed by -1.6975256790001367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 13:10:08.017426 22896 connection.cc:256] RPC call timeout handler was delayed by -1.4464256790000718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24280000000000002s for a response
W20260709 13:10:07.947167 26450 consensus_meta.cc:287] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.000s
I20260709 13:10:07.928705 26185 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:07.961359 26562 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.993772 26358 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:08.020440 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1007) took 1190 ms. Trace:
I20260709 13:10:08.027009 23005 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:08.023443 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:08.019817 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 137078us
I20260709 13:10:08.024391 23657 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:08.020655 23652 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:08.026486 23654 rpcz_store.cc:276] 0709 13:10:06.821075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.821306 (+   231us) service_pool.cc:224] Handling call
0709 13:10:08.010842 (+1189536us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54005e01d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:08.010949 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717038336}
I20260709 13:10:08.033310 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2374) took 1213 ms. Trace:
I20260709 13:10:08.034379 22931 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:08.035323 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.033677 22927 rpcz_store.cc:276] 0709 13:10:06.820030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.023120 (+1203090us) service_pool.cc:224] Handling call
0709 13:10:08.032864 (+  9744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.033021 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.033048 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.033086 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.033115 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.033167 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.033263 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.041383 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:08.043025 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.046545 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.049431 26511 raft_consensus.cc:697] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:08.052822 22931 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:08.058598 23655 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:08.021358 26430 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:08.073685 26430 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:08.060381 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.074609 23654 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 13: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:08.075691 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.075949 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:08.076246 23654 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:08.076489 23652 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:08.077111 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.077621 23654 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:08.078346 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.078933 23654 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:08.080420 26598 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:10:08.061142 23649 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:08.011103 26537 consensus_queue.cc:1059] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:08.046370 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.030056 26460 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:08.064136 26601 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:08.069883 26608 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:08.052146 26450 consensus_queue.cc:1059] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:08.081540 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:08.050197 26583 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.029857 26562 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:08.082708 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.054174 23080 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
W20260709 13:10:08.083247 22971 leader_election.cc:336] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.708s (SENT)
W20260709 13:10:08.085507 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 70648.9us
I20260709 13:10:08.091838 22930 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:08.079564 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.113029 23654 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:08.063136 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.097798 23652 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:08.096318 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.026103 26334 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:08.039430 26612 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.108726 26185 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:08.116154 22927 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
W20260709 13:10:08.117769 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 54733.3us
W20260709 13:10:08.118809 26602 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:08.119891 26543 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:08.124246 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.142199 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:08.142706 23652 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:08.125023 26511 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.050060 26420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41496 (request call id 17) took 13669 ms. Trace:
W20260709 13:10:08.125983 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 96417.7us
I20260709 13:10:08.111116 22971 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:08.113279 22895 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:08.127911 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 81641.4us
W20260709 13:10:08.140478 26572 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.005s
I20260709 13:10:08.132797 26614 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:08.132813 26616 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:08.102815 26460 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:08.168637 26562 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:08.169847 26460 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.103482 26618 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:08.179217 23078 raft_consensus.cc:2955] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 8 to 10, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:08.142007 26543 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:08.131567 26430 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:08.132696 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:08.163300 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:08.163890 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50668.3us
W20260709 13:10:08.166379 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.167505 26619 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:08.167626 26334 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:08.168145 26576 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:08.168598 26606 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:08.238723 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.226167 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 214886us
I20260709 13:10:08.250306 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:08.250770 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:08.234935 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 62065.7us
I20260709 13:10:08.199156 22924 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:10:08.234853 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 151620us
I20260709 13:10:08.168744 26616 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:08.249871 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.246750 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:08.252746 22971 leader_election.cc:336] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.751s (SENT)
I20260709 13:10:08.252874 23651 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:08.246541 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:08.254223 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:08.254786 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 91549.6us
I20260709 13:10:08.254972 23076 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:08.256583 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:08.256662 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.257282 23076 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:08.257419 22927 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
W20260709 13:10:08.257529 22971 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.767s (SENT)
I20260709 13:10:08.255708 23045 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.257939 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:08.258719 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.258791 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.256594 23075 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:08.259930 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:08.255313 23046 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:08.261147 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:08.261790 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:08.267041 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.262673 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:08.232609 26614 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:08.262353 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:08.127002 26608 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.266409 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:08.249982 26543 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.267550 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:08.140588 26612 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:08.252445 26541 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.287865 26612 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:08.288475 26612 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:08.288060 26541 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:08.290617 26541 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:08.291275 26623 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:08.293363 26623 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:08.294783 22928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 807) took 1697 ms (client timeout 2011 ms). Trace:
W20260709 13:10:08.295365 22928 rpcz_store.cc:269] 0709 13:10:06.597804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.694793 (+ 96989us) service_pool.cc:224] Handling call
0709 13:10:08.294552 (+1599759us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54001c9b54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:08.294701 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159364352}
I20260709 13:10:08.271373 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.262782 26185 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.272053 26521 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.273626 23080 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.269330 23073 raft_consensus.cc:2368] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
I20260709 13:10:08.317948 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.318673 23649 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:08.266073 26460 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:08.321491 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 51770.2us
I20260709 13:10:08.275952 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.277817 23648 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:08.261951 26582 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:08.268725 26621 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.278529 26608 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:08.267179 26562 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.281181 26537 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:08.281980 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:08.332957 23075 raft_consensus.cc:2410] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:08.332883 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:08.284659 26557 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.003s
I20260709 13:10:08.285121 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:08.285655 22971 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.029s (SENT)
I20260709 13:10:08.337762 23071 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:08.270972 23651 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:10:08.341141 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.341674 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.342686 23651 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:08.319730 23654 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:08.319993 23079 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:08.271426 22895 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:08.358722 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 87395.7us
I20260709 13:10:08.359586 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:08.361192 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:08.323526 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.323846 23077 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:08.322924 23648 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:08.270841 26614 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:08.293565 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.343878 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:08.388927 22924 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:08.299973 23076 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:08.219467 26572 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:08.377213 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.397199 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.390036 22927 raft_consensus.cc:2393] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:08.396198 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 126287us
I20260709 13:10:08.399091 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1013) took 1502 ms. Trace:
W20260709 13:10:08.405488 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 111983us
I20260709 13:10:08.409644 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:08.329785 26185 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:08.403167 23653 rpcz_store.cc:276] 0709 13:10:06.896320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.896445 (+   125us) service_pool.cc:224] Handling call
0709 13:10:07.071306 (+174861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.269516 (+198210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.398781 (+1129265us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001b8854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:08.399016 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454588672}
I20260709 13:10:08.412660 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.319566 26430 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:10:08.329514 26621 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:08.420094 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 134456us
W20260709 13:10:08.420936 22971 leader_election.cc:336] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.072s (SENT)
I20260709 13:10:08.421388 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.418318 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:08.419399 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 149058us
I20260709 13:10:08.330519 26582 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:08.291363 26543 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.396194 26358 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:08.396685 26541 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:08.323462 26576 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 13:10:08.480967 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 81984.7us
I20260709 13:10:08.481235 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:08.563606 23620 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.564117 23654 raft_consensus.cc:2393] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:10:08.564148 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 201944us
I20260709 13:10:08.565523 22895 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:08.565680 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.566679 23654 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:08.567119 23654 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:08.567328 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.494509 23080 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:08.534382 23651 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:08.537092 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1034) took 1108 ms. Trace:
I20260709 13:10:08.568046 23654 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.569312 23655 rpcz_store.cc:276] 0709 13:10:07.428299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.428550 (+   251us) service_pool.cc:224] Handling call
0709 13:10:08.536908 (+1108358us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540044d9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:08.537029 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734555392}
I20260709 13:10:08.570515 23654 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:08.543721 23000 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:08.543267 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 62742us
I20260709 13:10:08.407533 26608 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:08.551740 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 130834us
W20260709 13:10:08.575714 22971 leader_election.cc:336] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.119s (SENT)
W20260709 13:10:08.551824 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 277465us
I20260709 13:10:08.556340 23649 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 8. Ops: []
I20260709 13:10:08.577183 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 965) took 1118 ms. Trace:
I20260709 13:10:08.291435 26616 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.409499 26557 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.424431 23648 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:08.561553 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 299815us
W20260709 13:10:08.482993 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 64770.4us
I20260709 13:10:08.573258 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 968) took 1069 ms. Trace:
I20260709 13:10:08.543264 26511 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.577555 23649 rpcz_store.cc:276] 0709 13:10:07.458375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.425168 (+966793us) service_pool.cc:224] Handling call
0709 13:10:08.556110 (+130942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.576947 (+ 20837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.577125 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.294843 26623 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.578896 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 967) took 1116 ms. Trace:
I20260709 13:10:08.580916 23046 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:08.576519 22971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.799s (SENT) [suppressed 57 similar messages]
I20260709 13:10:08.611686 23653 rpcz_store.cc:276] 0709 13:10:07.462829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.465665 (+1002836us) service_pool.cc:224] Handling call
0709 13:10:08.555175 (+ 89510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.572934 (+ 17759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.572960 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.573001 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:08.578692 (+  5691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.578755 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.578848 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:08.612298 22971 leader_election.cc:336] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.202s (SENT)
I20260709 13:10:08.612733 22971 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:08.549140 26540 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.553828 26571 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:08.429504 26621 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.557608 26185 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:08.588784 23651 rpcz_store.cc:276] 0709 13:10:07.503588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.440765 (+937177us) service_pool.cc:224] Handling call
0709 13:10:08.533845 (+ 93080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.572953 (+ 39108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.573192 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.481403 26562 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.153s
I20260709 13:10:08.422338 26606 consensus_queue.cc:1059] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.163s
I20260709 13:10:08.572305 26626 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.576082 26618 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.627948 23648 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.634778 23002 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:08.639459 26537 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:10:08.629360 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:08.623108 26616 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:08.643716 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 92059.5us
I20260709 13:10:08.659116 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:08.670768 22931 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:08.144661 26420 rpcz_store.cc:276] 0709 13:09:54.354185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.354360 (+   175us) service_pool.cc:224] Handling call
0709 13:09:54.470498 (+116138us) log.cc:844] Serialized 506 byte log entry
0709 13:09:55.887229 (+1416731us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b58007805d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f74090 00007f3924f6443c 00007f3924f6ad53 00007f3924f6acd9 00007f3924f6ac69 00007f3924f6ac31 00007f3924f69dfd 000000000038f354 000000000038f199 00007f3921f1d475 00007f3921f1f7c1
0709 13:10:08.012611 (+12125382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62479,"raft.queue_time_us":873181,"raft.run_cpu_time_us":21321,"raft.run_wall_time_us":902569,"spinlock_wait_cycles":231344384,"thread_start_us":703158,"threads_started":3,"wal-append.queue_time_us":515704,"wal-append.run_cpu_time_us":1807,"wal-append.run_wall_time_us":1099213}
I20260709 13:10:08.648252 26626 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.618604 26608 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:10:08.672312 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 106937us
I20260709 13:10:08.686832 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:08.688006 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:08.688436 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 100031us
I20260709 13:10:08.688369 23076 raft_consensus.cc:1240] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:08.660211 26430 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:08.695304 23622 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:08.698015 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 147438us
I20260709 13:10:08.682196 26557 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.686084 26626 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:08.712644 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 53643.5us
I20260709 13:10:08.715708 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:08.692381 26511 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.668519 26632 consensus_queue.cc:1059] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:08.718529 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.692109 26430 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.678372 26358 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:08.720213 26627 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:08.720597 26622 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:08.720935 26625 log.cc:927] Time spent T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:10:08.721181 26637 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.721385 26631 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:08.723454 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.715255 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 147983us
I20260709 13:10:08.728796 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.733946 22927 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:10:08.734562 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.742867 26632 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:08.745378 26632 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:08.745733 26632 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.747344 23654 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:08.734711 22922 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:08.741786 26636 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.724573 26430 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:08.753305 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.756902 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.682179 26582 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.756407 26618 raft_consensus.cc:3055] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:08.752672 26636 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:08.752748 26631 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:08.786607 22896 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.742374 26614 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:08.778193 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 127169us
I20260709 13:10:08.713631 26185 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:08.836007 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:08.814319 26639 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:08.789821 26618 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:08.776355 26635 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.783630 26648 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:08.816399 26571 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:08.818710 26627 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:08.819617 26622 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:08.819872 26636 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:08.844323 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 57796.5us
W20260709 13:10:08.848910 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 120211us
I20260709 13:10:08.851519 23006 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:08.846496 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 156877us
W20260709 13:10:08.854635 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.857681 23006 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:08.859172 22896 connection.cc:256] RPC call timeout handler was delayed by -1.4413016409999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2548s for a response
I20260709 13:10:08.842976 26614 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.853756 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.846657 26648 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.866761 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:08.848676 26622 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.866870 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:08.868186 22998 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:08.865792 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:08.870843 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:08.848035 26541 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:08.872342 26193 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:10:08.874524 26630 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:08.875815 26576 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:08.876420 26631 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.879731 26647 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:10:08.882359 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:08.864825 26639 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:08.895484 22926 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:08.899842 22971 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:08.888141 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:08.911134 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.915795 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 44994.9us
I20260709 13:10:08.867848 26648 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:08.881991 26638 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:08.922989 23648 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
W20260709 13:10:08.925262 23648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1037) took 1496 ms (client timeout 1922 ms). Trace:
W20260709 13:10:08.920420 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 70614.4us
I20260709 13:10:08.923318 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:08.923631 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 63844.8us
I20260709 13:10:08.897802 26543 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:08.882167 26622 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:08.926679 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:08.925652 23648 rpcz_store.cc:269] 0709 13:10:07.429087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.534590 (+105503us) service_pool.cc:224] Handling call
0709 13:10:08.277711 (+743121us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b54004d79a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f81dc0 00007f392500de18 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6
0709 13:10:08.925208 (+647497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56515968}
I20260709 13:10:08.908728 26510 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:08.934163 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 177339us
I20260709 13:10:08.935593 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.914199 26639 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:08.893354 26606 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:10:08.934327 26523 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:10:08.962342 26642 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:08.893630 26618 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:08.911989 26420 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:10:08.967316 26460 consensus_meta.cc:287] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.638s	user 0.004s	sys 0.003s
I20260709 13:10:08.962915 26642 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:09.046557 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 164272us
I20260709 13:10:08.957718 26630 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:08.997151 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2248) took 1115 ms. Trace:
I20260709 13:10:08.816882 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:09.049135 23072 rpcz_store.cc:276] 0709 13:10:07.881733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.934644 (+ 52911us) service_pool.cc:224] Handling call
0709 13:10:07.944318 (+  9674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.082327 (+138009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.082354 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.082392 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:08.082421 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.996915 (+914494us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540042c7d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:08.996963 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.997100 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317005696}
I20260709 13:10:09.052282 22970 leader_election.cc:400] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
I20260709 13:10:09.052624 22970 leader_election.cc:403] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:09.000104 26541 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:08.972669 22877 auto_rebalancer.cc:629] Failed to schedule move for tablet a0fd26ed0b904e01959f5f0d30437e69: Illegal state: Replica b655449a388a41e3a606c6ea794825ad is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:08.985423 26653 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:08.973506 23620 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:08.995803 26655 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:08.957670 26635 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.957199 26571 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:08.936254 26638 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:08.862280 26358 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:10:08.983350 26658 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:08.937801 26644 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:08.957852 26639 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:08.989176 23000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2155) took 1546 ms (client timeout 1777 ms). Trace:
I20260709 13:10:08.977088 26649 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:09.119761 26649 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.120651 26649 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:09.121857 26649 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:08.960243 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:09.123970 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 163798us
I20260709 13:10:09.125218 26450 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:09.125571 26450 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.125922 26450 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:08.969872 26621 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.126065 26511 consensus_queue.cc:1059] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:09.127108 26511 consensus_queue.cc:1059] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:09.127974 26621 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.129235 26616 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.036458 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 136709us
I20260709 13:10:09.129675 26511 raft_consensus.cc:3055] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:09.130157 26511 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:09.046686 26612 consensus_meta.cc:287] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.758s	user 0.002s	sys 0.008s
I20260709 13:10:09.131945 26612 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:09.053843 26636 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:09.114650 23000 rpcz_store.cc:269] 0709 13:10:07.442803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.508826 (+ 66023us) service_pool.cc:224] Handling call
0709 13:10:08.988951 (+1480125us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540030f2d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:08.989094 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958266112}
W20260709 13:10:09.046617 26619 consensus_meta.cc:287] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.776s	user 0.006s	sys 0.002s
I20260709 13:10:09.142700 26619 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:09.060614 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 88499.2us
I20260709 13:10:09.061057 26460 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.072088 26642 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.053560 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:09.144917 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 91418.3us
W20260709 13:10:09.075340 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.147063 22926 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:09.048909 26630 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:09.110543 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:09.058149 26647 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
I20260709 13:10:09.115864 26641 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:09.160204 23073 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:09.154685 26572 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.072412 26420 raft_consensus.cc:2955] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:09.157200 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 46716.4us
I20260709 13:10:09.157209 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.158689 26606 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:09.158836 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:09.117413 26430 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.130960 26511 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.155306 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:09.162946 23620 leader_election.cc:400] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
W20260709 13:10:09.162181 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.163344 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.162662 22972 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.167711 26483 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:09.170614 23003 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:09.216742 23620 leader_election.cc:403] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:09.217765 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.219033 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.219607 23004 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:10:09.220428 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.221442 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:09.226060 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 675) took 1353 ms. Trace:
I20260709 13:10:09.228971 26636 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.214810 26612 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.230250 26557 raft_consensus.cc:3055] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:09.230171 26612 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.230656 26557 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.231451 26557 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.226446 23078 rpcz_store.cc:276] 0709 13:10:07.872472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.875891 (+  3419us) service_pool.cc:224] Handling call
0709 13:10:08.178848 (+302957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.179070 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:08.317622 (+138552us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.839454 (+521832us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.839510 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:08.839566 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.839635 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.225280 (+385645us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800444e80. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921eeb2a6 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4
0709 13:10:09.225901 (+   621us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540038a4d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:09.226006 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":480,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4352,"spinlock_wait_cycles":681900800,"thread_start_us":439510,"threads_started":1,"wal-append.queue_time_us":586810}
I20260709 13:10:09.053427 26626 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.153726 26549 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:09.237238 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 74649.9us
I20260709 13:10:09.237272 22998 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:09.237991 22998 pending_rounds.cc:85] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 5
I20260709 13:10:09.238229 22998 pending_rounds.cc:107] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:09.238435 22998 raft_consensus.cc:2889] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:09.239596 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 78056.2us
I20260709 13:10:09.239737 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.239444 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.161294 26630 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.232477 26557 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:09.240689 23074 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:09.241690 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.242900 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:09.163012 26619 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:09.253696 26014 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:09.265959 26014 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:09.266852 26014 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.267853 26648 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.234246 26483 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:09.269011 22929 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:09.269791 23077 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:09.256167 26612 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.258832 26639 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.242930 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.271037 23001 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:09.168936 26641 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.243048 26636 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:10:09.273087 22931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2394) took 1171 ms. Trace:
I20260709 13:10:09.273490 22931 rpcz_store.cc:276] 0709 13:10:08.101514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.130886 (+ 29372us) service_pool.cc:224] Handling call
0709 13:10:08.132268 (+  1382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.678510 (+546242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.272896 (+594386us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54000ce9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:09.273037 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237978368}
I20260709 13:10:09.273640 26450 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.278179 26612 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:09.279721 26543 raft_consensus.cc:3055] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:09.280005 26613 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:09.280071 26543 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:09.280874 26613 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.282425 26612 consensus_queue.cc:1059] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:09.284418 22999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1876) took 1934 ms (client timeout 1667 ms). Trace:
I20260709 13:10:09.284476 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:09.288898 22931 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:09.280045 23002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1871) took 1931 ms (client timeout 1761 ms). Trace:
W20260709 13:10:09.289752 23002 rpcz_store.cc:269] 0709 13:10:07.348771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.351754 (+  2983us) service_pool.cc:224] Handling call
0709 13:10:09.279889 (+1928135us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000b9fd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:09.279982 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899349760}
W20260709 13:10:09.293819 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 55424.9us
W20260709 13:10:09.303026 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.162163 26634 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.147s
W20260709 13:10:09.288724 22999 rpcz_store.cc:269] 0709 13:10:07.350323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.357002 (+  6679us) service_pool.cc:224] Handling call
0709 13:10:09.284271 (+1927269us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000ef6d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:09.284354 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637473536}
I20260709 13:10:09.296226 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:09.253510 26664 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
W20260709 13:10:09.318493 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 74957.1us
I20260709 13:10:09.319428 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.320082 26450 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.320712 26450 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.241864 26606 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.321300 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.321364 26656 consensus_queue.cc:1059] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:09.314702 26637 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.322451 26656 raft_consensus.cc:3055] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:09.322826 26656 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:09.322638 26637 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.322885 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.324043 26655 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:09.324753 26637 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.332213 26606 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.336799 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.083875 26653 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.129719 26616 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.252828 26511 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:09.338095 23002 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
W20260709 13:10:09.338419 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 140817us
I20260709 13:10:09.355470 26616 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.357101 23621 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:09.310011 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:09.343300 22931 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:09.346658 23005 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:10:09.351405 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 55259.5us
I20260709 13:10:09.284574 26613 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:09.376402 26573 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.377022 26573 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.379168 26573 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.381278 26620 raft_consensus.cc:3055] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:09.381682 26620 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:09.382571 26620 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.336781 26630 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.387212 26630 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.387831 23075 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:09.388959 26626 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.389856 26540 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:09.390293 26540 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.390648 26540 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:09.394912 26632 consensus_meta.cc:287] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 13:10:09.242156 26608 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:09.403297 26650 consensus_queue.cc:1059] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:09.395459 26632 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.404484 26650 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:09.404894 26650 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.405774 26650 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.406725 26632 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.409560 26653 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.411281 26637 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:09.415056 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50348.9us
W20260709 13:10:09.416875 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 59865.1us
W20260709 13:10:09.417886 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 107977us
I20260709 13:10:09.416092 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.420035 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.422274 26450 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:09.422732 26655 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:09.422791 23076 raft_consensus.cc:2955] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:09.424547 23657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1004) took 2610 ms (client timeout 1708 ms). Trace:
W20260709 13:10:09.425542 23650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 976) took 1793 ms (client timeout 1542 ms). Trace:
W20260709 13:10:09.463294 23650 rpcz_store.cc:269] 0709 13:10:07.631735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.425348 (+1793613us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:09.425462 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:09.426867 22926 raft_consensus.cc:1240] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:09.427266 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.464437 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.427380 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:09.466034 22927 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:09.363193 26656 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.428078 26543 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.428812 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:09.430299 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:09.435201 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 74962.2us
I20260709 13:10:09.441140 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.442734 23001 raft_consensus.cc:1240] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:09.444231 26483 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.440656 26635 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.445613 26562 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:09.433099 26637 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.447499 26615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.006s	sys 0.002s
I20260709 13:10:09.448024 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 803) took 1637 ms. Trace:
I20260709 13:10:09.498653 22997 rpcz_store.cc:276] 0709 13:10:07.810957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.178337 (+367380us) service_pool.cc:224] Handling call
0709 13:10:08.178638 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.278987 (+100349us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:08.522685 (+243698us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.726644 (+203959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.726709 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.726766 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.447800 (+721034us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54003aaa54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:09.447848 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.447968 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8038,"prepare.queue_time_us":212,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":101251,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"spinlock_wait_cycles":230297472,"thread_start_us":366448,"threads_started":3,"wal-append.queue_time_us":156842}
W20260709 13:10:09.500443 22971 leader_election.cc:336] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.590s (SENT)
I20260709 13:10:09.500870 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.450874 26653 consensus_queue.cc:1059] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:09.432933 26626 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.456347 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:09.504451 22931 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:09.407291 26650 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:09.462720 23657 rpcz_store.cc:269] 0709 13:10:06.813705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.818387 (+  4682us) service_pool.cc:224] Handling call
0709 13:10:09.424345 (+2605958us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54005e1ad4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:09.424445 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692750720}
W20260709 13:10:09.469129 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53140.2us
I20260709 13:10:09.474206 23003 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:09.475438 22929 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:09.481703 22924 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:09.487202 23006 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:09.496109 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.496822 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:09.475708 26583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.190s	user 0.025s	sys 0.047s
W20260709 13:10:09.512610 26583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.025s	sys 0.047s
I20260709 13:10:09.474329 26616 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:09.462127 26655 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.513278 26655 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.513388 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:09.513867 26608 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:09.510887 22930 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:09.512751 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.517719 26562 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:09.518093 26562 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.518852 26562 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.521139 26645 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:09.521440 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 978) took 1842 ms (client timeout 1551 ms). Trace:
I20260709 13:10:09.508116 26637 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:09.521857 23656 rpcz_store.cc:269] 0709 13:10:07.678901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.837148 (+158247us) service_pool.cc:224] Handling call
0709 13:10:09.521271 (+1684123us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b540063d8d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:09.521375 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3807644928}
I20260709 13:10:09.523365 26637 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.523715 26644 raft_consensus.cc:3055] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:09.524075 26644 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.524914 26644 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.526216 26644 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:09.527844 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.511248 26430 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.509986 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.485400 26656 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.536924 22924 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:09.553637 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 53211.6us
W20260709 13:10:09.557776 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50185.9us
I20260709 13:10:09.563370 26616 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:09.564806 26655 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.567049 26655 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.567588 26637 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:09.569957 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:09.573452 23620 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.573642 22924 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
W20260709 13:10:09.498464 26615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.006s	sys 0.002s
I20260709 13:10:09.577852 22930 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:09.578034 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.578804 23077 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
W20260709 13:10:09.574252 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45066.3us
I20260709 13:10:09.582370 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:09.583546 22895 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:09.586360 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.579236 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:09.595383 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.585253 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.596678 23075 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:09.597749 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.601186 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.601660 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:09.602283 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.569808 26483 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.561033 26645 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.612115 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:09.349197 26638 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.615247 23074 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:09.630513 23657 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:09.593918 26562 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.635143 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.636519 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.596226 26637 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.491087 26622 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.638132 23652 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:09.515575 26613 consensus_queue.cc:1059] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:10:09.598110 26205 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.603443 26571 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:09.642241 23654 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:09.600337 26583 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:09.647154 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.647001 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.651692 26670 raft_consensus.cc:3055] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:09.651887 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.652133 26670 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:09.652438 23656 raft_consensus.cc:2376] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10. Re-sending same reply.
I20260709 13:10:09.653280 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.652972 26670 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.653779 23656 raft_consensus.cc:2376] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10. Re-sending same reply.
I20260709 13:10:09.654150 26670 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.654546 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.655194 23656 raft_consensus.cc:2368] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
I20260709 13:10:09.596194 26555 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:10:09.659336 23077 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:09.660841 26613 raft_consensus.cc:3055] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:09.661276 26613 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:09.629779 26608 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.612325 26541 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:09.666038 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.666380 26583 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:09.666642 23654 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:09.667485 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.667320 26583 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.667980 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:09.668851 23078 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:09.665187 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:09.596083 26614 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:10:09.668077 23654 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:09.661401 26648 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:09.603776 26153 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:10:09.681695 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.673205 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.691535 22926 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:09.691968 22926 pending_rounds.cc:85] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 5
I20260709 13:10:09.691171 23071 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:09.692255 22926 pending_rounds.cc:107] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:09.692982 22926 raft_consensus.cc:2889] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.663341 26571 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.695778 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.696710 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.697541 23077 raft_consensus.cc:2393] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:09.703962 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.704370 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.705451 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:09.706104 23071 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.720463 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.721426 23654 raft_consensus.cc:2410] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:10:09.695472 26642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.006s	sys 0.051s
I20260709 13:10:09.726568 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.727201 23654 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:09.728191 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 250145us
I20260709 13:10:09.739823 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:09.739722 26562 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:09.740999 26153 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.741801 26555 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:09.743532 26645 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:09.744377 26606 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:09.744912 23654 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:09.744918 26606 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.746443 26606 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.749675 26620 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:09.750748 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.751821 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.752082 26606 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.753986 26666 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:09.754390 26666 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.757805 26543 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.761523 22928 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:09.762416 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:09.763449 23077 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:09.763763 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.764868 22998 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:09.765728 23075 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:09.752435 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.763499 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:09.768534 26632 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:09.769037 26632 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:09.769502 26632 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:09.774879 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.781594 26616 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:09.785121 26153 raft_consensus.cc:3055] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:09.785543 26153 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:09.786388 26153 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.787580 26153 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:09.793902 22829 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 372) took 20178 ms (client timeout 15000 ms). Trace:
I20260709 13:10:09.796052 22928 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:09.798072 26014 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:09.798352 26555 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:09.798661 26014 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:09.801033 26014 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.802003 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.752764 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:09.815425 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 85065.2us
W20260709 13:10:09.816020 22896 leader_election.cc:336] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.024s (SENT)
I20260709 13:10:09.816360 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.826476 22971 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:09.703871 26571 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:09.664765 26205 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.839879 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.677572 26608 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:09.726794 26642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.006s	sys 0.051s
I20260709 13:10:09.840765 23654 raft_consensus.cc:2410] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:09.835517 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:09.860705 22997 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.850733 23620 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.855930 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:09.856305 26674 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:10:09.856401 26616 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:09.857473 26014 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:09.858476 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:09.859107 26619 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:09.861548 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:09.892462 23656 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.862411 22998 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:09.863298 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.863888 22930 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:09.893657 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.874930 26656 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:09.794800 22829 rpcz_store.cc:269] 0709 13:09:49.615280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.615592 (+   312us) service_pool.cc:224] Handling call
0709 13:10:09.793612 (+20178020us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:01.731154 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:01.860153 (+128999us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:01.860217 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:10:01.860241 (+    24us) tablet.cc:662] Decoding operations
0709 13:10:01.895741 (+ 35500us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:01.895783 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:01.895851 (+    68us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:10:01.896808 (+   957us) tablet.cc:701] Row locks acquired
0709 13:10:01.896821 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:10:01.896970 (+   149us) write_op.cc:270] Start()
0709 13:10:01.897082 (+   112us) write_op.cc:276] Timestamp: P: 1783602601896924 usec, L: 0
0709 13:10:01.897100 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:10:01.897860 (+   760us) log.cc:844] Serialized 4780 byte log entry
0709 13:10:04.532650 (+2634790us) op_driver.cc:464] REPLICATION: finished
0709 13:10:05.545655 (+1013005us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3921f000ac 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3928a40ef0
0709 13:10:06.105623 (+559968us) write_op.cc:301] APPLY: starting
0709 13:10:06.105762 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:06.106116 (+   354us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:06.106156 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:06.230415 (+124259us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:06.230843 (+   428us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:10:06.230894 (+    51us) write_op.cc:312] APPLY: finished
0709 13:10:06.231339 (+   445us) log.cc:844] Serialized 89 byte log entry
0709 13:10:06.405001 (+173662us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:06.405224 (+   223us) write_op.cc:454] Released schema lock
0709 13:10:06.405288 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:06.405830 (+   542us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:06.405861 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3853664,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":1572606,"apply.run_cpu_time_us":12646,"apply.run_wall_time_us":300213,"num_ops":12,"prepare.queue_time_us":141040,"prepare.run_cpu_time_us":36627,"prepare.run_wall_time_us":1580899,"raft.queue_time_us":1147506,"raft.run_cpu_time_us":46152,"raft.run_wall_time_us":1458606,"replication_time_us":2635386,"spinlock_wait_cycles":11153280,"thread_start_us":4145038,"threads_started":5,"wal-append.queue_time_us":1454856,"wal-append.run_cpu_time_us":132241,"wal-append.run_wall_time_us":3284919}]]}
I20260709 13:10:09.879626 26608 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:09.868075 26655 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.497681 26635 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.881296 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:09.902436 22931 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:09.755148 26666 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:09.884063 26450 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.886595 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:09.886848 26639 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:09.888175 26672 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:10:09.888062 26618 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.873610 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:09.912144 26616 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.895714 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:09.904193 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:09.909201 22997 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:09.913527 23073 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:09.914425 22972 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:10.027324 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:10.027612 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 113281us
I20260709 13:10:10.028076 23654 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
W20260709 13:10:09.990510 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.859745 26358 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:09.995364 23074 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:10.010114 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.010516 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.015403 23080 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:09.866058 26664 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:10.008759 23657 raft_consensus.cc:2376] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6. Re-sending same reply.
W20260709 13:10:10.020978 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 134433us
I20260709 13:10:10.029130 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:10.036260 23653 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:10.041993 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:09.904817 26555 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:10:09.860929 26613 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.062528 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.025581 26612 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:10.064805 23652 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
W20260709 13:10:10.035302 26623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.011s	sys 0.029s
I20260709 13:10:10.025537 26655 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.086898 23654 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:10.038360 26608 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:10.127818 26608 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:10.128122 26679 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:10:10.128211 26608 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.136698 26608 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:10.126746 26639 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:10.137742 26540 consensus_meta.cc:287] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.003s
I20260709 13:10:10.138185 26540 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:10.144809 26622 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.095290 26664 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:10.146725 26664 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:10.147946 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.149566 26639 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.149431 26612 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:10.149677 22827 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 7 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 8 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:10.095628 26185 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.005s	sys 0.020s
W20260709 13:10:10.151065 26185 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.005s	sys 0.020s
I20260709 13:10:10.125927 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:10.151950 23654 raft_consensus.cc:2376] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9. Re-sending same reply.
I20260709 13:10:10.058411 26666 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.150272 26639 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:10.126693 26684 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:10.019336 26450 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.160758 23071 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
W20260709 13:10:10.155959 26615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.017s	sys 0.019s
I20260709 13:10:10.059064 26641 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:10.164671 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:10.151775 22827 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:10.167343 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 125376us
W20260709 13:10:10.125808 26623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.011s	sys 0.029s
I20260709 13:10:10.174242 23654 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:10.135205 26632 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:10.177686 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.199939 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.200775 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2281) took 1042 ms. Trace:
W20260709 13:10:10.174199 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.18957e+06us
I20260709 13:10:10.225545 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.203238 23079 rpcz_store.cc:276] 0709 13:10:09.158339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.159095 (+   756us) service_pool.cc:224] Handling call
0709 13:10:09.159450 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.169134 (+  9684us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:09.169168 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.169598 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.497267 (+327669us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:09.497309 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.497376 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.200491 (+703115us) raft_consensus.cc:1685] finished
0709 13:10:10.200536 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.200709 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2892,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":60115,"spinlock_wait_cycles":11520,"thread_start_us":243774,"threads_started":1,"wal-append.queue_time_us":391230}
I20260709 13:10:10.226584 22997 raft_consensus.cc:2376] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8. Re-sending same reply.
I20260709 13:10:10.229269 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.231170 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:10.233251 22827 catalog_manager.cc:5697] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 3 to 6, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 6 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:10.243638 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:10.244627 23006 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:10.246443 22925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.023s
I20260709 13:10:10.244706 22827 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 5 to 7, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 7 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:10.246872 22925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.011s	sys 0.023s
I20260709 13:10:10.262694 22997 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:10:10.264216 23045 leader_election.cc:336] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.200s (SENT)
I20260709 13:10:10.266927 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:10.202390 26631 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.151420 26612 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.226649 26543 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:10.175850 26615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.017s	sys 0.020s
I20260709 13:10:10.290807 22827 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:10.304355 23045 leader_election.cc:336] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.252s (SENT)
W20260709 13:10:10.292618 22926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.025s
I20260709 13:10:10.304796 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:10.305157 22926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.006s	sys 0.025s
I20260709 13:10:10.284924 26631 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:10.322286 26644 consensus_meta.cc:287] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.796s	user 0.008s	sys 0.000s
W20260709 13:10:10.322952 26678 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.481s	user 0.001s	sys 0.001s
I20260709 13:10:10.323418 26631 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:10.324193 26540 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:10.325232 26682 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:10:10.171515 26622 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:10.285629 26635 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:10.326413 26622 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.327730 26543 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:10.328694 26622 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.329622 26543 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.159682 26655 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.303644 26621 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:10.311924 26690 ts_tablet_manager.cc:933] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:10.316816 26632 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:10.317425 22827 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 6 to 8, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 8 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:10.316810 26420 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.000s
I20260709 13:10:10.320468 26482 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:10.333662 26680 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:10.333192 22827 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:10.257098 26358 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:10.335922 26358 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:10.336177 22971 leader_election.cc:400] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
I20260709 13:10:10.336294 26358 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.336556 22971 leader_election.cc:403] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:10.255961 26620 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.337754 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:10.320708 26450 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.368198 23654 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:10.370489 22971 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:10.373878 22971 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:10.339098 26637 consensus_meta.cc:287] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.003s
I20260709 13:10:10.372017 22827 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:10.373059 26572 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:10.369424 26620 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.336568 26608 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.367007 26540 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8.
W20260709 13:10:10.415746 23075 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.008s	sys 0.018s
I20260709 13:10:10.397683 22827 catalog_manager.cc:5697] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 5, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
W20260709 13:10:10.416280 23075 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.018s
W20260709 13:10:10.400950 23656 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.000s
I20260709 13:10:10.383728 26562 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:10.410310 26650 consensus_meta.cc:287] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.879s	user 0.006s	sys 0.002s
I20260709 13:10:10.411983 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:10.395721 26637 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:10.413895 26688 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 13:10:10.413971 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:10.383963 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.417004 23656 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:10.470129 22927 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.455946 23621 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:10.457388 22999 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:10.386255 26511 consensus_meta.cc:287] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 1.019s	user 0.009s	sys 0.000s
I20260709 13:10:10.379182 26616 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.395637 26620 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:10.460309 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.463135 22827 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.482903 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:10.464558 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 43953.4us
I20260709 13:10:10.384267 26644 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:10.466511 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:10.419363 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.485834 22924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.009s	sys 0.021s
W20260709 13:10:10.486160 22924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.009s	sys 0.021s
I20260709 13:10:10.486359 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:10.486575 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.459111 22998 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:10.473889 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:10.487339 23653 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
W20260709 13:10:10.476445 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.476331 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.476046 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.392495 26639 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.417358 26562 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:10.464531 26689 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.179s	user 0.000s	sys 0.002s
I20260709 13:10:10.503482 26655 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:10.470259 26645 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:10.504263 26645 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:10.506337 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.506474 26645 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:10.485502 26483 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:10.508270 26650 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.508956 26650 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:10.509512 26637 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:10.510043 26637 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:10.511114 26650 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.510840 26637 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.512419 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.513537 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:10.388383 26571 consensus_meta.cc:287] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:10:10.484396 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:10.518920 22998 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:10.520249 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:10.476002 26634 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:10.421250 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:10.488406 23000 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:10.488713 23073 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:10.527370 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:10.528311 23074 raft_consensus.cc:2393] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:10.384909 26572 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:10.489408 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:10.522434 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.529186 23002 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:10.490370 22827 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 7 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 8 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:10.491905 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:10.527369 23076 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.009s	sys 0.010s
I20260709 13:10:10.485795 26626 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:10.533943 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.424949 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.535960 23656 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:10.496124 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:10.514357 23652 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:10.508185 22971 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:10.517479 22997 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:10:10.382640 26670 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:10:10.528133 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:10.482532 23651 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:10.530345 23657 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:10:10.531339 23076 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.009s	sys 0.010s
I20260709 13:10:10.542009 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.542310 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:10.543044 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.515877 26562 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:10.521795 23003 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.013s	sys 0.012s
W20260709 13:10:10.559705 23003 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.012s
I20260709 13:10:10.559880 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:10.561789 23655 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.012s
W20260709 13:10:10.563459 23655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.008s	sys 0.012s
I20260709 13:10:10.562391 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:10.565413 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:10.565811 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:10.526752 26618 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:10.563788 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:10.566795 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.568135 23000 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:10.561652 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:10.565992 23077 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:10.570729 23077 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:10.530623 26572 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.574381 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:10.574570 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.575335 23653 raft_consensus.cc:2410] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:10.543601 26626 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.543355 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:10.556356 26644 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:10.645882 26644 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:10.646325 26644 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.561703 26615 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:10.647977 26615 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.650517 26615 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:10.622292 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2288) took 1205 ms. Trace:
I20260709 13:10:10.526348 26571 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:10.654348 26571 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.541757 26642 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:10.573089 26670 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.621863 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:10.626820 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 52501.8us
I20260709 13:10:10.534525 26608 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:10:10.656606 23657 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:10.628997 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:10.629647 26549 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.660122 22997 raft_consensus.cc:606] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:10.659734 26549 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:10.660672 26608 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.661490 26608 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:10.661929 26549 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:10.662536 22997 raft_consensus.cc:614] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:10.668735 26632 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:10.530628 26683 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:10.672838 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:10.673846 26632 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:10.674814 26642 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.675410 26632 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:10.675343 26642 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.675941 26632 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:10.676437 26632 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:10.677527 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:10.678153 26642 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:10.678418 26643 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:10.679864 23648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.004s	sys 0.050s
W20260709 13:10:10.680367 23648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.004s	sys 0.050s
I20260709 13:10:10.680322 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:10.561151 26655 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:10:10.578344 26618 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:10.577188 26014 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:10.561414 26616 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:10:10.686944 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1042) took 1087 ms. Trace:
I20260709 13:10:10.688757 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682d24a2200c4222a401f9ab803af214"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
W20260709 13:10:10.765865 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.752441 26697 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:10:10.745249 23649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.018s	sys 0.071s
I20260709 13:10:10.728510 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:10.738792 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:10.738881 26700 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:10:10.817600 23648 rpcz_store.cc:276] 0709 13:10:09.599224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.599357 (+   133us) service_pool.cc:224] Handling call
0709 13:10:09.599696 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.599927 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.599952 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.638043 (+ 38091us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.031739 (+393696us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.681073 (+649334us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.686647 (+  5574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.686725 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.686767 (+    42us) raft_consensus.cc:1685] finished
0709 13:10:10.686778 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.686893 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29777,"prepare.queue_time_us":285297,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":45545,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":903723,"threads_started":2,"wal-append.queue_time_us":662806}
I20260709 13:10:10.747165 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:10.825750 23649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.021s	sys 0.082s
I20260709 13:10:10.533785 26634 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:10.689003 26688 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:10.737633 26683 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.686846 22929 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:10.621946 26483 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:10.739070 26699 log.cc:927] Time spent T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:10:10.725551 22827 catalog_manager.cc:5697] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 3 to 4, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 4 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.817836 22997 raft_consensus.cc:606] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:10.839740 22997 raft_consensus.cc:614] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:10.824420 26620 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.818898 23045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.031s
W20260709 13:10:10.841969 23045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.005s	sys 0.031s
W20260709 13:10:10.827090 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 98660us
I20260709 13:10:10.618702 26543 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:10.830557 23653 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:10.835230 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1043) took 1234 ms. Trace:
I20260709 13:10:10.845260 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:10.849077 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 827) took 1161 ms. Trace:
I20260709 13:10:10.832545 26643 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:10.849901 23653 rpcz_store.cc:276] 0709 13:10:09.697966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.732546 (+1034580us) service_pool.cc:224] Handling call
0709 13:10:10.849009 (+116463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.832389 26670 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:10.840703 26420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.019s	sys 0.019s
W20260709 13:10:10.755720 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.020s
I20260709 13:10:10.860136 22927 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:10.862262 22926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 829) took 1078 ms. Trace:
I20260709 13:10:10.860257 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:10.865144 23648 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.866334 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:10.867323 22827 catalog_manager.cc:5697] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 2 to 3, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 3 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.862728 22926 rpcz_store.cc:276] 0709 13:10:09.783664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.783819 (+   155us) service_pool.cc:224] Handling call
0709 13:10:09.784099 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.784403 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.784431 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.784834 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.306960 (+522126us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.307038 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.307194 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.862021 (+554827us) raft_consensus.cc:1685] finished
0709 13:10:10.862046 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.862197 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1140,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":520800,"threads_started":1,"wal-append.queue_time_us":772140}
I20260709 13:10:10.870440 23650 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:10.874042 22927 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:10.880440 22929 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:10.846714 26543 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:10.877390 26708 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.883582 26702 log.cc:927] Time spent T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:10:10.883675 26358 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.000s
I20260709 13:10:10.851297 26620 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.884914 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:10.885030 26618 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.887085 26706 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.872730 22827 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 3 to 5, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:10.869501 26420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.019s	sys 0.019s
I20260709 13:10:10.880976 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 687) took 1215 ms. Trace:
W20260709 13:10:10.869907 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.013s	sys 0.020s
I20260709 13:10:10.880030 26655 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.859977 26648 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.924916 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:10.925225 23080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.013s
W20260709 13:10:10.973044 23080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.003s	sys 0.013s
I20260709 13:10:10.930684 23648 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:10.932145 22827 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 9 to 10, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 10 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:10.845849 26483 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.845901 26683 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:10.937736 22925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2405) took 1362 ms. Trace:
W20260709 13:10:10.924085 26688 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:10.853982 26643 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:10.944458 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:10.986868 22999 raft_consensus.cc:606] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:10.877257 26703 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:10.899364 26543 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.934419 23072 rpcz_store.cc:276] 0709 13:10:09.665826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.667235 (+  1409us) service_pool.cc:224] Handling call
0709 13:10:09.667535 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.692839 (+ 25304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.692870 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.713217 (+ 20347us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.235204 (+521987us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:10.759456 (+524252us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.760775 (+  1319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.760871 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.880778 (+119907us) raft_consensus.cc:1685] finished
0709 13:10:10.880797 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.880922 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97130,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":1891,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":16024,"thread_start_us":888285,"threads_started":2,"wal-append.queue_time_us":703623}
I20260709 13:10:10.974165 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 835) took 1142 ms. Trace:
I20260709 13:10:10.993319 23648 rpcz_store.cc:276] 0709 13:10:09.831805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.842902 (+1011097us) service_pool.cc:224] Handling call
0709 13:10:10.974087 (+131185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.994588 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:10.995185 23648 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:10.973927 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 353933us
W20260709 13:10:10.934180 26690 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.019s	sys 0.033s
I20260709 13:10:10.979857 22925 rpcz_store.cc:276] 0709 13:10:09.575404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.591923 (+ 16519us) service_pool.cc:224] Handling call
0709 13:10:09.612102 (+ 20179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.612411 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.612445 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.640937 (+ 28492us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.252466 (+611529us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:10.252531 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.252622 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.937456 (+684834us) raft_consensus.cc:1685] finished
0709 13:10:10.937484 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.937651 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2394,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6905,"thread_start_us":581507,"threads_started":1,"wal-append.queue_time_us":841987}
I20260709 13:10:10.934839 26631 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.998353 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:10.977212 26634 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.033907 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1040) took 1436 ms. Trace:
I20260709 13:10:11.034330 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.035264 23072 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:10:11.012177 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 993) took 1187 ms. Trace:
I20260709 13:10:11.036163 23652 rpcz_store.cc:276] 0709 13:10:09.824323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.460068 (+635745us) service_pool.cc:224] Handling call
0709 13:10:11.012027 (+551959us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b540044cd54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:11.012129 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71781120}
I20260709 13:10:11.036937 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:11.037405 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:11.037812 23621 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:10.978327 26655 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.038857 23653 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:10.980391 26608 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.042186 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:11.042868 23006 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:11.043622 26620 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:11.007079 26710 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:10:11.007802 26701 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:10:11.008473 26704 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:10:11.009167 26713 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:11.010389 23622 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:11.071260 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 60944us
I20260709 13:10:11.072096 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1048) took 1441 ms. Trace:
I20260709 13:10:11.012171 26205 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:11.072844 26583 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.073117 22924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1976) took 1201 ms. Trace:
I20260709 13:10:11.073280 26583 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.073729 26583 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.073975 26638 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.074476 26638 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.073591 22924 rpcz_store.cc:276] 0709 13:10:09.871300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.871473 (+   173us) service_pool.cc:224] Handling call
0709 13:10:09.871852 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.883890 (+ 12038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.883920 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.884416 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.486463 (+602047us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:10.486499 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.486558 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.072888 (+586330us) raft_consensus.cc:1685] finished
0709 13:10:11.072912 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.073055 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11669,"raft.queue_time_us":16393,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":601708,"threads_started":1,"wal-append.queue_time_us":949790}
I20260709 13:10:10.990412 26643 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:10.995991 26703 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:10.847311 23649 rpcz_store.cc:276] 0709 13:10:09.600471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.600604 (+   133us) service_pool.cc:224] Handling call
0709 13:10:09.632052 (+ 31448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.640153 (+  8101us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:10.057558 (+417405us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.831052 (+773494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.831288 (+   236us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:10.834924 (+  3636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.835015 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.835163 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":642940,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1632,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":12139,"thread_start_us":1052102,"threads_started":2}
I20260709 13:10:10.651247 23076 rpcz_store.cc:276] 0709 13:10:09.417234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.417798 (+   564us) service_pool.cc:224] Handling call
0709 13:10:09.422480 (+  4682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.422684 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:09.496149 (+ 73465us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.413341 (+917192us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:10.571906 (+158565us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.575203 (+  3297us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.575625 (+   422us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.577124 (+  1499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.577184 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:10.577247 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.622070 (+ 44823us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.622227 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3703,"prepare.queue_time_us":435359,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":3267,"raft.queue_time_us":47330,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":93911,"spinlock_wait_cycles":141020032,"thread_start_us":940051,"threads_started":2,"wal-append.queue_time_us":704441}
I20260709 13:10:11.084403 23648 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:10.934945 26358 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:11.020615 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.048563 26619 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:11.022310 26631 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.025574 26666 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.027387 26642 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:11.029814 26683 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:11.031993 26676 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 1.310s	user 0.002s	sys 0.009s
I20260709 13:10:11.032383 26483 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.037724 26644 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.040810 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:10.933468 26708 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.034296 23650 rpcz_store.cc:276] 0709 13:10:09.597379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.597483 (+   104us) service_pool.cc:224] Handling call
0709 13:10:11.033757 (+1436274us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54005e01d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:11.033856 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039974656}
I20260709 13:10:11.043830 26637 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.052150 22896 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:11.043520 26623 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.998149 26690 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.019s	sys 0.033s
W20260709 13:10:11.036942 26698 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:10.941506 26706 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.072467 23651 rpcz_store.cc:276] 0709 13:10:09.630323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.634870 (+  4547us) service_pool.cc:224] Handling call
0709 13:10:11.071954 (+1437084us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400646ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:11.072046 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941910272}
I20260709 13:10:11.125469 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:11.127063 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.041028 26664 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.072451 23001 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:11.131253 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:11.081729 23074 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:11.082338 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.047995 26634 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.085225 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:11.088536 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.136519 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:11.021658 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.099247 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.104945 22931 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:10:11.056869 26608 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.148747 26706 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.116425 26683 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.097971 26642 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:11.143240 26549 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.133903 23652 raft_consensus.cc:2376] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8. Re-sending same reply.
W20260709 13:10:11.114449 26612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.004s	sys 0.026s
W20260709 13:10:11.136905 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.999359 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 154812us
I20260709 13:10:11.137997 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.096868 26616 consensus_queue.cc:1059] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:10:11.144208 23648 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:11.144302 23656 raft_consensus.cc:2410] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:11.137475 23651 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:11.116513 26637 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.143513 23649 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
W20260709 13:10:11.166108 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.112005 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:11.166667 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 820) took 1480 ms. Trace:
I20260709 13:10:11.166994 23656 rpcz_store.cc:276] 0709 13:10:09.685778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.021398 (+1335620us) service_pool.cc:224] Handling call
0709 13:10:11.166613 (+145215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.151211 26358 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:11.151896 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 693) took 1313 ms. Trace:
I20260709 13:10:11.141695 26639 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.169504 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1062) took 1535 ms. Trace:
I20260709 13:10:11.170058 23651 rpcz_store.cc:276] 0709 13:10:09.634149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.136237 (+1502088us) service_pool.cc:224] Handling call
0709 13:10:11.169453 (+ 33216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.171301 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.169461 23075 rpcz_store.cc:276] 0709 13:10:09.838923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.839026 (+   103us) service_pool.cc:224] Handling call
0709 13:10:09.839328 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:09.852243 (+ 12915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.852285 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:09.852868 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 13:10:10.416616 (+563748us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:10.504547 (+ 87931us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.504937 (+   390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.504999 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.151694 (+646695us) raft_consensus.cc:1685] finished
0709 13:10:11.151714 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.151842 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":731,"prepare.queue_time_us":87521,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":12120,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"thread_start_us":563428,"threads_started":1,"wal-append.queue_time_us":1027508}
I20260709 13:10:11.143283 26664 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.152881 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.154637 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 694) took 1244 ms. Trace:
I20260709 13:10:11.127967 26623 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.100471 26619 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.159184 26549 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.160271 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.160480 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:11.161537 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1962) took 1736 ms. Trace:
I20260709 13:10:11.165016 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:11.190644 23004 raft_consensus.cc:2410] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:11.166064 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 811) took 1489 ms. Trace:
I20260709 13:10:11.191525 23649 rpcz_store.cc:276] 0709 13:10:09.677010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.084438 (+1407428us) service_pool.cc:224] Handling call
0709 13:10:11.166012 (+ 81574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.149272 26608 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:11.135110 26483 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:11.130353 26690 tablet_copy_client.cc:323] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.194:39749
I20260709 13:10:11.172686 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:11.116617 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 64540.7us
W20260709 13:10:11.162746 26612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.026s
I20260709 13:10:11.162882 23045 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:11.102038 26666 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.137101 26655 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:11.208365 26720 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:10:11.208976 26619 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:11.205783 26645 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.209414 26666 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.209784 26645 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:11.210212 26645 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.212628 26644 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:11.213306 26693 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.747s	user 0.001s	sys 0.003s
I20260709 13:10:11.213927 26708 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:11.214483 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1046) took 1602 ms. Trace:
I20260709 13:10:11.214854 23655 rpcz_store.cc:276] 0709 13:10:09.612205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.612651 (+   446us) service_pool.cc:224] Handling call
0709 13:10:09.640148 (+ 27497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.643618 (+  3470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.643644 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.659914 (+ 16270us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.030192 (+370278us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:10.576814 (+546622us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.607418 (+ 30604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.607517 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.212773 (+605256us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:11.214228 (+  1455us) raft_consensus.cc:1685] finished
0709 13:10:11.214313 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.214429 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86743,"prepare.queue_time_us":286642,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":44685,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":27037,"spinlock_wait_cycles":5446912,"thread_start_us":879973,"threads_started":2,"wal-append.queue_time_us":630239}
I20260709 13:10:11.206526 26483 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.216933 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.217662 23655 raft_consensus.cc:2410] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:11.218043 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 834) took 1386 ms. Trace:
I20260709 13:10:11.218330 23655 rpcz_store.cc:276] 0709 13:10:09.831499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.216685 (+1385186us) service_pool.cc:224] Handling call
0709 13:10:11.217990 (+  1305us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:11.219566 26728 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:10:11.163312 26683 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:11.228400 26721 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:11.229712 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:11.230140 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.231570 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.188715 26642 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.232256 23079 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:11.233785 22970 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:11.164047 26706 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:11.190114 22922 rpcz_store.cc:276] 0709 13:10:09.424803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.433015 (+  8212us) service_pool.cc:224] Handling call
0709 13:10:09.446954 (+ 13939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.022787 (+575833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.022830 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.023370 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.485397 (+462027us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:10.485445 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.152489 (+667044us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b54003930d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:11.152536 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.152585 (+    49us) raft_consensus.cc:1685] finished
0709 13:10:11.152597 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.161479 (+  8882us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54546,"raft.queue_time_us":69793,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":14122,"spinlock_wait_cycles":131276160,"thread_start_us":824132,"threads_started":2,"wal-append.queue_time_us":814840}
I20260709 13:10:11.235877 26706 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.240962 26549 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:11.189399 23077 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:11.168862 26637 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:11.243980 26626 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.002s
I20260709 13:10:11.244364 26626 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.172792 26639 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.246222 26639 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.200168 23002 raft_consensus.cc:606] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:11.251920 23002 raft_consensus.cc:614] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:11.255295 26562 consensus_meta.cc:287] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.002s
I20260709 13:10:11.175045 23078 rpcz_store.cc:276] 0709 13:10:09.909936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.910080 (+   144us) service_pool.cc:224] Handling call
0709 13:10:10.009058 (+ 98978us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:10.024140 (+ 15082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.024183 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:10.024817 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 13:10:10.486773 (+461956us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:10.541064 (+ 54291us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.541312 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.541426 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.154376 (+612950us) raft_consensus.cc:1685] finished
0709 13:10:11.154401 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.154531 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39511,"prepare.queue_time_us":74070,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":15769,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":27501,"spinlock_wait_cycles":8028928,"thread_start_us":407740,"threads_started":1,"wal-append.queue_time_us":792313}
I20260709 13:10:11.206453 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.255806 26562 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.256542 23075 raft_consensus.cc:2410] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:11.234114 23076 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:11.260398 23006 raft_consensus.cc:1240] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:11.261852 26562 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:11.262234 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:11.263476 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.264251 23649 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 13: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:11.264994 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.267273 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:11.267925 26205 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.268420 26205 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.268857 26205 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.269181 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:11.202994 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:11.384176 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.275404 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:11.354794 22972 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:11.349486 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:11.172784 23074 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:11.348423 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.390079 23648 raft_consensus.cc:2393] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:11.279336 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 994) took 1454 ms. Trace:
I20260709 13:10:11.390556 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 810) took 1551 ms. Trace:
I20260709 13:10:11.309767 23649 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:11.386379 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.390830 23653 rpcz_store.cc:276] 0709 13:10:09.824630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.884572 (+1059942us) service_pool.cc:224] Handling call
0709 13:10:11.279183 (+394611us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400930154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:11.279279 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255538048}
I20260709 13:10:11.399435 23653 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 13:10:11.346632 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 109298us
I20260709 13:10:11.303901 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.402153 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:11.392575 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.402848 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:11.403126 23651 raft_consensus.cc:2376] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8. Re-sending same reply.
I20260709 13:10:11.403594 23076 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:11.403882 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:11.405308 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 50616.4us
I20260709 13:10:11.408941 22970 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:11.409576 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:11.410430 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.410758 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:11.403609 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1051) took 1772 ms. Trace:
I20260709 13:10:11.411146 22926 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:11.411306 23651 rpcz_store.cc:276] 0709 13:10:09.631170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.296905 (+1665735us) service_pool.cc:224] Handling call
0709 13:10:11.403556 (+106651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.411739 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:11.413162 23648 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 13:10:11.393641 23657 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
W20260709 13:10:11.387260 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 224436us
I20260709 13:10:11.380324 23650 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:11.418612 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 829) took 1720 ms. Trace:
I20260709 13:10:11.419046 23650 rpcz_store.cc:276] 0709 13:10:09.698693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.229453 (+1530760us) service_pool.cc:224] Handling call
0709 13:10:11.418551 (+189098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.402143 23654 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: [5.6-9.8]
W20260709 13:10:11.421778 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.314154 26572 consensus_meta.cc:287] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.001s
I20260709 13:10:11.425530 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:11.192276 26638 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:11.278715 26205 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.393452 23003 rpcz_store.cc:276] 0709 13:10:09.839054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.839151 (+    97us) service_pool.cc:224] Handling call
0709 13:10:09.839467 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:09.846395 (+  6928us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:10.560136 (+713741us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.050690 (+490554us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.057241 (+  6551us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:11.077902 (+ 20661us) log.cc:844] Serialized 52 byte log entry
0709 13:10:11.078039 (+   137us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:11.078075 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.078148 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.148750 (+ 70602us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800467740. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:11.219016 (+ 70266us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:11.278126 (+ 59110us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b1800467740. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d522 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:11.390314 (+112188us) raft_consensus.cc:1685] finished
0709 13:10:11.390342 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.390492 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12386,"prepare.queue_time_us":976270,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":15750,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":13855,"spinlock_wait_cycles":45517824,"thread_start_us":1080458,"threads_started":2,"wal-append.queue_time_us":527070}
I20260709 13:10:11.444314 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:11.444787 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:11.445788 26583 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.447638 26626 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.448716 23016 tablet_copy_service.cc:140] P 216ff6323e434e399d196d8ba262c8f3: Received BeginTabletCopySession request for tablet 5adc1058fd2948e382bcd0ee2213ab3a from peer 01988c2c817947859340a730b7f1247d ({username='slave'} at 127.0.0.1:41504)
I20260709 13:10:11.390240 26608 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.390017 26655 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:10:11.363338 26670 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.386312 26549 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:11.400774 26703 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:11.454010 26623 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.390858 26510 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.452288 23651 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:11.524107 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1063) took 1889 ms. Trace:
I20260709 13:10:11.524412 23651 rpcz_store.cc:276] 0709 13:10:09.634437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.412018 (+1777581us) service_pool.cc:224] Handling call
0709 13:10:11.451973 (+ 39955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.523847 (+ 71874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.524052 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.456902 26639 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.269418 26664 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.327945 26543 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:11.316907 26632 consensus_meta.cc:287] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260709 13:10:11.400444 26642 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.462121 26648 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:11.463807 26732 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:11.463501 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 52816.2us
I20260709 13:10:11.464135 26645 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.465612 26637 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.462886 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:11.592552 23652 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:11.464165 26619 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:11.466394 26573 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.464426 26612 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:11.463631 26358 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:11.467334 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 117937us
I20260709 13:10:11.468227 26643 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.425557 26571 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:11.391501 26613 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.469794 26683 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:11.470113 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.471408 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.474370 22929 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:11.476011 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:11.477386 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.479940 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1060) took 1790 ms. Trace:
I20260709 13:10:11.480366 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1059) took 1766 ms. Trace:
I20260709 13:10:11.523223 26670 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:11.481163 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 72286.1us
I20260709 13:10:11.481256 26650 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:11.481410 22927 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:11.481823 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 75439.4us
I20260709 13:10:11.481958 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.483091 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1065) took 1833 ms. Trace:
I20260709 13:10:11.483983 26706 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:11.484486 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1061) took 1781 ms. Trace:
I20260709 13:10:11.489790 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1049) took 1859 ms. Trace:
W20260709 13:10:11.508018 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 435758us
I20260709 13:10:11.407343 26631 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:11.490671 23016 tablet_copy_service.cc:161] P 216ff6323e434e399d196d8ba262c8f3: Beginning new tablet copy session on tablet 5adc1058fd2948e382bcd0ee2213ab3a from peer 01988c2c817947859340a730b7f1247d at {username='slave'} at 127.0.0.1:41504: session id = 01988c2c817947859340a730b7f1247d-5adc1058fd2948e382bcd0ee2213ab3a
I20260709 13:10:11.561069 23655 raft_consensus.cc:2368] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11.
W20260709 13:10:11.562395 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 146249us
W20260709 13:10:11.562609 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.566800 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 822) took 1880 ms. Trace:
I20260709 13:10:11.636340 23651 rpcz_store.cc:276] 0709 13:10:09.686346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.565833 (+1879487us) service_pool.cc:224] Handling call
0709 13:10:11.566174 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.566425 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.566458 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.566510 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:11.566557 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.566619 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.566738 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.494200 26708 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.590817 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.525730 26623 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.525609 26703 raft_consensus.cc:3055] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:11.603205 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:11.567276 26615 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.488425 26572 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.506596 26608 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:11.617127 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.604038 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.617887 23071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.033s	sys 0.061s
I20260709 13:10:11.651973 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:11.480517 26666 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.525422 26549 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.623380 23656 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:11.610608 26014 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:10:11.625762 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.610507 26358 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.628142 23657 rpcz_store.cc:276] 0709 13:10:09.649232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.416088 (+1766856us) service_pool.cc:224] Handling call
0709 13:10:11.482649 (+ 66561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.482809 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.482832 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.482869 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:11.482904 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.482949 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.483033 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.629456 23648 rpcz_store.cc:276] 0709 13:10:09.633892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.411227 (+1777335us) service_pool.cc:224] Handling call
0709 13:10:11.411500 (+   273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:11.414639 (+  3139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.414882 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.622360 23653 rpcz_store.cc:276] 0709 13:10:09.633370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.398884 (+1765514us) service_pool.cc:224] Handling call
0709 13:10:11.399201 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:11.399905 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.400160 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.630165 22930 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:11.629558 23649 rpcz_store.cc:276] 0709 13:10:09.630632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.394570 (+1763938us) service_pool.cc:224] Handling call
0709 13:10:11.487602 (+ 93032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.489514 (+  1912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.489542 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.489576 (+    34us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:11.489605 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.489654 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.489746 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.622198 23654 rpcz_store.cc:276] 0709 13:10:09.633638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.401336 (+1767698us) service_pool.cc:224] Handling call
0709 13:10:11.401772 (+   436us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:11.420484 (+ 18712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.423957 (+  3473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.634287 22927 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:11.599048 26612 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:11.634605 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.599550 26573 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.603068 26483 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:11.596343 26619 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:11.646621 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.647202 22926 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:11.571197 26632 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:11.651631 23071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.033s	sys 0.061s
I20260709 13:10:11.655334 23650 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:11.629577 26650 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.661599 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1066) took 1831 ms. Trace:
I20260709 13:10:11.836440 23651 rpcz_store.cc:276] 0709 13:10:09.830638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.637452 (+1806814us) service_pool.cc:224] Handling call
0709 13:10:11.637687 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.661188 (+ 23501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.661231 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.661285 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:11.661335 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.661412 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.661540 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19124,"raft.queue_time_us":114131}
I20260709 13:10:11.627463 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 991) took 1927 ms. Trace:
I20260709 13:10:11.837993 23652 rpcz_store.cc:276] 0709 13:10:09.700123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.593128 (+1893005us) service_pool.cc:224] Handling call
0709 13:10:11.619008 (+ 25880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.619164 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.619200 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.627228 (+  8028us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:11.627272 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.627325 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.627417 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.632583 26571 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:11.638891 26620 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.628952 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.676291 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.644501 26703 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:11.703517 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1058) took 2070 ms. Trace:
I20260709 13:10:11.864671 23655 rpcz_store.cc:276] 0709 13:10:09.633105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.218947 (+1585842us) service_pool.cc:224] Handling call
0709 13:10:11.703270 (+484323us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540044d9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:11.703442 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381280640}
I20260709 13:10:11.727591 22925 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:11.705462 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.728214 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.729537 23654 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:11.598059 26732 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:11.743990 22998 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.730674 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:11.753024 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:11.677354 26153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.000s	sys 0.018s
I20260709 13:10:11.730453 26573 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.838688 26650 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.834715 26730 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:11.670565 26666 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.653813 26185 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
W20260709 13:10:11.941038 23620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.093s	sys 0.121s
I20260709 13:10:11.753888 26619 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.941715 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 841) took 1470 ms. Trace:
W20260709 13:10:11.936622 26614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.011s	sys 0.033s
I20260709 13:10:11.651630 26623 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.733932 26612 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.918373 22931 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:11.651424 26615 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:11.836583 26655 consensus_queue.cc:1059] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:10:12.201388 22928 raft_consensus.cc:2393] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:12.178756 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:12.178027 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 517954us
I20260709 13:10:12.178435 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:12.203066 23649 rpcz_store.cc:276] 0709 13:10:10.471714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.758093 (+1286379us) service_pool.cc:224] Handling call
0709 13:10:11.941654 (+183561us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:12.203706 23620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.103s	sys 0.132s
I20260709 13:10:12.203773 23654 pending_rounds.cc:85] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 7
I20260709 13:10:12.242786 23654 pending_rounds.cc:107] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:12.243103 23654 raft_consensus.cc:2889] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:12.174798 26739 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 13:10:12.205183 23074 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:11.969666 22923 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:12.214300 23657 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:12.254565 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1068) took 1788 ms. Trace:
W20260709 13:10:12.217696 26737 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.578s	user 0.000s	sys 0.001s
I20260709 13:10:12.217573 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.218568 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:11.941220 26631 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:12.245311 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:12.262154 22929 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:12.174314 26746 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:10:12.248260 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:12.210287 26543 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.211396 26632 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:11.952059 22827 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.021s	sys 0.025s
W20260709 13:10:12.265678 22827 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.024s	sys 0.029s
W20260709 13:10:12.251017 26735 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.659s	user 0.001s	sys 0.000s
W20260709 13:10:12.173658 26738 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.552s	user 0.001s	sys 0.000s
W20260709 13:10:12.208237 26153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.007s	sys 0.021s
I20260709 13:10:12.254576 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 836) took 2422 ms. Trace:
I20260709 13:10:12.279525 23654 rpcz_store.cc:276] 0709 13:10:09.832071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.728879 (+1896808us) service_pool.cc:224] Handling call
0709 13:10:11.729201 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.254333 (+525132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.254505 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.254985 23657 rpcz_store.cc:276] 0709 13:10:10.466666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.831500 (+1364834us) service_pool.cc:224] Handling call
0709 13:10:12.208644 (+377144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.254350 (+ 45706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.254505 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.174121 23016 tablet_copy_source_session.cc:215] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:12.202608 26614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.022s	sys 0.035s
I20260709 13:10:11.971460 26626 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:12.247339 22896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.012s
W20260709 13:10:12.306344 22896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.000s	sys 0.012s
W20260709 13:10:12.306895 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 703702us
I20260709 13:10:12.262521 26670 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.165211 26358 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.170279 26645 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.049400 26483 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.257987 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.173133 26557 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:11.936385 26620 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.253852 22924 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:12.261385 22930 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:12.263315 22897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.005s
W20260709 13:10:12.329219 22897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.011s	sys 0.005s
I20260709 13:10:12.240548 26571 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:12.250753 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 844) took 1777 ms. Trace:
W20260709 13:10:12.267119 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.267719 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.335103 23656 rpcz_store.cc:276] 0709 13:10:10.473555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.207955 (+1734400us) service_pool.cc:224] Handling call
0709 13:10:12.250121 (+ 42166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.250353 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.250388 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.250442 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.250494 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.250560 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.250690 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.335999 22925 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:12.275108 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.336930 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2180) took 1312 ms. Trace:
I20260709 13:10:12.307580 22896 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.337472 22997 rpcz_store.cc:276] 0709 13:10:11.024488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.027856 (+  3368us) service_pool.cc:224] Handling call
0709 13:10:11.028221 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.028570 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.028606 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.028966 (+   360us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.352742 (+323776us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:11.352783 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.352848 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.336680 (+983832us) raft_consensus.cc:1685] finished
0709 13:10:12.336707 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.336860 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2318,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":323491,"threads_started":1,"wal-append.queue_time_us":571422}
I20260709 13:10:12.339808 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2179) took 1315 ms. Trace:
I20260709 13:10:12.084829 26205 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.244130 26730 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.111544 26703 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.283883 26549 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.346247 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2305) took 1681 ms. Trace:
I20260709 13:10:12.344297 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.346666 23080 rpcz_store.cc:276] 0709 13:10:10.665144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.020015 (+354871us) service_pool.cc:224] Handling call
0709 13:10:11.020295 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.020601 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.020625 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.021071 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.163449 (+142378us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:11.163501 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.163688 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.346039 (+1182351us) raft_consensus.cc:1685] finished
0709 13:10:12.346061 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.346191 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1503,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":141954,"threads_started":1,"wal-append.queue_time_us":497416}
I20260709 13:10:12.306162 26572 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.311131 26608 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.270103 26631 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:12.340294 22999 rpcz_store.cc:276] 0709 13:10:11.024177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.040176 (+ 15999us) service_pool.cc:224] Handling call
0709 13:10:11.069308 (+ 29132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.069618 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.069650 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.071352 (+  1702us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.488823 (+417471us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:11.495944 (+  7121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.496032 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.339539 (+843507us) raft_consensus.cc:1685] finished
0709 13:10:12.339566 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.339740 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":387,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":6573,"thread_start_us":417158,"threads_started":1,"wal-append.queue_time_us":553492}
W20260709 13:10:12.354902 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 47401.5us
I20260709 13:10:12.343674 26645 raft_consensus.cc:993] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:12.359817 26670 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.385061 22998 raft_consensus.cc:2410] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:10:12.328336 26483 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:12.347692 26741 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.509s	user 0.001s	sys 0.000s
I20260709 13:10:12.367600 22896 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.328917 26626 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:12.368669 23000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 818) took 1343 ms. Trace:
I20260709 13:10:12.350567 22929 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:12.373687 26650 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:12.375526 26615 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:12.376678 26708 consensus_meta.cc:287] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.733s	user 0.007s	sys 0.001s
I20260709 13:10:12.331984 26639 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.334173 26637 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:12.385916 26666 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.386085 26623 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.369189 26643 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.387084 26732 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.388654 26631 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:12.359858 26755 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.363919 26754 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:12.391263 26613 consensus_meta.cc:287] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.767s	user 0.005s	sys 0.000s
I20260709 13:10:12.391714 26703 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.392098 26753 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:12.444702 26670 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:12.397548 26730 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.401850 26153 raft_consensus.cc:1081] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:12.398973 26573 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.414286 26620 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.335599 26557 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.318500 26614 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:10:12.423771 22971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.001s	sys 0.013s
W20260709 13:10:12.424362 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 364546us
W20260709 13:10:12.426126 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.011s	sys 0.033s
W20260709 13:10:12.432680 22972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.019s	sys 0.027s
I20260709 13:10:12.439426 23000 rpcz_store.cc:276] 0709 13:10:11.024772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.029346 (+  4574us) service_pool.cc:224] Handling call
0709 13:10:11.029633 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.029954 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.029983 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.030403 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.165646 (+135243us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:11.165698 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.165779 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.364430 (+1198651us) raft_consensus.cc:1685] finished
0709 13:10:12.368434 (+  4004us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.368603 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1139,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":134904,"threads_started":1,"wal-append.queue_time_us":494319}
W20260709 13:10:12.441318 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 73837.9us
I20260709 13:10:12.449229 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:12.449283 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 208401us
W20260709 13:10:12.457587 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.449229 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 814) took 2770 ms. Trace:
I20260709 13:10:12.481184 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.486603 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.488586 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.446415 26708 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:12.461066 26683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.008s	sys 0.012s
I20260709 13:10:12.495374 23072 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:12.461314 26637 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.481165 26623 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.518823 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.014s	sys 0.035s
W20260709 13:10:12.520983 22972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.019s	sys 0.032s
I20260709 13:10:12.522136 22927 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:12.521157 23650 rpcz_store.cc:276] 0709 13:10:09.679020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.419867 (+1740847us) service_pool.cc:224] Handling call
0709 13:10:11.506628 (+ 86761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.836539 (+329911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.448931 (+612392us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54001b8854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:12.449158 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341559168}
I20260709 13:10:12.523325 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:12.522306 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 604732us
I20260709 13:10:12.526611 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:12.527336 22929 raft_consensus.cc:2393] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:12.528385 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.531524 22971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.004s	sys 0.016s
W20260709 13:10:12.533257 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.665690 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.667039 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:12.667882 23080 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:12.672791 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2308) took 2000 ms. Trace:
W20260709 13:10:12.672474 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 223319us
I20260709 13:10:12.676775 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:12.496764 26736 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.481s	user 0.001s	sys 0.000s
I20260709 13:10:12.492717 26616 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.690256 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 166942us
I20260709 13:10:12.672997 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:12.671917 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 152133us
I20260709 13:10:12.691691 22895 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:12.695011 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:12.660985 26683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.011s	sys 0.013s
I20260709 13:10:12.522617 26717 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.681504 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:12.682507 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.700291 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.682679 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.679131 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:12.704785 23079 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:12.705623 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:12.499209 26670 raft_consensus.cc:697] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:12.686014 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:12.680689 26510 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:12.676229 23073 rpcz_store.cc:276] 0709 13:10:10.672093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.048275 (+376182us) service_pool.cc:224] Handling call
0709 13:10:11.048649 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.049928 (+  1279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.049971 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.069483 (+ 19512us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.567870 (+498387us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:11.567948 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.568044 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.672600 (+1104556us) raft_consensus.cc:1685] finished
0709 13:10:12.672618 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.672741 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":864,"raft.queue_time_us":1450,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":15379,"thread_start_us":465793,"threads_started":1,"wal-append.queue_time_us":564743}
I20260709 13:10:12.702359 23075 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:10:12.668711 26666 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:12.706135 23079 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.685827 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.704206 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:12.710660 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.713181 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:12.725943 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:12.724114 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.726811 23074 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:12.728961 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.678506 26759 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.730706 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:12.678179 26637 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:12.734130 22922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.005s	sys 0.001s
W20260709 13:10:12.744192 22922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.006s	sys 0.001s
I20260709 13:10:12.736398 23080 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:12.697404 26732 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.738118 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:12.681509 26706 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:12.682063 26620 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:12.740090 23004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.027s	sys 0.039s
I20260709 13:10:12.485181 26755 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.491251 26754 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.742551 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:12.698101 26643 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.744781 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:12.711002 26639 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:12.756587 23076 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
W20260709 13:10:12.746663 23004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.028s	sys 0.039s
I20260709 13:10:12.495668 26753 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.707504 26153 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.754921 22896 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.679949 26623 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.754813 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 1980) took 1347 ms. Trace:
I20260709 13:10:12.775611 26769 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:12.765085 26639 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.786978 22922 rpcz_store.cc:276] 0709 13:10:11.407138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.407280 (+   142us) service_pool.cc:224] Handling call
0709 13:10:11.407587 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.463330 (+ 55743us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:11.751060 (+287730us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.754517 (+1003457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.754561 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:12.754601 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.754657 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.754763 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64994,"prepare.queue_time_us":469716,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":79932,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1065540,"threads_started":2}
I20260709 13:10:12.788334 26650 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:12.758399 26618 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.084s	sys 0.126s
W20260709 13:10:12.789170 26618 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.085s	sys 0.126s
I20260709 13:10:12.788875 26153 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:12.706815 26626 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.706537 26572 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.718994 26185 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:12.775154 22896 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.748502 23074 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:12.731796 26358 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:12.672051 26730 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 13:10:12.796778 22896 consensus_peers.cc:597] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 -> Peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Couldn't send request to peer 01988c2c817947859340a730b7f1247d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5adc1058fd2948e382bcd0ee2213ab3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.788501 26639 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.707175 26616 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:12.758108 26641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.004s	sys 0.012s
W20260709 13:10:12.735018 26742 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.551s	user 0.001s	sys 0.000s
I20260709 13:10:12.769688 26757 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:12.789181 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.770985 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:12.731925 26430 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:10:12.745988 26763 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.799238 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 104299us
I20260709 13:10:12.804509 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2306) took 2139 ms. Trace:
I20260709 13:10:12.725980 26666 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.790495 26613 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:12.813791 22922 raft_consensus.cc:2410] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:12.789855 26643 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:12.724740 26717 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.792346 26645 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.814810 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 43932.4us
I20260709 13:10:12.802605 26014 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:12.765470 26732 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.793810 26185 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.825445 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:12.864463 26666 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.865168 26613 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:12.865260 26185 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.865762 26613 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.868091 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:12.869247 23071 rpcz_store.cc:276] 0709 13:10:10.665461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.024674 (+359213us) service_pool.cc:224] Handling call
0709 13:10:11.024972 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.025303 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.025331 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.025774 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.753851 (+728077us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:11.753892 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.753967 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.804266 (+1050299us) raft_consensus.cc:1685] finished
0709 13:10:12.804290 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.804445 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10885,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":72,"thread_start_us":727727,"threads_started":1,"wal-append.queue_time_us":638187}
I20260709 13:10:12.872545 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:12.873504 22922 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:12.864814 26732 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.876106 26645 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:12.880200 26645 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:12.795446 26769 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:12.765359 26620 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:12.806342 26641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.004s	sys 0.012s
W20260709 13:10:12.883709 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 351998us
I20260709 13:10:12.792733 26764 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:12.806733 26664 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:12.798967 26730 consensus_queue.cc:1243] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:12.748319 26759 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:12.939131 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 253369us
I20260709 13:10:12.940824 22970 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:12.879513 26732 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:12.795630 26572 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:12.816380 26757 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:12.817364 26483 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:12.987416 22972 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.941704 26683 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:12.991876 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 51114.9us
I20260709 13:10:12.992914 22970 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:12.994130 22970 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:12.992962 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.996491 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:12.997043 23074 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:12.998118 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 270496us
I20260709 13:10:12.999617 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:12.995106 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:12.944818 26768 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:13.039901 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 820) took 1989 ms. Trace:
I20260709 13:10:12.988487 26014 raft_consensus.cc:697] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:13.076974 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:12.983855 26573 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:13.080582 23005 rpcz_store.cc:276] 0709 13:10:11.050650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.051290 (+   640us) service_pool.cc:224] Handling call
0709 13:10:11.051539 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.056879 (+  5340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.056906 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.070504 (+ 13598us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.506147 (+435643us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:11.506189 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.506273 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.039558 (+1533285us) raft_consensus.cc:1685] finished
0709 13:10:13.039590 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.039814 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4896,"raft.queue_time_us":13005,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":9466,"thread_start_us":428402,"threads_started":1,"wal-append.queue_time_us":562608}
I20260709 13:10:13.080920 23076 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:12.885675 26763 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:12.881906 26670 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:13.032948 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 207571us
W20260709 13:10:13.075798 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.991977 26683 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:13.004251 26642 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 1.433s	user 0.008s	sys 0.004s
I20260709 13:10:13.092465 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.005149 26420 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.005311 26664 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:13.098055 23080 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:12.992226 26757 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:13.099267 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 91852us
I20260709 13:10:13.005458 26666 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:13.102299 23620 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:13.103216 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:13.108480 23076 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:13.108902 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:13.095853 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 227832us
I20260709 13:10:13.110762 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.111411 23080 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:12.988190 26758 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:13.115180 26775 log.cc:927] Time spent T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:10:13.116648 26786 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:13.098565 26643 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:13.117715 26612 consensus_meta.cc:287] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.000s
I20260709 13:10:13.097245 26683 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.122777 23079 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:13.111017 26777 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:13.000520 26732 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.104040 26664 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.102483 26650 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.104192 26666 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.009063 26753 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.101589 26764 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:13.102053 26776 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:13.010226 26557 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:13.122818 26358 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.145944 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.163810 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:13.162748 26616 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:13.145407 26637 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.183296 23080 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:13.163692 26706 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.156409 26420 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.178637 26755 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:13.179059 26153 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.154173 26758 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.183917 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:13.184300 23080 raft_consensus.cc:2410] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:13.148979 26573 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.169075 26666 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.170696 26664 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:13.234436 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50597.1us
W20260709 13:10:13.189204 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 191573us
I20260709 13:10:13.180001 26777 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:13.193296 26706 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.184592 26641 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:13.179494 26779 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.239534 22972 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:13.232393 26758 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.163033 26786 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.166446 26612 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.251076 22972 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:13.235122 22970 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:13.252430 26774 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:10:13.252862 26788 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:13.253402 26762 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:13.254655 26763 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:13.255896 26778 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:10:13.191509 26358 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.256335 26641 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.259760 26767 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:10:13.260346 26773 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.260619 26648 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:10:13.259294 26613 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.265007 26153 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:13.265511 23072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 700) took 2154 ms (client timeout 2255 ms). Trace:
I20260709 13:10:13.267009 26766 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:13.238736 26620 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:13.268308 26510 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.269614 26777 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.276400 23074 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:13.195616 26618 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:13.280390 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45342.7us
W20260709 13:10:13.284729 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 181575us
I20260709 13:10:13.306571 26557 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:13.307004 26802 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.246142 26706 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:13.263592 26619 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.040s	user 0.007s	sys 0.001s
I20260709 13:10:13.183274 26650 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.245342 26420 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:13.310002 26703 consensus_meta.cc:287] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.821s	user 0.006s	sys 0.004s
I20260709 13:10:13.355629 22922 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:13.319461 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 210570us
I20260709 13:10:13.188799 26014 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.251348 26626 consensus_queue.cc:1059] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:10:13.189716 26764 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:13.368954 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 373880us
W20260709 13:10:13.372596 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 178548us
W20260709 13:10:13.380798 23072 rpcz_store.cc:269] 0709 13:10:11.111104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.152656 (+ 41552us) service_pool.cc:224] Handling call
0709 13:10:13.265314 (+2112658us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400266e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:13.265425 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036575616}
I20260709 13:10:13.417058 23071 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:13.363857 26763 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:13.423576 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.426833 26557 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.592731 22970 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:13.380579 26766 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:13.314044 26643 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.428057 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:13.539858 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:13.427188 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.598637 23076 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:13.428862 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.427488 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.553234 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1067) took 3722 ms. Trace:
I20260709 13:10:13.601300 23648 rpcz_store.cc:276] 0709 13:10:09.830934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.727401 (+1896467us) service_pool.cc:224] Handling call
0709 13:10:12.242637 (+515236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.500530 (+257893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.500569 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.699433 (+198864us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.790374 (+ 90941us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.790781 (+   407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.807431 (+ 16650us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.552945 (+745514us) raft_consensus.cc:1685] finished
0709 13:10:13.552967 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.553152 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":431,"raft.queue_time_us":196132,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2688,"thread_start_us":344692,"threads_started":2,"wal-append.queue_time_us":374332}
I20260709 13:10:13.555984 23045 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:13.318794 26788 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.319845 26762 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.608599 22971 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:13.460325 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:13.423961 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 844) took 1766 ms. Trace:
I20260709 13:10:13.612254 23650 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:13.597355 23654 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:13.615468 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:13.612152 22930 rpcz_store.cc:276] 0709 13:10:11.657155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.332263 (+675108us) service_pool.cc:224] Handling call
0709 13:10:12.332525 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.332704 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:12.355484 (+ 22780us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.272910 (+917426us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18003d1f20. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa23a 00007f3925014a2a
0709 13:10:13.423509 (+150599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:13.423557 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:13.423597 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.423680 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.423790 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16,"prepare.queue_time_us":19630,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":88,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":20212,"spinlock_wait_cycles":28584832,"thread_start_us":150355,"threads_started":1}
I20260709 13:10:13.617786 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:13.558032 26620 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.618319 22930 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:13.593540 26732 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:13.596359 26763 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.373014 26773 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:13.624112 26185 consensus_meta.cc:287] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.001s
I20260709 13:10:13.596619 26557 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.648030 23078 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:13.651559 23078 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:13.605043 26780 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:13.640448 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:13.649744 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:13.436077 26618 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.614800 26420 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:13.656728 23652 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:13.659461 23620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.195:45219 timed out after 2.255s (SENT) [suppressed 22 similar messages]
I20260709 13:10:13.662950 23657 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:13.593597 26619 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.653496 26644 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.649276 26763 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.652350 23078 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.648099 26772 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:13.664515 26583 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:13.705343 22924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 1989) took 2140 ms. Trace:
I20260709 13:10:13.705852 22924 rpcz_store.cc:276] 0709 13:10:11.565401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.625524 (+ 60123us) service_pool.cc:224] Handling call
0709 13:10:13.705153 (+2079629us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54000ce9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:13.705278 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896190336}
I20260709 13:10:13.649739 26620 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.654536 26645 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.672526 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:13.699488 23078 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.656105 26780 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:13.620116 26794 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:10:13.717119 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:13.720036 22929 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:13.677835 26795 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:13.684670 26642 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:13.666112 26185 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.724910 22924 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:13.749907 23652 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:13.754235 26358 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:13.755340 26618 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.724134 26772 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:13.756645 26772 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.721097 26732 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:13.758251 26732 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.760239 26732 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:13.754241 26799 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.278s	user 0.000s	sys 0.002s
W20260709 13:10:13.762395 26792 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:10:13.762290 26420 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:13.763331 26664 consensus_meta.cc:287] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.001s
I20260709 13:10:13.689400 26626 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.752526 23078 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:10:13.789861 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:13.794652 23078 pending_rounds.cc:85] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 5
I20260709 13:10:13.794999 23078 pending_rounds.cc:107] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:10:13.795320 23078 raft_consensus.cc:2889] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:13.715857 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:13.798115 23657 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.763777 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 828) took 2017 ms. Trace:
W20260709 13:10:13.783603 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 227668us
I20260709 13:10:13.800470 23045 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:13.802130 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:13.717850 26645 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:13.831707 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 223221us
I20260709 13:10:13.724624 26613 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:13.744694 26642 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.798786 23004 rpcz_store.cc:276] 0709 13:10:11.746275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.746499 (+   224us) service_pool.cc:224] Handling call
0709 13:10:11.746864 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.766038 (+1019174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.766081 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.784706 (+ 18625us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.187051 (+402345us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:13.187103 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.187196 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.763552 (+576356us) raft_consensus.cc:1685] finished
0709 13:10:13.763572 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.763721 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":419158,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":153,"thread_start_us":1413888,"threads_started":2,"wal-append.queue_time_us":771677}
W20260709 13:10:13.788455 26745 log.cc:927] Time spent T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.717s	user 0.011s	sys 0.006s
W20260709 13:10:13.787091 26639 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.972s	user 0.012s	sys 0.000s
I20260709 13:10:13.790431 26620 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.842919 23073 raft_consensus.cc:2368] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
W20260709 13:10:13.849035 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.721668 26641 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:13.725023 26780 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.772621 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:13.886308 22972 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:13.787364 26788 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:13.859462 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 57485.5us
I20260709 13:10:13.708022 26806 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.870757 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:13.871676 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.008s	sys 0.015s
I20260709 13:10:13.668453 26766 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.880405 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.882019 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:13.890671 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.008s	sys 0.016s
I20260709 13:10:13.871511 26645 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.889843 26760 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.872349 26708 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:13.891611 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.789232 26764 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.898326 23074 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:13.899220 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:13.899513 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.893097 23078 raft_consensus.cc:2393] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:13.871387 26583 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.874493 26642 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.894964 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:13.895476 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 236034us
I20260709 13:10:13.901109 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:13.796216 26664 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.884744 26613 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.776803 26795 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.904680 23074 pending_rounds.cc:85] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 6
I20260709 13:10:13.910518 23074 pending_rounds.cc:107] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:13.910846 23074 raft_consensus.cc:2889] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:13.911818 22971 leader_election.cc:400] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11.
I20260709 13:10:13.901849 23657 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:13.907823 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:13.920444 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:13.916576 26797 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:10:13.923406 26820 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.903091 26788 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:13.925279 26788 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.927969 26641 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:13.928532 26641 raft_consensus.cc:697] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:13.929409 26641 consensus_queue.cc:237] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.909426 26583 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:13.933239 26583 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.933667 26572 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:13.934653 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:13.935242 22928 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:13.935835 22928 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:13.936326 26800 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:13.937609 26764 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.938186 26764 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:13.938691 26764 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.939073 26804 raft_consensus.cc:3055] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:13.939472 26804 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:13.939862 26787 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:13.940366 26787 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.941470 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2437) took 1412 ms. Trace:
I20260709 13:10:13.941816 22922 rpcz_store.cc:276] 0709 13:10:12.528963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.874522 (+345559us) service_pool.cc:224] Handling call
0709 13:10:12.874877 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.554057 (+679180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.941252 (+387195us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400345b54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:13.941417 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105044736}
W20260709 13:10:13.937809 26813 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:13.944527 23653 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:13.877939 26639 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.975814 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1071) took 2882 ms. Trace:
I20260709 13:10:13.975865 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:13.976383 23653 rpcz_store.cc:276] 0709 13:10:11.093126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.943996 (+2850870us) service_pool.cc:224] Handling call
0709 13:10:13.944321 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.952339 (+  8018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.975728 (+ 23389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:13.977730 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:13.978660 23653 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:10:13.980356 26482 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:10:13.981184 26819 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.981735 26819 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:13.989959 26683 consensus_meta.cc:287] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.003s
I20260709 13:10:13.990376 26683 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.991580 22930 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:13.841683 26626 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:13.896149 26807 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.916241 23652 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
W20260709 13:10:13.923744 26785 log.cc:927] Time spent T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.325s	user 0.000s	sys 0.012s
I20260709 13:10:13.898033 26708 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:13.952224 26736 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:14.029410 22931 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:14.009981 26758 consensus_meta.cc:287] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.003s
I20260709 13:10:14.031572 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.014648 26807 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.049628 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:13.974977 26572 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:10:14.050426 23657 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:13.925009 26791 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:10:14.055091 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2282) took 1353 ms. Trace:
I20260709 13:10:14.056790 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.057567 23657 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 3.
I20260709 13:10:13.923529 26817 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:10:14.055532 23075 rpcz_store.cc:276] 0709 13:10:12.701589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.701718 (+   129us) service_pool.cc:224] Handling call
0709 13:10:12.702048 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.702256 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:12.937442 (+235186us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.459961 (+522519us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.641962 (+182001us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.054747 (+412785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:14.054798 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:14.054839 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.054911 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.055035 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181529,"prepare.queue_time_us":524209,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":787923,"raft.run_cpu_time_us":456,"raft.run_wall_time_us":36263,"spinlock_wait_cycles":18158976,"thread_start_us":891642,"threads_started":3,"wal-append.queue_time_us":417114}
W20260709 13:10:14.076347 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 168580us
I20260709 13:10:14.076772 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:14.077306 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.078286 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:14.070343 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.074875 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.033594 26708 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.078900 23075 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 4.
I20260709 13:10:14.088068 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:14.088856 23075 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:10:14.079385 23657 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.080317 23654 raft_consensus.cc:2410] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:14.089915 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:14.091076 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.091792 23654 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:14.094462 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:14.092751 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.096009 23075 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:14.096907 26823 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:14.097338 26823 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:14.097689 26823 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:14.093503 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 180897us
I20260709 13:10:14.100031 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.104365 23654 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:14.103448 26613 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:14.105563 26613 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.102873 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.051054 26807 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.040508 26758 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:14.110752 22971 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.078115 26797 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:14.114315 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.074769 26583 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:14.122596 22928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:10:14.123126 22928 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.123540 22928 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.128672 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.117781 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:14.132718 23657 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
W20260709 13:10:14.112372 26510 consensus_meta.cc:287] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.000s
I20260709 13:10:14.133060 23077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2284) took 1431 ms. Trace:
I20260709 13:10:14.112330 26572 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:14.133671 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.135464 23077 rpcz_store.cc:276] 0709 13:10:12.702097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.702187 (+    90us) service_pool.cc:224] Handling call
0709 13:10:12.702447 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.720301 (+ 17854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.720334 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.743876 (+ 23542us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.085369 (+341493us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:13.085426 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.085517 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.132808 (+1047291us) raft_consensus.cc:1685] finished
0709 13:10:14.132835 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.132991 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32234,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":19320,"thread_start_us":289427,"threads_started":1,"wal-append.queue_time_us":539605}
I20260709 13:10:14.140307 23654 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:14.134395 26717 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:14.159036 26796 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.742s	user 0.000s	sys 0.002s
W20260709 13:10:14.160032 26814 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:10:14.120446 26797 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:14.161221 26797 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.162451 26797 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:14.162722 26757 consensus_meta.cc:287] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 1.041s	user 0.003s	sys 0.006s
W20260709 13:10:14.138860 26648 consensus_meta.cc:287] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.519s	user 0.002s	sys 0.007s
I20260709 13:10:14.120000 26763 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.109004 26804 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.166779 26763 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:14.167135 26666 consensus_meta.cc:287] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.928s	user 0.008s	sys 0.002s
I20260709 13:10:14.167879 26664 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.162618 26644 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:14.131816 26583 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.141903 26572 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:14.173300 26572 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.173671 26583 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:14.141273 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 94557.1us
I20260709 13:10:14.153267 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.122404 26777 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:14.167539 26666 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.174677 23654 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:14.127416 26205 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:14.178963 22971 connection.cc:256] RPC call timeout handler was delayed by -1.4255018100000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:10:14.181214 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:14.180064 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 84496us
I20260709 13:10:14.184700 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:14.137229 26802 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:14.187165 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.187785 23657 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:14.139323 26510 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.193543 26666 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:14.195290 26557 consensus_meta.cc:287] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.001s
I20260709 13:10:14.196368 26618 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:14.196897 26618 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:14.197727 26827 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:14.197867 26618 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.133615 26613 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.198204 26708 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.178045 26794 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.213086 26758 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.213442 26794 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.177419 26781 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:14.200672 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.210199 26802 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:14.211388 22928 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.200119 26482 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:14.163414 26757 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.202191 23045 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:14.216403 26706 consensus_meta.cc:287] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.002s
I20260709 13:10:14.234200 22928 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.134558 26821 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:10:14.191130 26777 raft_consensus.cc:697] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:14.239144 23045 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:14.189029 26717 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:10:14.242951 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:14.233940 26639 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.200582 26832 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:10:14.211557 26557 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.254644 23657 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:14.261971 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.240406 26781 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.262583 23657 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 5.
I20260709 13:10:14.240914 26794 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:14.274374 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 93257.1us
I20260709 13:10:14.238279 26706 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.227748 26764 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.275315 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:14.276295 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.281596 23655 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.223028 26823 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.243952 26510 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:14.243641 26795 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:14.290025 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.288753 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.255277 26833 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:14.288494 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.291822 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.292877 23654 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:14.291327 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:14.294227 23654 raft_consensus.cc:2368] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10.
I20260709 13:10:14.297179 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:14.298050 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.299751 23003 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:14.262375 26626 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.301636 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.306675 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.305639 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:14.311985 26708 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.313849 26786 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.305959 26833 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:14.305557 26358 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:14.305619 26802 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.503178 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.305415 26639 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.295317 26205 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.321780 26777 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.523427 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.523954 23657 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.523306 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.506976 23655 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:14.508147 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.507360 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.292552 26794 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:14.519876 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:14.520459 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 238825us
W20260709 13:10:14.522197 26645 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.005s
W20260709 13:10:14.544229 22971 leader_election.cc:336] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.359s (SENT)
W20260709 13:10:14.545644 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.546325 23000 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:14.547355 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.509763 26626 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:14.514984 26840 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.311s	user 0.001s	sys 0.007s
I20260709 13:10:14.552042 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.549057 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.555725 23006 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:14.556173 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:14.526530 26642 consensus_meta.cc:287] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.606s	user 0.013s	sys 0.009s
I20260709 13:10:14.513579 26358 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:14.560648 26358 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:14.564414 26833 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.567081 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.567811 26690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adc1058fd2948e382bcd0ee2213ab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.568634 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.569373 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.570289 23655 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:14.571192 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.571893 23655 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:14.572844 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:14.574910 23655 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 5: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:14.577049 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:14.579418 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:14.549536 26626 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.589238 23045 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.586936 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:14.543454 26205 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:14.599210 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.603547 23657 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:14.604750 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:14.552296 26645 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:14.607244 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.604442 23045 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:14.608726 23000 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:14.609086 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:14.596553 26845 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:14.588508 26626 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:14.610533 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.612778 22999 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.592387 26573 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:14.616415 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.617225 23655 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.568876 26642 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:14.597941 26666 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:14.611097 23001 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:14.606473 26816 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.632973 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:14.610450 26845 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:14.600775 26757 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.606043 26482 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.613078 26430 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:14.642959 26430 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.611526 26644 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:14.640663 23004 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:14.618983 26794 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:14.643100 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:14.644083 22928 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.644377 26794 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.645022 26645 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.643383 26430 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:14.613840 26717 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.650521 26856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47786 (request call id 852) took 1057 ms. Trace:
I20260709 13:10:14.650874 22999 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:14.643088 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.653744 22997 raft_consensus.cc:2368] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:14.614931 26706 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.657243 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2442) took 1340 ms. Trace:
W20260709 13:10:14.667053 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.669822 23655 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:14.657110 22928 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:14.656001 26644 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:14.677618 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:14.689677 23622 connection.cc:256] RPC call timeout handler was delayed by -1.574271342999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:10:14.685818 26797 consensus_meta.cc:287] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
I20260709 13:10:14.647923 26666 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:14.642724 26573 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:14.646652 26845 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.652508 26831 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:14.656147 26850 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.693928 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.675828 22923 rpcz_store.cc:276] 0709 13:10:13.316837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.220412 (+903575us) service_pool.cc:224] Handling call
0709 13:10:14.237736 (+ 17324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:14.237918 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:14.549413 (+311495us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.656921 (+107508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:14.656970 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:14.657018 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.657082 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.657190 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":753,"prepare.queue_time_us":312282,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2622,"raft.queue_time_us":70,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5875,"thread_start_us":397344,"threads_started":2}
I20260709 13:10:14.810441 23001 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:14.725768 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:14.688493 26205 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:14.692461 26807 consensus_meta.cc:287] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.572s	user 0.002s	sys 0.013s
I20260709 13:10:14.828352 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:14.696898 26760 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.792s	user 0.007s	sys 0.003s
I20260709 13:10:14.836627 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:14.727723 26799 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:14.694151 26655 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.726840 26780 consensus_meta.cc:287] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.834s	user 0.013s	sys 0.024s
W20260709 13:10:14.719717 26572 consensus_meta.cc:287] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:10:14.696761 26706 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.696147 26823 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.823212 26797 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:14.827164 26831 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:14.871512 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.856649 26655 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.855434 26760 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.892215 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.892985 23000 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:14.885821 26620 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.881296 26797 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.837155 26807 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.894012 26620 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.897893 26623 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:14.828641 26850 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.670416 26856 rpcz_store.cc:276] 0709 13:10:13.592741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.587054 (+994313us) service_pool.cc:224] Handling call
0709 13:10:14.650429 (+ 63375us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-copy.queue_time_us":62582,"thread_start_us":28526,"threads_started":1}
I20260709 13:10:14.859419 26780 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.859246 26572 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.863168 26706 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.912957 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 843) took 4440 ms. Trace:
I20260709 13:10:14.941704 23651 rpcz_store.cc:276] 0709 13:10:10.473241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.207982 (+1734741us) service_pool.cc:224] Handling call
0709 13:10:12.208352 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.497112 (+288760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.497143 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.497185 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.497222 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.912641 (+2415419us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54006ed054. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:14.912708 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.912865 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":192245,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":21349,"spinlock_wait_cycles":110136064,"thread_start_us":240474,"threads_started":1}
W20260709 13:10:14.915349 23073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 2286) took 2212 ms (client timeout 1818 ms). Trace:
W20260709 13:10:14.944618 23073 rpcz_store.cc:269] 0709 13:10:12.702577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.725720 (+ 23143us) service_pool.cc:224] Handling call
0709 13:10:14.915132 (+2189412us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002b4dd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:14.915277 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2477623552}
I20260709 13:10:14.876686 26644 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.917112 26620 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.919675 26764 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:14.920704 26655 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:14.921383 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:14.950861 22925 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.950948 23002 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:10:14.921576 26807 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.886107 26666 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.927289 26631 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:14.929389 26780 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.929770 26773 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.931277 26557 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:14.931867 26730 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:14.952983 26631 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:14.962405 26730 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.909252 26831 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.920737 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:14.934762 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.935451 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:14.939812 23005 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
W20260709 13:10:14.947386 23622 connection.cc:256] RPC call timeout handler was delayed by -1.4023713430000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
I20260709 13:10:14.952800 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:14.898861 26573 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:14.934345 26642 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.972671 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:15.069099 23656 raft_consensus.cc:2376] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8. Re-sending same reply.
I20260709 13:10:15.069693 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1074) took 1644 ms. Trace:
I20260709 13:10:15.070240 23656 rpcz_store.cc:276] 0709 13:10:13.425264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.427722 (+  2458us) service_pool.cc:224] Handling call
0709 13:10:14.914386 (+1486664us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:10:15.069638 (+155252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54993792}
W20260709 13:10:15.021471 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.972522 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:15.073673 23657 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:15.072317 23622 connection.cc:256] RPC call timeout handler was delayed by -1.1726381379999111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:10:15.074973 23622 connection.cc:256] RPC call timeout handler was delayed by -1.154871342999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 13:10:15.075502 23622 connection.cc:256] RPC call timeout handler was delayed by -1.0817381379999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:10:15.076048 23622 connection.cc:256] RPC call timeout handler was delayed by -1.0702713429999449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:10:15.077384 23622 connection.cc:256] RPC call timeout handler was delayed by -1.0484381379999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:10:15.077936 23622 connection.cc:256] RPC call timeout handler was delayed by -1.001871342999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 13:10:15.057788 23654 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:14.982821 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:15.079126 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 853) took 1486 ms. Trace:
I20260709 13:10:15.081147 23654 rpcz_store.cc:276] 0709 13:10:13.592987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.057074 (+1464087us) service_pool.cc:224] Handling call
0709 13:10:15.057438 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.078784 (+ 21346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.079052 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:15.082999 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:15.040293 26860 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:10:15.044674 26835 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.781s	user 0.013s	sys 0.002s
I20260709 13:10:14.971850 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:15.129463 23655 raft_consensus.cc:2368] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
W20260709 13:10:15.052937 26789 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.689s	user 0.008s	sys 0.000s
I20260709 13:10:15.041006 26730 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.061663 26639 consensus_meta.cc:287] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.002s
I20260709 13:10:15.044239 26717 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.079105 26185 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:15.159917 26482 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 13:10:15.069417 26634 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:15.160445 26482 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:15.160542 26634 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:14.948732 26626 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.056252 26358 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.161691 26634 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.162784 26634 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.043488 26850 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:15.013749 26683 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:15.156615 23655 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:15.068980 26831 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.976080 26631 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:15.164351 26631 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.078301 26845 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.159641 26706 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:14.960412 26430 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.166600 26845 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.166730 26812 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 1.469s	user 0.002s	sys 0.000s
I20260709 13:10:15.167758 26430 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.168095 26639 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:15.168640 23655 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:10:15.168715 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 85839.3us
I20260709 13:10:15.175887 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:15.178344 23622 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:15.179462 26749 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.180253 26749 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:15.180895 23655 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:15.181164 26572 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.134547 26859 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:15.163064 26358 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.182247 23655 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:15.163101 26626 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.172859 26766 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.134929 26768 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:15.168848 26620 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:15.274904 26768 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:15.288695 26754 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.320374 26768 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:15.382647 22928 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:14.972340 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.388221 22927 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.388799 23000 raft_consensus.cc:2410] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:15.390165 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.097293 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.091089 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.399873 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:15.400668 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.401392 23003 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:15.401491 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.405401 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.405682 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.407025 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.399170 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.189644 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:15.412793 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 223118us
I20260709 13:10:15.124001 23651 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:15.418223 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 860) took 1106 ms. Trace:
I20260709 13:10:15.421160 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.422257 22999 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:15.418761 23651 rpcz_store.cc:276] 0709 13:10:14.311416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.416187 (+1104771us) service_pool.cc:224] Handling call
0709 13:10:15.416951 (+   764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.417532 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.417569 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.417643 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:15.417746 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.417849 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.417987 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:15.424568 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.426348 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.432371 26621 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.433089 26430 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:15.433701 26621 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:15.434192 26430 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.415159 23622 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:15.407305 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.432367 26623 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:15.452262 22927 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:15.453992 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.455117 22927 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:15.456647 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.459525 22927 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.461596 26430 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.463271 26811 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.464102 26811 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.436363 26620 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:15.466334 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1090) took 1281 ms. Trace:
I20260709 13:10:15.468108 26768 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:15.466785 23654 rpcz_store.cc:276] 0709 13:10:14.184801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.082316 (+897515us) service_pool.cc:224] Handling call
0709 13:10:15.154312 (+ 71996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.169480 (+ 15168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.169509 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.169898 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.410746 (+240848us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:15.450879 (+ 40133us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.465552 (+ 14673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.465717 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.465775 (+    58us) raft_consensus.cc:1685] finished
0709 13:10:15.465798 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.466107 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20518,"raft.queue_time_us":20782,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":395,"thread_start_us":276603,"threads_started":2,"wal-append.queue_time_us":142591}
W20260709 13:10:15.458701 22925 consensus_meta.cc:287] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 13:10:15.469090 26768 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.469472 22925 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:15.472045 22926 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:15.472736 22925 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:15.476667 23651 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:15.466917 26620 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.482188 26620 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:15.476643 22927 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:15.483398 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.489356 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.491125 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:15.498239 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 83438.2us
I20260709 13:10:15.504946 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.505734 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1089) took 1326 ms. Trace:
I20260709 13:10:15.506341 23657 rpcz_store.cc:276] 0709 13:10:14.179289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.074698 (+895409us) service_pool.cc:224] Handling call
0709 13:10:15.131360 (+ 56662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.131640 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:15.131960 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.504962 (+373002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.505058 (+    96us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:15.505139 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.505274 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.505482 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2440,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":206,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":370469,"threads_started":1}
I20260709 13:10:15.526520 26619 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:15.514014 26620 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:15.538393 26788 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.529774 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:15.543949 26650 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.544585 23652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 858) took 1513 ms (client timeout 1518 ms). Trace:
W20260709 13:10:15.545027 23652 rpcz_store.cc:269] 0709 13:10:14.031366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.519188 (+1487822us) service_pool.cc:224] Handling call
0709 13:10:15.544503 (+ 25315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:15.515978 26768 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.547750 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 101610us
I20260709 13:10:15.547719 26620 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:15.561134 26811 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.563433 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1088) took 1372 ms. Trace:
I20260709 13:10:15.566282 26620 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.585232 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:15.586926 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.588526 26634 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:15.589876 26621 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:15.564074 23656 rpcz_store.cc:276] 0709 13:10:14.141725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.071230 (+929505us) service_pool.cc:224] Handling call
0709 13:10:15.129124 (+ 57894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.129365 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.129392 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.129856 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.411666 (+281810us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:15.500891 (+ 89225us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.502876 (+  1985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.509657 (+  6781us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.509925 (+   268us) raft_consensus.cc:1685] finished
0709 13:10:15.509943 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.513783 (+  3840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1888,"prepare.queue_time_us":115378,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":142,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":4729,"thread_start_us":329366,"threads_started":2,"wal-append.queue_time_us":152847}
W20260709 13:10:15.600391 22931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2445) took 2282 ms (client timeout 2689 ms). Trace:
W20260709 13:10:15.600800 22931 rpcz_store.cc:269] 0709 13:10:13.317795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.789597 (+471802us) service_pool.cc:224] Handling call
0709 13:10:15.599959 (+1810362us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54003c91d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:15.600209 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538921216}
I20260709 13:10:15.608261 23000 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:15.609617 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.610337 23000 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:15.611195 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.627430 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:15.628201 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.634588 23621 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:15.635484 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.637629 23079 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.640077 23621 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:15.641990 26634 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:15.642619 26634 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.643114 26634 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.643886 26623 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:15.644111 22998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2184) took 4255 ms (client timeout 2046 ms). Trace:
I20260709 13:10:15.644300 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:15.644626 22998 rpcz_store.cc:269] 0709 13:10:11.388662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.388812 (+   150us) service_pool.cc:224] Handling call
0709 13:10:15.643703 (+4254891us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400012554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:15.643916 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590818176}
I20260709 13:10:15.647720 26621 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:15.647910 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2200) took 1099 ms. Trace:
I20260709 13:10:15.648360 23002 rpcz_store.cc:276] 0709 13:10:14.548748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.551398 (+  2650us) service_pool.cc:224] Handling call
0709 13:10:14.551799 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.951532 (+399733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.647368 (+695836us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400097c54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:15.647693 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917191040}
I20260709 13:10:15.648488 26621 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.650115 22999 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:15.651132 26621 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.651968 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:15.653384 26850 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:15.653977 26850 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:15.655139 26850 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.656934 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 859) took 1347 ms. Trace:
I20260709 13:10:15.658497 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 852) took 1019 ms. Trace:
I20260709 13:10:15.645042 23080 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.658878 23001 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:15.660058 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2186) took 1371 ms. Trace:
I20260709 13:10:15.657004 26690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47800 (request call id 1047) took 6044 ms. Trace:
I20260709 13:10:15.660564 23005 rpcz_store.cc:276] 0709 13:10:14.288715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.289744 (+  1029us) service_pool.cc:224] Handling call
0709 13:10:15.659609 (+1369865us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540030e654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:15.659826 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376430464}
I20260709 13:10:15.658944 22928 rpcz_store.cc:276] 0709 13:10:14.638833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.689627 (+ 50794us) service_pool.cc:224] Handling call
0709 13:10:15.658219 (+968592us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400373f54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:15.658423 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287359232}
W20260709 13:10:15.677050 23653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 854) took 2083 ms (client timeout 1940 ms). Trace:
W20260709 13:10:15.677563 23653 rpcz_store.cc:269] 0709 13:10:13.593532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.676596 (+2083064us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:15.676800 (+   204us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:10:15.685199 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 87846.2us
I20260709 13:10:15.687884 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.688627 22926 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:15.688807 22924 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:10:15.660166 23655 rpcz_store.cc:276] 0709 13:10:14.309127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.236168 (+927041us) service_pool.cc:224] Handling call
0709 13:10:15.236567 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.237055 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:15.412648 (+175593us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.652061 (+239413us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b18003fe560. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3924bb24bc 00007f3921f0048b 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa23a
0709 13:10:15.652302 (+   241us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.652867 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.654451 (+  1584us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:15.654714 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.656307 (+  1593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.656433 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.656573 (+   140us) raft_consensus.cc:1685] finished
0709 13:10:15.656590 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.656758 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202601,"prepare.run_wall_time_us":125,"raft.queue_time_us":821,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":32247,"spinlock_wait_cycles":53463552,"thread_start_us":34109,"threads_started":1,"wal-append.queue_time_us":102799}
I20260709 13:10:15.690452 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.691373 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.698293 23080 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:15.714030 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.714641 22925 raft_consensus.cc:2376] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10. Re-sending same reply.
I20260709 13:10:15.716864 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.718209 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.718523 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.719270 22931 raft_consensus.cc:2410] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:15.720314 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.722543 22930 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:15.722388 26634 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.724848 23079 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:15.727478 26621 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.732673 26621 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.734338 26787 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:15.736074 26621 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.737478 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.742965 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.751046 22930 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.756515 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.764674 22922 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.767874 22927 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.768767 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.767483 26620 consensus_queue.cc:1059] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:10:15.771950 26620 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:15.772336 26620 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:15.773510 26620 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.775059 26620 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.781733 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.782799 23079 raft_consensus.cc:2393] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:15.783573 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.784416 23072 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:15.784755 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.785365 23074 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.788293 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.769322 22928 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:15.771262 23003 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:15.806102 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.808190 22998 raft_consensus.cc:2410] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:15.809847 26819 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.809967 26878 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:10:15.813485 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.813549 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.815212 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.820353 22998 raft_consensus.cc:2368] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9.
I20260709 13:10:15.821291 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.820932 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.822378 23071 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.830910 26759 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:15.834193 26621 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:15.834674 23046 connection.cc:256] RPC call timeout handler was delayed by -1.2512965839999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3268s for a response
I20260709 13:10:15.834932 26621 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.836488 26832 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.837096 26832 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.837476 26621 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.819128 23080 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:15.831595 23077 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:15.841825 23074 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:15.839525 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.843118 22928 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:15.841704 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.845484 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.845755 22922 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:15.672195 26690 rpcz_store.cc:276] 0709 13:10:09.629952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.634793 (+  4841us) service_pool.cc:224] Handling call
0709 13:10:10.330793 (+696000us) ts_tablet_manager.cc:934] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
0709 13:10:11.460340 (+1129547us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b4c004cf580. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f39232d6a20 00007f39232e7a29 00007f39232e813f 00007f39232ac2ab 00007f39232d9f3c 00007f39232da461 00007f39232da768 00007f39290602eb 00007f3929f85d3b 00007f3929f80008 00007f3929f7f405
0709 13:10:14.283902 (+2823562us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:15.290718 (+1006816us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:15.291975 (+  1257us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:15.633959 (+341984us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:15.656226 (+ 22267us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:15.656569 (+   343us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:15.656772 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":7046,"spinlock_wait_cycles":339438976,"tablet-copy.queue_time_us":628231,"thread_start_us":1040151,"threads_started":2}
I20260709 13:10:15.837513 22972 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:15.852612 26690 tablet_copy_client.cc:806] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:15.853060 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:15.853319 26690 tablet_copy_client.cc:670] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:15.853760 23649 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.849386 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.855765 23078 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.848914 26634 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:15.851986 23622 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:15.852031 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.861594 23074 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:15.864823 26780 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.865312 26666 consensus_queue.cc:1059] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:15.872040 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.872738 23074 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:15.873528 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.874056 26612 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.874148 22997 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:15.874676 22997 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:15.875487 22997 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.876511 22997 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.869874 26759 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:15.874289 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.881027 26759 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:15.888269 23622 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:15.892962 26850 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:15.893647 26850 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:15.871901 26819 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:15.897485 26819 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.900084 23649 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:15.901767 26849 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:15.902184 26849 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.902511 26849 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.904472 22928 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:10:15.905668 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.906507 22928 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:15.908366 22931 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.909824 22931 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:15.910909 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.889252 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:15.912849 22925 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.913160 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2436) took 3385 ms. Trace:
I20260709 13:10:15.913483 22929 rpcz_store.cc:276] 0709 13:10:12.527534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.527946 (+   412us) service_pool.cc:224] Handling call
0709 13:10:12.528216 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.723313 (+1195097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.912655 (+2189342us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400346f54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:15.912932 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740373760}
I20260709 13:10:15.914028 23622 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:15.915697 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:15.917774 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.918731 23006 raft_consensus.cc:2393] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:15.924566 26819 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.932663 26841 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.677s	user 0.006s	sys 0.012s
W20260709 13:10:15.932866 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.937285 26762 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:15.938993 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.939754 26797 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.940194 26832 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.894788 26850 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.942323 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.943369 22929 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:15.948498 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.949087 26759 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:15.949455 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.949084 22929 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:15.949998 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.950768 23080 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:15.950517 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.951073 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.951721 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.952073 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.952418 22924 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.953284 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.953917 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.954859 22929 raft_consensus.cc:2410] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:15.954967 22924 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:15.956265 22924 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:15.950613 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:15.956789 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.988421 22925 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.988476 22970 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:15.990463 26786 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:15.991012 26786 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.957826 26772 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:15.991460 23078 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:15.991807 26772 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:15.992076 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.992892 26772 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:15.993571 22926 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:15.994208 26772 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.959379 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.959626 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:15.960070 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.996119 23073 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.957873 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:15.996662 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.997234 23077 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:15.997480 22925 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.961891 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:16.000072 23080 raft_consensus.cc:2368] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:15.963514 26787 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:15.964498 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.001250 23000 raft_consensus.cc:2393] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:16.001732 26880 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.173s	user 0.002s	sys 0.001s
I20260709 13:10:16.002175 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.003366 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.953336 23006 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:16.005498 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.006098 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.006613 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:16.006927 22926 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:15.966205 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.007411 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:16.008184 22927 raft_consensus.cc:2368] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:16.008605 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:16.008788 26804 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.009402 22999 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:16.010210 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:16.010900 22999 raft_consensus.cc:2393] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:16.012287 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.013994 23006 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:16.015477 23006 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.015908 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.016783 22923 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:15.967945 22928 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:15.970093 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.017215 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:16.017599 26638 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.017666 22998 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:15.970481 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.018380 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.018254 26638 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.018779 23003 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:10:15.971585 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.971920 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.972163 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:15.972411 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:15.973912 26483 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:15.973968 26706 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:15.974639 26634 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:15.961186 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:15.975854 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:15.978673 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.951978 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:15.991367 22922 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:15.993292 26786 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:15.965256 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:16.009002 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:15.911306 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.4026e+06us
W20260709 13:10:15.974771 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 59198.6us
I20260709 13:10:16.019484 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.075737 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:16.081641 23073 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
W20260709 13:10:16.052680 23649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1077) took 2474 ms (client timeout 1509 ms). Trace:
I20260709 13:10:16.057154 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:15.980508 22997 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:16.018783 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 855) took 1293 ms. Trace:
W20260709 13:10:16.101305 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 113687us
I20260709 13:10:16.073729 22929 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:16.100207 23622 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.016970 22999 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:16.099689 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2214) took 1137 ms. Trace:
W20260709 13:10:16.094449 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 269063us
W20260709 13:10:16.102128 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.102689 22997 rpcz_store.cc:276] 0709 13:10:14.962766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.975877 (+ 13111us) service_pool.cc:224] Handling call
0709 13:10:15.843792 (+867915us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5eee 0000000000375939 00007f3929f591e0 00007f392a0220c4 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:10:16.099596 (+255804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56706944}
W20260709 13:10:16.098395 23649 rpcz_store.cc:269] 0709 13:10:13.426153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.428126 (+  1973us) service_pool.cc:224] Handling call
0709 13:10:15.852710 (+2424584us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:10:15.900697 (+ 47987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56915840}
W20260709 13:10:16.108307 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 147252us
I20260709 13:10:16.101416 22923 rpcz_store.cc:276] 0709 13:10:14.725409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.810479 (+ 85070us) service_pool.cc:224] Handling call
0709 13:10:16.018603 (+1208124us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400346a54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:16.018710 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2711442304}
I20260709 13:10:16.111123 23004 raft_consensus.cc:2368] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
I20260709 13:10:16.112471 23622 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.115504 22925 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:16.071712 26655 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.022527 26638 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:16.036708 26780 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.125226 22818 maintenance_manager.cc:419] P 84f66d81ef21415a8d9a0c01ca7125b0: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033397
I20260709 13:10:16.024580 26740 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.108155 26832 raft_consensus.cc:2764] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:16.024824 26623 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.137669 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:16.142697 22999 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.047616 26849 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.133240 26634 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.150104 25932 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:16.150271 26562 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:16.139529 26483 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.161540 25932 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.150146 22828 catalog_manager.cc:5697] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.172451 22828 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.173817 22828 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 6, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 6 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.166373 22971 leader_election.cc:400] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10.
I20260709 13:10:16.175235 22828 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 5 to 9, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 9 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.161327 26153 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.145197 26650 consensus_queue.cc:1059] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:16.191078 26650 raft_consensus.cc:3055] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:16.191497 26650 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:16.192613 26650 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.194006 26650 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.167212 26562 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:16.198045 26562 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:16.198333 25932 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:16.199882 26153 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.200454 22828 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 8 to 10, term changed from 8 to 9, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to <none>, VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) evicted. New cstate: current_term: 9 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.202641 26153 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:16.165320 26623 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.202865 22828 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 3 to 5, term changed from 3 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194), VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195), VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 5 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:16.204928 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 96301.2us
I20260709 13:10:16.175732 26740 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.206759 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:16.206198 22828 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 6 to 8, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 8 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.207341 26740 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:16.209656 26562 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:16.209800 26483 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:16.210150 26562 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:16.210628 26562 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.215276 26817 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.215802 26817 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:16.216681 26817 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:16.205088 26623 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:16.139618 26655 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.228595 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:16.230763 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:16.237174 22896 connection.cc:256] RPC call timeout handler was delayed by -1.589524969000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 13:10:16.234635 22828 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.242986 23005 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:16.242671 22972 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:16.244910 22828 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.246783 23045 leader_election.cc:400] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:16.247228 23045 leader_election.cc:403] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:16.250625 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:16.253281 23046 leader_election.cc:400] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:16.248034 26754 consensus_queue.cc:1059] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:16.229430 26562 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.260682 22828 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.248333 26690 tablet_copy_client.cc:538] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:16.271225 23006 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:10:16.271936 22998 raft_consensus.cc:2376] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6. Re-sending same reply.
I20260709 13:10:16.271955 23006 pending_rounds.cc:85] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 8
W20260709 13:10:16.264237 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 151849us
I20260709 13:10:16.259703 22970 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:16.254346 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.270481 23003 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:16.274660 23005 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:16.279610 26641 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:16.284121 26644 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:16.284845 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 159124us
I20260709 13:10:16.242827 26666 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:10:16.289373 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 57572.9us
I20260709 13:10:16.290433 23002 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:16.273286 23006 pending_rounds.cc:107] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:10:16.303323 23006 raft_consensus.cc:2889] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.262938 26655 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:16.291577 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.234521 26793 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:10:16.292282 25932 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.278360 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.307734 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.266605 26772 consensus_queue.cc:1059] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:16.314841 26772 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:16.315253 26772 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:16.316779 23622 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.317723 26849 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:16.318429 26849 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.318627 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:16.319890 26655 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:16.320286 26655 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.320629 26655 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.321130 25932 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:16.324136 26850 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.324602 26850 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.324996 26850 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.328651 26623 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:16.328944 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:16.329701 26483 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:16.330155 26483 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:16.330214 26562 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:16.330636 23000 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:16.302634 26754 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:16.331089 26754 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.331192 26483 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.333163 26483 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.334117 26797 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:16.329934 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 95697.4us
I20260709 13:10:16.340030 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:16.329840 26623 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:16.343178 22998 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:16.331553 26754 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.345121 23622 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:16.352291 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 61286.8us
W20260709 13:10:16.349828 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 103814us
W20260709 13:10:16.358160 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.340998 26623 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.339056 26762 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.339366 26666 consensus_queue.cc:1059] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:16.371026 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:16.351146 26562 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:10:16.367594 25932 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:10:16.389710 26666 raft_consensus.cc:3055] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:16.390149 26666 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:16.393564 22971 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.509s (SENT)
I20260709 13:10:16.395838 26573 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:16.395979 26820 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:16.396569 25932 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:16.396615 26573 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:16.397766 26820 consensus_queue.cc:1059] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:16.398583 26573 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:16.367884 26623 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.391116 26666 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.400722 26666 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.378994 26894 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.404210 26894 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.404577 26894 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.377959 26772 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.408962 26772 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.356235 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:16.309157 26641 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:16.414563 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 61673.9us
I20260709 13:10:16.407367 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:16.412533 22997 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:10:16.418560 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:16.420146 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 83494.2us
I20260709 13:10:16.395087 26655 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:16.424453 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 44923.1us
I20260709 13:10:16.451906 23078 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:16.425093 22896 connection.cc:256] RPC call timeout handler was delayed by -1.45452496900009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 13:10:16.452616 22896 connection.cc:256] RPC call timeout handler was delayed by -1.37172496900007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 13:10:16.452339 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45120us
I20260709 13:10:16.457633 22999 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:16.459116 23621 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:16.415964 26832 raft_consensus.cc:3055] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:16.481339 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.481369 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.482538 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:16.488656 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 138157us
I20260709 13:10:16.489254 22922 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:16.480270 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 84181.9us
I20260709 13:10:16.461040 22926 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:10:16.436061 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.491411 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.492381 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.494724 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.497831 23077 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:16.426370 26562 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.461409 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.485724 23074 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:16.481402 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:16.500361 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 149931us
W20260709 13:10:16.501629 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.460836 22896 connection.cc:256] RPC call timeout handler was delayed by -1.1265713950000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:10:16.486275 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:16.507402 22896 connection.cc:256] RPC call timeout handler was delayed by -1.0569613769999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:10:16.508296 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:16.508636 22896 connection.cc:256] RPC call timeout handler was delayed by -1.0569613769999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:10:16.455356 26650 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:16.509169 22896 connection.cc:256] RPC call timeout handler was delayed by -1.0245613770000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:10:16.516912 22896 connection.cc:256] RPC call timeout handler was delayed by -1.0180249690000664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2636s for a response
I20260709 13:10:16.509343 23072 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:16.509007 22924 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:16.512768 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.488431 26832 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:16.508399 23071 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
W20260709 13:10:16.517375 22896 connection.cc:256] RPC call timeout handler was delayed by -1.0146613770000386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 13:10:16.518179 23076 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:16.517966 23075 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:16.486760 26740 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:16.516618 22828 catalog_manager.cc:5697] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 3 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 8 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.509991 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.519930 23078 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:16.420624 26762 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.526777 23078 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:16.427784 26483 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:10:16.537472 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.538221 23076 raft_consensus.cc:2368] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7.
W20260709 13:10:16.540040 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.544149 22827 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35510 (request call id 351) took 20935 ms (client timeout 15000 ms). Trace:
I20260709 13:10:16.550683 26690 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Bootstrap starting.
I20260709 13:10:16.535004 22828 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 4 to 5, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:16.544557 22827 rpcz_store.cc:269] 0709 13:09:55.642438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.686996 (+ 44558us) service_pool.cc:224] Handling call
0709 13:10:16.543903 (+20856907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:12.349981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:12.393644 (+ 43663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:12.393708 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:10:12.393735 (+    27us) tablet.cc:662] Decoding operations
0709 13:10:12.443747 (+ 50012us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:12.460102 (+ 16355us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:12.481408 (+ 21306us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:10:13.099580 (+618172us) tablet.cc:701] Row locks acquired
0709 13:10:13.115478 (+ 15898us) write_op.cc:260] PREPARE: finished
0709 13:10:13.115710 (+   232us) write_op.cc:270] Start()
0709 13:10:13.115874 (+   164us) write_op.cc:276] Timestamp: P: 1783602613115599 usec, L: 0
0709 13:10:13.115897 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:13.116588 (+   691us) log.cc:844] Serialized 5939 byte log entry
0709 13:10:14.164618 (+1048030us) op_driver.cc:464] REPLICATION: finished
0709 13:10:14.295068 (+130450us) write_op.cc:301] APPLY: starting
0709 13:10:14.301460 (+  6392us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:14.301799 (+   339us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:14.301908 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:14.339713 (+ 37805us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:14.569947 (+230234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:10:14.585629 (+ 15682us) write_op.cc:312] APPLY: finished
0709 13:10:14.641769 (+ 56140us) log.cc:844] Serialized 107 byte log entry
0709 13:10:14.667534 (+ 25765us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.689184 (+ 21650us) write_op.cc:454] Released schema lock
0709 13:10:14.694641 (+  5457us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:14.856493 (+161852us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.856537 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33455,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":130132,"apply.run_cpu_time_us":11059,"apply.run_wall_time_us":533529,"num_ops":15,"prepare.queue_time_us":989656,"prepare.run_cpu_time_us":20308,"prepare.run_wall_time_us":864942,"raft.queue_time_us":348664,"raft.run_cpu_time_us":18078,"raft.run_wall_time_us":135199,"replication_time_us":1019965,"thread_start_us":1351189,"threads_started":4,"wal-append.queue_time_us":253184,"wal-append.run_cpu_time_us":50440,"wal-append.run_wall_time_us":2478199}]]}
I20260709 13:10:16.562558 22922 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:16.534822 26817 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.579154 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:16.582535 23074 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.555151 23078 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.584380 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:16.573343 25932 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:16.551990 26740 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:16.601584 23078 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.574273 22828 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: config changed from index 2 to 5, term changed from 5 to 9, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to <none>, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194), VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195), VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.606189 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:16.590090 26817 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.636479 26740 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.638695 26817 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:16.591890 26850 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.642187 26850 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:16.642911 26850 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:16.644929 23649 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: [2.5-7.9]
I20260709 13:10:16.646795 23657 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:16.649358 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.571542 26901 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:10:16.583717 26638 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:16.535902 26754 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.655943 22828 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.668780 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.680572 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.681600 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.678164 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:16.684255 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.677349 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.686334 23654 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:10:16.687696 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 98584.5us
I20260709 13:10:16.687783 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:16.660096 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 84651.7us
I20260709 13:10:16.702947 23655 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.704039 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.705726 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:16.706115 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.677736 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.706993 23073 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:16.707171 23656 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:16.707553 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 175027us
I20260709 13:10:16.707021 23652 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.707995 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.708117 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.708654 23657 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:16.710331 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.591086 26832 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.710175 23653 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:16.643533 26850 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.710976 22997 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.716136 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.719519 23649 raft_consensus.cc:2368] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:16.716820 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:16.716943 22828 catalog_manager.cc:5697] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.717875 23077 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.720994 23078 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:10:16.723104 23078 pending_rounds.cc:85] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 8
I20260709 13:10:16.722849 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.737368 23078 pending_rounds.cc:107] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:10:16.737797 23078 raft_consensus.cc:2889] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.740505 22927 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:16.741468 22828 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 5 to 10, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.748564 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.750147 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.752472 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.753252 23073 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:16.713702 26562 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:16.764863 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.721334 26655 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:16.766173 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.772167 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.777213 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.742311 26817 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.742089 26706 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:16.782256 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:16.784457 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.785861 22930 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.785414 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:16.787173 22927 raft_consensus.cc:2368] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:16.762544 26895 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.755005 26641 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:16.755030 26483 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.753300 25932 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:16.788821 22828 catalog_manager.cc:5697] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:16.789772 23654 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:16.718886 26894 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.790387 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:16.787593 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.796479 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:16.797724 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 81038.4us
I20260709 13:10:16.726485 26650 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:10:16.781718 26832 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.806037 23074 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:16.785744 26153 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.800107 23075 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:16.785878 26849 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.805655 23650 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:16.804822 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:16.808115 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 70120.6us
I20260709 13:10:16.812565 23654 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:10:16.811836 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.813905 23072 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:16.797135 23077 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:16.814066 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:16.813999 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.816675 23648 pending_rounds.cc:85] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 6
I20260709 13:10:16.817016 23648 pending_rounds.cc:107] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:10:16.817242 23648 raft_consensus.cc:2889] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.817588 23073 raft_consensus.cc:1240] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:10:16.818655 26903 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:16.819341 26910 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:16.822183 25932 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:16.822883 26905 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:10:16.824453 26904 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:16.825646 26780 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:16.826090 26780 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:16.805239 26483 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.829921 26483 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:16.832052 26918 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.832544 26918 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:16.834591 26918 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:16.829857 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 236634us
I20260709 13:10:16.842362 23656 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:16.806347 26913 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.846097 26850 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:16.806583 26909 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:16.857877 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50414.6us
I20260709 13:10:16.858608 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:16.827005 26780 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:16.862773 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.865265 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:16.865852 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:16.866155 23045 leader_election.cc:336] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.016s (SENT)
I20260709 13:10:16.814975 26901 consensus_queue.cc:1243] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:16.872498 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.873229 23002 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:16.880199 23073 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:16.879165 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.804780 26706 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.882737 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.816162 26153 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.888842 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:16.889549 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.887161 23650 raft_consensus.cc:2376] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6. Re-sending same reply.
I20260709 13:10:16.886382 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.870347 26573 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.808296 26895 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.896044 23652 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:16.901726 23622 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:16.908660 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.910341 23073 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:16.843806 26817 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:10:16.912353 23622 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:16.911443 26483 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.919688 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.928898 23652 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:16.942241 23653 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:16.878911 26740 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:10:16.897652 26666 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:16.951079 22895 leader_election.cc:400] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:16.951470 22895 leader_election.cc:403] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:16.907927 26901 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:16.911441 26910 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:16.911841 26780 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.855647 26913 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.914522 26641 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:16.920653 26655 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:16.954237 26910 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.957500 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.958141 26483 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:16.958722 26754 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:16.959537 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.953090 26850 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:16.971731 23652 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:16.965927 23076 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:16.873400 26562 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:16.967888 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.968580 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:16.950266 26666 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:16.912009 26573 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:16.964567 26772 consensus_meta.cc:287] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 13:10:16.990363 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.012082 23654 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:16.993180 26850 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:16.994216 26623 consensus_meta.cc:287] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.002s
W20260709 13:10:16.995601 26923 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:16.936653 26909 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:10:16.972059 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:17.004062 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 124122us
I20260709 13:10:16.971378 26910 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:17.028090 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 123730us
I20260709 13:10:17.010643 26666 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:17.015278 22998 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
W20260709 13:10:17.018920 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 152803us
I20260709 13:10:17.022682 22927 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:16.964138 26786 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:17.000255 23652 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:17.024909 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:16.960517 26849 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.033282 22925 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.029501 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.014432 26907 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.030145 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 58164.8us
I20260709 13:10:17.031839 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:16.992193 23657 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:17.034149 23654 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:17.050055 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:17.025194 26894 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:17.023933 26754 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:10:17.056896 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:17.071727 22930 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:17.047794 26641 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:17.025928 26623 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:17.080925 26915 log.cc:927] Time spent T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.227s	user 0.002s	sys 0.001s
I20260709 13:10:17.089498 26926 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:17.091832 23657 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:17.093490 23080 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:17.093950 23080 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:17.073565 23045 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.019s (SENT)
I20260709 13:10:17.081853 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.076340 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:17.083971 26766 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:17.095225 23653 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:17.107977 23657 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:17.109501 23657 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:17.110697 23657 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:17.112074 23653 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:17.113443 23078 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:17.113773 23078 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:17.114471 23078 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.055995 26916 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:17.097810 26766 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:17.115638 26916 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.116298 26766 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.052359 26907 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:17.121685 23654 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:17.122140 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:17.124044 26895 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:17.124069 26820 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:17.127733 23080 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.128716 23080 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.130851 26850 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.135950 23653 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:17.093320 26153 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:17.120651 26706 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:17.055050 26849 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.196892 26623 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:17.199095 26849 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:17.232110 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.135146 22929 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:17.245950 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:17.247633 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 187236us
W20260709 13:10:17.249145 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.264472 23078 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:17.265156 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 231994us
I20260709 13:10:17.268167 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.270133 26650 consensus_queue.cc:1059] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:17.271306 26650 raft_consensus.cc:3055] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:17.271749 26650 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:17.272882 26650 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.274430 26650 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:17.278959 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:17.283628 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:17.285636 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.285916 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:17.287015 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:17.287523 23072 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.288426 23075 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:10:17.289265 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.289654 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.279748 23004 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:17.291442 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:17.292001 22924 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.098461 26641 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:17.293004 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.296518 22928 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:17.293898 23078 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:17.295773 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.247833 26909 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:17.300758 22931 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
W20260709 13:10:17.301545 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 270614us
I20260709 13:10:17.301774 23621 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:17.312081 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:17.317149 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:17.318764 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.295353 26820 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.294941 26623 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.294961 26901 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.324827 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.320881 22925 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:17.327386 23074 raft_consensus.cc:1275] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:17.320765 22971 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:17.319963 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 302669us
W20260709 13:10:17.331496 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.332007 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.333683 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.336702 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.337410 23656 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:17.338117 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.338714 22931 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:17.339668 22926 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:17.344749 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:17.345561 23079 raft_consensus.cc:2410] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:17.346659 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:17.347209 23071 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.340979 22972 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:17.348253 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 44806.9us
I20260709 13:10:17.351538 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:17.352856 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.320685 26740 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.354012 22925 raft_consensus.cc:1275] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:10:17.358351 22927 raft_consensus.cc:2410] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:17.362922 23002 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:17.358814 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.363703 22929 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:17.359476 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:17.364848 23079 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:17.300755 25932 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:17.313687 26620 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:10:17.328214 26644 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:17.362864 22925 pending_rounds.cc:85] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 4
I20260709 13:10:17.385088 22925 pending_rounds.cc:107] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:17.385403 22925 raft_consensus.cc:2889] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:17.388098 23071 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
W20260709 13:10:17.373061 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 54749us
W20260709 13:10:17.389540 23620 connection.cc:256] RPC call timeout handler was delayed by -1.0437286480000694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
I20260709 13:10:17.395699 23046 leader_election.cc:400] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:17.396131 23046 leader_election.cc:403] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.421833 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.362798 26740 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.318096 26909 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.425431 26483 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:10:17.345109 26901 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.433017 26901 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:17.436463 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:17.338888 26623 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.411072 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:17.376845 26766 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.439168 23652 raft_consensus.cc:1240] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:17.331015 26820 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:17.438694 22971 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.454841 22970 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:17.457381 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.407815 26916 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:17.423882 26913 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:17.438575 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:17.476811 23648 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.460455 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:17.441701 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 149201us
I20260709 13:10:17.407629 26817 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.444989 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.439683 26740 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.477445 23652 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:10:17.479694 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 187785us
I20260709 13:10:17.444516 23656 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:17.445737 22924 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:17.423688 23080 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:17.446254 26644 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:17.501442 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:17.448426 26762 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:17.518079 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2359) took 1072 ms. Trace:
W20260709 13:10:17.475986 26902 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:10:17.461333 26797 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.531255 23080 rpcz_store.cc:276] 0709 13:10:16.427455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.427627 (+   172us) service_pool.cc:224] Handling call
0709 13:10:16.454520 (+ 26893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.093409 (+638889us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001c78a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f81dc0 00007f392500c1c0 00007f392500d231 00007f3925009d8f 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c
0709 13:10:17.499418 (+406009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.499640 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236907392}
I20260709 13:10:17.542044 22997 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:17.543905 23620 leader_election.cc:400] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7.
I20260709 13:10:17.544245 23620 leader_election.cc:403] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.547463 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.548245 23652 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:10:17.549517 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 222099us
I20260709 13:10:17.569329 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:17.441534 26935 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:17.530660 26793 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:17.517447 26926 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:17.545746 26832 consensus_meta.cc:287] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.732s	user 0.017s	sys 0.007s
W20260709 13:10:17.594700 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 253755us
I20260709 13:10:17.481775 26786 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:10:17.498711 26912 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:10:17.598423 23654 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:10:17.604089 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 53293.3us
I20260709 13:10:17.604287 26620 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:17.499467 26754 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 13:10:17.608878 23650 consensus_meta.cc:287] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.672s	user 0.020s	sys 0.002s
I20260709 13:10:17.619342 23650 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
W20260709 13:10:17.614318 23651 consensus_meta.cc:287] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.592s	user 0.016s	sys 0.019s
I20260709 13:10:17.620141 23651 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
W20260709 13:10:17.597347 26927 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:17.617470 23652 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:17.587697 26935 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.631814 26935 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.597107 26772 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.615675 26895 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 6. Current term is 7.
I20260709 13:10:17.499038 26641 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:17.633682 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 93757.1us
W20260709 13:10:17.647945 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 258990us
I20260709 13:10:17.650216 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:17.649397 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 129870us
I20260709 13:10:17.651819 23657 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
W20260709 13:10:17.654603 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.656872 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 125215us
I20260709 13:10:17.657727 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.659379 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:17.645674 26921 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.027s
I20260709 13:10:17.671260 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:17.684510 22930 consensus_meta.cc:287] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.007s
W20260709 13:10:17.656622 26910 consensus_meta.cc:287] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.006s
W20260709 13:10:17.685897 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 99215.1us
W20260709 13:10:17.659528 26925 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.566s	user 0.003s	sys 0.000s
I20260709 13:10:17.686182 22926 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:17.688632 22930 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:17.689530 22922 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [6.8-7.9]
W20260709 13:10:17.675379 26921 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.006s	sys 0.028s
I20260709 13:10:17.642480 26772 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.694554 26912 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:17.707289 23653 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:17.687116 26895 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.722173 23072 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:17.723832 23620 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.696781 25932 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.694380 26944 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.644078 26644 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.722793 26916 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:17.693059 26786 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:10:17.736907 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.729084 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.733821 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:17.694823 26910 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.771265 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:17.714594 26912 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:17.729138 26620 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:17.753516 26945 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:10:17.726038 26573 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:17.797888 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 148268us
I20260709 13:10:17.725934 26941 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 13:10:17.725781 26820 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:17.753724 26623 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:17.790138 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 66244.8us
W20260709 13:10:17.790868 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57135.6us
I20260709 13:10:17.806972 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:17.808009 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.809391 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:17.809635 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:17.810176 23080 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.811434 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:17.836930 22930 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:17.837024 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.773100 26909 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:17.840593 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:17.798954 26666 consensus_meta.cc:287] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.751s	user 0.017s	sys 0.000s
W20260709 13:10:17.839236 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.842737 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:17.842221 26931 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:10:17.856081 26942 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:10:17.865139 23080 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:17.866065 23648 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:17.867933 26964 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:17.868459 26946 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:10:17.869683 26959 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:17.870458 26959 raft_consensus.cc:2764] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:17.871942 26948 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:17.868127 26933 log.cc:927] Time spent T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:10:17.872522 26948 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.873024 26948 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.789921 26940 consensus_queue.cc:1059] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 13:10:17.845060 26620 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.878453 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.853767 26832 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.916819 26959 raft_consensus.cc:3055] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:17.917375 26959 raft_consensus.cc:740] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:17.918375 26959 consensus_queue.cc:260] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:17.920190 26959 raft_consensus.cc:3060] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.845975 26666 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:17.924501 26666 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:17.925185 26960 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:10:17.928355 23649 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.020s
I20260709 13:10:17.937944 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.902899 26623 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.956796 23620 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.960809 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:17.959410 23649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1037) took 1136 ms. Trace:
I20260709 13:10:17.964671 23620 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:17.965032 26947 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:17.966359 26483 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.967118 26483 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.967795 26962 consensus_queue.cc:1059] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:10:17.961843 23649 rpcz_store.cc:276] 0709 13:10:16.820766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.825392 (+  4626us) service_pool.cc:224] Handling call
0709 13:10:16.825718 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:16.953777 (+128059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.953810 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:16.972673 (+ 18863us) log.cc:844] Serialized 52 byte log entry
0709 13:10:17.326067 (+353394us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.934833 (+608766us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.955860 (+ 21027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.955966 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.956003 (+    37us) raft_consensus.cc:1685] finished
0709 13:10:17.956014 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.956930 (+   916us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79639,"prepare.queue_time_us":260539,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":7541,"raft.queue_time_us":48631,"raft.run_cpu_time_us":4351,"raft.run_wall_time_us":24013,"spinlock_wait_cycles":2304,"thread_start_us":898484,"threads_started":3,"wal-append.queue_time_us":450637}
I20260709 13:10:17.982833 22896 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.040575 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1104) took 1039 ms. Trace:
I20260709 13:10:18.044955 26926 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:18.045508 26759 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:18.045416 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 374247us
I20260709 13:10:17.960911 26620 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:18.047966 26573 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.048066 26666 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.051687 26706 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:17.982566 26849 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.970597 26894 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:10:18.047521 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.088591 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.089073 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.059156 23655 rpcz_store.cc:276] 0709 13:10:17.000870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.004180 (+  3310us) service_pool.cc:224] Handling call
0709 13:10:17.004518 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.004934 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.004967 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.005446 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.309720 (+304274us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.541425 (+231705us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.605367 (+ 63942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.605458 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.039235 (+433777us) raft_consensus.cc:1685] finished
0709 13:10:18.039266 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.040460 (+  1194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62480,"prepare.queue_time_us":237019,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":64914,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":9180,"thread_start_us":515137,"threads_started":2,"wal-append.queue_time_us":412085}
I20260709 13:10:18.075687 26941 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:18.076179 26759 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:18.076363 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.076828 26205 consensus_queue.cc:1048] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:17.956728 26634 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:18.080937 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.097397 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 139130us
I20260709 13:10:17.906941 26912 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:18.103999 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 452567us
I20260709 13:10:18.106819 23045 leader_election.cc:400] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
I20260709 13:10:18.099263 26759 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.085167 26573 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.120599 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:18.088079 26666 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.125823 23622 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:18.127333 26780 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 1.162s	user 0.009s	sys 0.013s
I20260709 13:10:18.138038 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.135010 23622 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.094172 26706 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:18.145905 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 43829.6us
I20260709 13:10:18.125988 26902 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:10:18.164860 26963 log.cc:927] Time spent T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:10:18.108568 26634 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.157781 23001 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:18.173547 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.112921 26786 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:10:18.120747 26940 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:18.136643 26620 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:18.181223 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 214891us
W20260709 13:10:18.187407 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.171061 26623 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:18.170693 26912 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:18.207355 26967 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:10:18.240253 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.316656 26980 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:18.248174 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 80873.9us
I20260709 13:10:18.164727 26958 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
W20260709 13:10:18.342334 22929 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.008s	sys 0.023s
W20260709 13:10:18.342792 22929 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.008s	sys 0.023s
I20260709 13:10:18.186264 26941 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:18.207317 26954 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:18.246943 26983 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:18.261312 26957 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:10:18.284514 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:18.286067 26970 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:10:18.287531 26706 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:18.288658 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:18.267970 26969 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:10:18.295547 26573 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:18.261242 26623 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:18.299114 26740 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.000s
I20260709 13:10:18.302618 26483 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.303246 26910 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:18.308470 26666 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:18.213531 26965 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:10:18.269302 26975 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:18.357458 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:18.355178 26941 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:18.257645 26620 raft_consensus.cc:697] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:18.336361 26766 consensus_meta.cc:287] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.876s	user 0.011s	sys 0.000s
I20260709 13:10:18.359018 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.157357 26926 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.362020 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:18.362387 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.362835 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:18.362902 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.396552 23653 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:18.363132 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:18.364161 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 226203us
I20260709 13:10:18.364962 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:18.366894 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2373) took 1038 ms. Trace:
I20260709 13:10:18.371080 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.317265 26980 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.389086 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:18.400875 23649 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.391575 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:18.397455 22926 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:18.397320 23075 rpcz_store.cc:276] 0709 13:10:17.325800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.330666 (+  4866us) service_pool.cc:224] Handling call
0709 13:10:17.353256 (+ 22590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.610176 (+256920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.610206 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.637248 (+ 27042us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.706701 (+ 69453us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:17.706745 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.707704 (+   959us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.364423 (+656719us) raft_consensus.cc:1685] finished
0709 13:10:18.364442 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.364566 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59994,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":252895,"threads_started":2,"wal-append.queue_time_us":148157}
I20260709 13:10:18.405452 23622 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:18.371061 26740 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.391379 26941 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.428239 22896 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.426530 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:18.411253 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 54365.1us
I20260709 13:10:18.429309 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:18.401006 26690 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.003s
I20260709 13:10:18.409626 26849 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:18.453451 26948 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:10:18.467985 23651 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:18.403014 26954 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:18.486358 26620 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.487067 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:18.407114 26907 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:18.395736 26759 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.484561 26894 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.485435 26740 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:18.459446 26623 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:18.485881 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 57753.7us
I20260709 13:10:18.486200 26948 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:18.480883 23649 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:18.457581 26706 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:18.500662 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 887) took 1246 ms. Trace:
I20260709 13:10:18.502748 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2372) took 1177 ms. Trace:
I20260709 13:10:18.476094 26483 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.476032 26959 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:18.512588 22923 rpcz_store.cc:276] 0709 13:10:17.243709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.243816 (+   107us) service_pool.cc:224] Handling call
0709 13:10:17.281711 (+ 37895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.550113 (+268402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.583148 (+ 33035us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.619141 (+ 35993us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.699129 (+ 79988us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.699178 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.700241 (+  1063us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.490184 (+789943us) raft_consensus.cc:1685] finished
0709 13:10:18.490210 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.490376 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159612,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11065,"thread_start_us":303548,"threads_started":2,"wal-append.queue_time_us":162613}
I20260709 13:10:18.513954 23078 rpcz_store.cc:276] 0709 13:10:17.325449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.325586 (+   137us) service_pool.cc:224] Handling call
0709 13:10:17.325890 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.330140 (+  4250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:17.353762 (+ 23622us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.715198 (+361436us) spinlock_profiling.cc:243] Waited 896 us on lock 0x7b18004be800. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa23a 00007f3925014a2a
0709 13:10:17.793072 (+ 77874us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.836512 (+ 43440us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.836648 (+   136us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:17.836680 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.836741 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.476300 (+639559us) raft_consensus.cc:1685] finished
0709 13:10:18.502492 (+ 26192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.502679 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5881,"prepare.queue_time_us":32263,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":6845,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":24864,"spinlock_wait_cycles":2061568,"thread_start_us":71703,"threads_started":1,"wal-append.queue_time_us":531054}
W20260709 13:10:18.504972 26966 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.317s	user 0.005s	sys 0.000s
W20260709 13:10:18.528388 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51722.1us
I20260709 13:10:18.529877 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:18.536386 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.536396 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.537298 23657 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:10:18.538246 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.538604 23045 connection.cc:256] RPC call timeout handler was delayed by -1.6144464080000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:10:18.538864 23045 connection.cc:256] RPC call timeout handler was delayed by -1.506446407999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 13:10:18.539160 23045 connection.cc:256] RPC call timeout handler was delayed by -1.3093464080000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:10:18.539407 23045 connection.cc:256] RPC call timeout handler was delayed by -1.2125615669999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:10:18.539637 23045 connection.cc:256] RPC call timeout handler was delayed by -1.1599464079999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:10:18.539934 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0726464079999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 13:10:18.540225 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0546464080000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:10:18.540503 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0365896170000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 13:10:18.500329 26894 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:18.541796 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 136442us
I20260709 13:10:18.542536 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.543222 23653 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:18.512224 26706 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.544432 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.548185 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:18.548286 22896 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.548455 22927 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:18.548790 22929 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.552253 26944 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:18.553998 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.554371 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.556192 26982 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:10:18.556541 26980 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:18.558971 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.559365 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.559983 26935 consensus_meta.cc:287] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.001s
I20260709 13:10:18.560215 26907 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.560379 26935 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.560704 26907 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:18.562425 26935 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:18.541077 26952 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.546842 26940 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.563926 23002 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 13: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:18.563568 26952 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:18.550477 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.568240 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:18.547155 26706 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.568791 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2378) took 1237 ms. Trace:
I20260709 13:10:18.569321 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:18.569169 23079 rpcz_store.cc:276] 0709 13:10:17.331495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.376045 (+ 44550us) service_pool.cc:224] Handling call
0709 13:10:17.416246 (+ 40201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.664153 (+247907us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:17.664472 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.763121 (+ 98649us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.769950 (+  6829us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.770469 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.770590 (+   121us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.770622 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.770698 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.281340 (+510642us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b18004be440. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:18.291546 (+ 10206us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b2400205028. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921da39c4 00007f3921da1acb 00007f3921f5cdc9 00007f3921f5ca55 00007f3921f5c09d 00007f3924b8e10e 00007f3924ba588c 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221
0709 13:10:18.568611 (+277065us) raft_consensus.cc:1685] finished
0709 13:10:18.568631 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.568743 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47277,"prepare.queue_time_us":6721,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":719,"raft.queue_time_us":261633,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":15563,"spinlock_wait_cycles":80769152,"thread_start_us":296387,"threads_started":2,"wal-append.queue_time_us":270309}
I20260709 13:10:18.556111 26759 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:18.571538 23077 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:18.576869 23649 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:18.562537 26907 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:18.573325 22929 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:18.578090 22922 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:18.578197 23078 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:18.580011 22922 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:18.550493 26984 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:10:18.596318 22896 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.598476 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:18.599509 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.593613 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:18.547345 26655 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:18.605355 22927 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:18.605552 22970 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.610827 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:18.611474 26894 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:18.612962 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:18.631706 23072 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.613125 26948 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:18.617089 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:18.617627 26959 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:18.618538 26983 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.596378 22922 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.620594 26849 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.594851 26935 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:18.594672 26940 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:18.622648 26952 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:18.623142 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.643340 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:18.645272 26786 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:18.645682 26786 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.645619 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:18.624428 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:18.647392 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:18.648262 23074 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:18.625893 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:18.650660 23080 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:18.651090 26655 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:18.578966 26989 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.640903 23077 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:18.646238 26786 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.651569 26655 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.643944 22922 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:18.654338 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48849.3us
I20260709 13:10:18.656522 23077 raft_consensus.cc:1275] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:18.657613 23072 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:18.658630 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.626935 26954 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:18.640057 26766 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:18.632563 26944 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:18.631502 26993 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:18.666180 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 66735.3us
I20260709 13:10:18.673391 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:18.673838 23045 leader_election.cc:400] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:18.674619 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.667047 26938 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:18.667269 26666 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:18.667680 26949 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.668066 26655 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:18.668267 26989 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:18.669605 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.671746 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.675760 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:18.676563 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.683357 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:18.660347 26849 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.665771 26766 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:18.644043 26988 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:18.679237 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:18.672299 26959 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:18.680267 26948 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.683351 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.683733 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:18.683943 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:18.696244 23652 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.684906 23001 raft_consensus.cc:2393] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 4: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:18.695964 23654 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:18.685020 23653 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:18.676896 23648 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:18.663512 26954 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:18.702015 26954 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.704478 26953 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:18.704864 26953 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:18.705509 22922 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:18.705886 22922 pending_rounds.cc:85] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 7
I20260709 13:10:18.706110 22922 pending_rounds.cc:107] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:18.705698 26953 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:18.706341 22922 raft_consensus.cc:2889] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:18.706899 26953 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.707494 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.708043 26901 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:18.708146 22998 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:18.708487 26901 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:18.709679 26901 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:18.710944 26901 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.687417 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:18.712215 26916 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.713371 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.678962 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:18.715968 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.670959 26817 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.688158 26766 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.685951 26952 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.715905 23621 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:18.718860 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:18.719053 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:18.696327 22971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.061s (SENT) [suppressed 34 similar messages]
I20260709 13:10:18.723286 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.729242 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:18.731973 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.733588 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:18.686087 26944 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:18.690618 26989 raft_consensus.cc:697] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:18.780511 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.780470 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.780762 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.780470 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.784982 22998 raft_consensus.cc:2410] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:10:18.782276 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48801.6us
I20260709 13:10:18.785247 23000 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:18.780812 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:18.780315 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:18.682346 26993 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:18.781471 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 58257.6us
I20260709 13:10:18.695678 26948 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:18.792272 23071 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:18.789034 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.735787 26780 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:18.735071 26916 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:18.739367 26850 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:18.803929 23652 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
W20260709 13:10:18.805505 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 99646.2us
W20260709 13:10:18.809309 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.785164 26832 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.782781 26894 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:18.789973 26740 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.693434 26941 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.796193 26948 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:18.832229 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 135934us
I20260709 13:10:18.742292 26912 consensus_queue.cc:1059] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:10:18.800024 26780 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.834887 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:18.834789 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:18.840108 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.805052 26916 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:18.868052 22930 raft_consensus.cc:1240] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:18.869200 26910 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.831442 26894 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.810603 26954 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.864378 26780 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.869829 26912 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:18.868323 26916 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:18.878157 26950 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:18.887410 26950 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:18.887849 26941 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:18.888336 26950 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.888902 26938 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.889434 26938 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:18.873337 26894 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.872314 26850 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.834949 26983 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:10:18.872931 26910 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.901454 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2377) took 1573 ms. Trace:
I20260709 13:10:18.903002 23073 rpcz_store.cc:276] 0709 13:10:17.328435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.362743 (+ 34308us) service_pool.cc:224] Handling call
0709 13:10:17.384108 (+ 21365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.439162 (+ 55054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.439213 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.479433 (+ 40220us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.697315 (+217882us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:17.697371 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.050596 (+353225us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b480018c258. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3929f33aa1 00007f3929f2ab37 00007f3929f2a9ca 00007f392a02226f 00007f392a021f37 00007f392a03655c 00007f392a036508 00007f392a036488 00007f392a036443 00007f392a0356ec 00007f3928f5fa96
0709 13:10:18.901157 (+850561us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54003890d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:18.901214 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.901254 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:18.901266 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.901396 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54388,"raft.queue_time_us":201537,"raft.run_cpu_time_us":3461,"raft.run_wall_time_us":407127,"spinlock_wait_cycles":129432192,"thread_start_us":147119,"threads_started":1,"wal-append.queue_time_us":238259}
I20260709 13:10:18.891861 26944 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.912070 26706 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.914124 26706 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:18.920632 27015 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.903141 26850 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.921712 23655 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:18.885236 26912 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:18.921190 27015 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:18.927724 27002 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:10:18.929215 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:18.939576 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:18.899498 26759 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.942996 26793 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.944499 22999 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.947118 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:18.950793 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 164961us
I20260709 13:10:18.952483 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:18.878091 26959 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:18.945449 26901 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.961783 26949 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:18.985589 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.941702 26766 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.945253 26759 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.951799 26793 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:18.964730 26912 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:19.123940 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 175866us
I20260709 13:10:18.892381 26989 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.197785 26993 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:19.052152 26573 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:19.197592 27022 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:19.198297 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 238407us
I20260709 13:10:18.962992 26740 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:19.199062 26910 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.199644 26634 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:19.200312 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.200166 26901 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:19.063484 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 410121us
W20260709 13:10:19.211942 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.320994 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.214972 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:19.213850 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 424891us
I20260709 13:10:19.254240 23074 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:19.208453 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 241304us
I20260709 13:10:19.285162 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:19.285753 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:19.204720 27015 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:19.205441 26916 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.206259 26850 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:18.946933 26762 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:18.951354 26666 consensus_queue.cc:1059] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:10:19.203048 26894 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.206811 26780 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.300992 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:19.576421 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:19.301703 23077 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:19.218946 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:19.294018 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:19.315259 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:19.340952 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:19.580794 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 295043us
I20260709 13:10:19.203135 22999 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:19.343011 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:19.257138 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:19.576581 23073 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:19.262535 26690 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:10:19.588754 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 262515us
I20260709 13:10:19.589802 23045 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:19.592113 23006 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:19.342607 26817 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.007s
I20260709 13:10:19.332588 22926 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:10:19.521229 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 198039us
I20260709 13:10:19.211623 26938 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:19.571452 26762 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.256062 26759 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.218532 26954 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.289754 26740 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.266266 27007 log.cc:927] Time spent T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.407s	user 0.002s	sys 0.000s
I20260709 13:10:19.597715 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:19.639424 22928 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.598647 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:19.522982 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:19.511699 26976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.019s	sys 0.078s
W20260709 13:10:19.271522 27019 log.cc:927] Time spent T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260709 13:10:19.607273 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 350184us
I20260709 13:10:19.254029 26766 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.222148 27026 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.300845 26641 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.260403 26912 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:19.609527 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:19.614701 23071 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:19.616657 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:19.573616 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:19.602819 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:19.619974 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:19.257854 26793 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.519706 26483 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.623708 22997 raft_consensus.cc:2368] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:19.573966 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:19.646032 26786 consensus_meta.cc:287] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.990s	user 0.007s	sys 0.011s
W20260709 13:10:19.631891 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 288963us
I20260709 13:10:19.596726 26952 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.641542 26740 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:19.608331 26817 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.259449 26623 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.364s
W20260709 13:10:19.644379 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 54697.3us
I20260709 13:10:19.689059 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:19.645404 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:19.647640 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:19.690919 23073 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:19.207630 26948 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.271986 26754 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.359s
I20260709 13:10:19.270530 26573 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.412s
I20260709 13:10:19.630827 26996 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:19.671646 22926 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:19.631063 27015 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.277350 26966 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.321s	user 0.006s	sys 0.003s
I20260709 13:10:19.633960 26944 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:19.647030 26976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.033s	sys 0.092s
I20260709 13:10:19.236605 26772 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.674994 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:19.676759 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:19.731149 22931 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:19.224254 27029 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.681123 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 78412.2us
I20260709 13:10:19.734205 22927 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:19.344482 26935 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:19.344854 26634 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.680197 26483 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.642963 26953 raft_consensus.cc:2804] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:19.694752 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 47204.3us
I20260709 13:10:19.623309 26762 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:19.701269 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:19.702701 23045 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:19.793629 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 91053us
I20260709 13:10:19.794550 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:19.697715 26793 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:19.683051 26926 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:19.715943 23079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2386) took 1163 ms. Trace:
I20260709 13:10:19.705458 23004 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:19.733951 26938 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:19.784039 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.673529 26641 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:19.683643 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 74209.4us
I20260709 13:10:19.806295 22971 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:19.782438 26996 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:19.668926 27026 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:19.682958 26952 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:19.797736 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 197276us
I20260709 13:10:19.704201 26655 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.688515 27033 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.706663 26690 tablet_bootstrap.cc:492] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Bootstrap complete.
I20260709 13:10:19.799952 23079 rpcz_store.cc:276] 0709 13:10:18.552599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.572206 (+ 19607us) service_pool.cc:224] Handling call
0709 13:10:18.594919 (+ 22713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.595238 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.595264 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.600445 (+  5181us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.640020 (+ 39575us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:18.640205 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.640279 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.265733 (+625454us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:19.707349 (+441616us) raft_consensus.cc:1685] finished
0709 13:10:19.707374 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.715876 (+  8502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20923,"raft.queue_time_us":83,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":15822,"spinlock_wait_cycles":8255360,"thread_start_us":33719,"threads_started":1,"wal-append.queue_time_us":128378}
I20260709 13:10:19.801858 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:19.707026 26910 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:19.684640 26786 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.815167 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:19.730566 27015 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.799453 26766 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:19.803618 26926 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.743729 27031 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.813383 26901 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.805684 26953 raft_consensus.cc:697] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:19.809490 26938 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:19.784451 27029 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.789696 26634 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.800311 26981 consensus_queue.cc:1048] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:10:19.849850 26954 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:19.804973 26793 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:19.894647 22929 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:19.860316 26916 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:19.862159 26910 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:19.865231 26766 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:19.858807 26894 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:19.868005 26948 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:19.922165 27042 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:19.867215 26754 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:19.901295 26690 ts_tablet_manager.cc:1403] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Time spent bootstrapping tablet: real 3.351s	user 0.048s	sys 0.067s
I20260709 13:10:19.900933 26573 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:19.929168 22928 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:19.911942 26793 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:19.867301 26926 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.862157 27033 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.864991 27040 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:10:19.919788 26910 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:19.923374 26766 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.923992 27044 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:19.939109 27022 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:19.945008 26754 raft_consensus.cc:697] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:19.972250 26483 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:19.971853 26754 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:19.913651 27031 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:19.895856 26996 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:19.979727 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 188323us
I20260709 13:10:19.960114 27044 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:19.968391 27039 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:10:19.985214 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:19.975142 27034 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:10:20.026895 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:20.027604 23652 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 3.
I20260709 13:10:20.029551 22971 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:20.030427 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 228661us
I20260709 13:10:20.031252 22972 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:20.032030 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:19.987640 27036 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:10:20.033592 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:20.036191 23651 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
W20260709 13:10:20.034263 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 54787.7us
I20260709 13:10:20.041070 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:20.041381 23648 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:20.041728 23649 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:20.043079 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:20.043797 23650 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.049552 23654 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:20.029984 26983 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:19.988570 26894 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:20.036396 27032 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:10:19.976183 27022 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.026520 26483 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.026706 26981 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.060370 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 245274us
I20260709 13:10:19.965271 26953 consensus_queue.cc:237] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.055455 22971 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:20.065697 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:19.988409 27046 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:10:20.072539 23650 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:19.991542 27044 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:20.050722 26935 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:20.101414 23002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 877) took 1614 ms (client timeout 1522 ms). Trace:
I20260709 13:10:20.097815 22971 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:20.083361 23620 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:20.083745 27047 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:10:20.101894 23002 rpcz_store.cc:269] 0709 13:10:18.486698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.486847 (+   149us) service_pool.cc:224] Handling call
0709 13:10:20.101211 (+1614364us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b5400012554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:20.101343 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175100672}
W20260709 13:10:20.083849 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.084365 26959 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.084496 26786 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:20.033950 26850 consensus_queue.cc:1059] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:10:20.088131 27056 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.093639 26690 raft_consensus.cc:359] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 7 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:20.091727 26981 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.096181 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:20.115161 23654 raft_consensus.cc:1240] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:20.117578 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 51955.8us
I20260709 13:10:20.068841 26983 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:20.152541 26983 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.127205 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:20.090164 26916 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:20.156291 26916 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.075479 27055 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:20.144443 27056 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.101565 26935 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.117106 27049 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:20.108265 27015 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:20.110616 27026 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:20.078735 26894 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.123224 27054 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.099447 26483 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.094596 26762 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:20.343884 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 263856us
I20260709 13:10:20.128443 26817 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:20.346961 27015 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:20.348007 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 2028) took 1064 ms. Trace:
I20260709 13:10:20.376616 22923 rpcz_store.cc:276] 0709 13:10:19.283438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.291070 (+  7632us) service_pool.cc:224] Handling call
0709 13:10:19.291415 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.291787 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.291815 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.292295 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.682702 (+390407us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:19.682764 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.682858 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.347733 (+664875us) raft_consensus.cc:1685] finished
0709 13:10:20.347762 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.347941 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2428,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":389846,"threads_started":1,"wal-append.queue_time_us":445903}
I20260709 13:10:20.166494 26938 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:20.149538 26634 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:20.123924 26959 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.146310 27043 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.228s
I20260709 13:10:20.371747 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:20.374414 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 222143us
W20260709 13:10:20.384662 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 257514us
I20260709 13:10:20.189483 26786 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.172519 27029 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:20.401861 23001 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:20.192189 26935 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.420958 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:20.309103 26952 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:20.350858 27055 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:20.400226 23655 raft_consensus.cc:2376] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11. Re-sending same reply.
I20260709 13:10:20.193867 26690 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Initialized, Role: LEARNER
I20260709 13:10:20.192446 27049 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.374295 26817 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.441026 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:20.393074 27015 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:20.393812 27033 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:20.445732 22972 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:20.454820 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:20.227811 27053 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.214s
I20260709 13:10:20.443190 27052 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:20.440876 27049 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:20.444077 26817 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:20.452569 27015 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:20.403286 27011 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:10:20.473258 26907 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:20.461678 27033 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:20.452706 27055 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:20.464839 27031 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:20.493783 27056 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:20.494256 26793 consensus_meta.cc:287] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.000s
I20260709 13:10:20.476193 27052 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.494988 26483 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:20.495266 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2398) took 1754 ms. Trace:
W20260709 13:10:20.515997 27041 log.cc:927] Time spent T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 13:10:20.516368 27055 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.517035 27071 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:10:20.517472 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2399) took 1221 ms. Trace:
I20260709 13:10:20.489388 27026 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:20.504557 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.487973 27012 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.004s	sys 0.000s
I20260709 13:10:20.513617 23077 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:20.488408 27059 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.474010 26690 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:20.553112 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2492) took 1266 ms. Trace:
I20260709 13:10:20.518953 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:20.576256 23080 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:20.575328 22929 rpcz_store.cc:276] 0709 13:10:19.286739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.311764 (+ 25025us) service_pool.cc:224] Handling call
0709 13:10:20.552847 (+1241083us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400346a54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:20.553036 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515419520}
I20260709 13:10:20.518018 23072 rpcz_store.cc:276] 0709 13:10:19.295786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.302305 (+  6519us) service_pool.cc:224] Handling call
0709 13:10:19.302594 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.302931 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.302966 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.303558 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.850170 (+546612us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:19.850212 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.850298 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.517167 (+666869us) raft_consensus.cc:1685] finished
0709 13:10:20.517196 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.517382 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1047,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":275764,"threads_started":1,"wal-append.queue_time_us":455714}
I20260709 13:10:20.516280 23071 rpcz_store.cc:276] 0709 13:10:18.740680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.807539 (+ 66859us) service_pool.cc:224] Handling call
0709 13:10:18.832473 (+ 24934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.669639 (+837166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.495037 (+825398us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540021aa54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:20.495207 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798370688}
W20260709 13:10:20.579777 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 106490us
I20260709 13:10:20.585242 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:20.578536 27012 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.688s	user 0.004s	sys 0.008s
I20260709 13:10:20.556533 26849 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:20.532580 27060 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.544185 27061 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:20.576736 26981 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:20.600955 27064 log.cc:927] Time spent T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:10:20.520243 26793 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.607788 27060 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:20.621098 27051 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 13:10:20.622394 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 749) took 1299 ms. Trace:
I20260709 13:10:20.622718 23073 rpcz_store.cc:276] 0709 13:10:19.322929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.702127 (+379198us) service_pool.cc:224] Handling call
0709 13:10:19.731192 (+ 29065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.731551 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.731581 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.786976 (+ 55395us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.966767 (+179791us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:19.966827 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.966933 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.622171 (+655238us) raft_consensus.cc:1685] finished
0709 13:10:20.622192 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.622329 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2301,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7209,"thread_start_us":179392,"threads_started":1,"wal-append.queue_time_us":257860}
I20260709 13:10:20.633718 26759 raft_consensus.cc:3055] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:20.634277 26759 raft_consensus.cc:740] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:20.636493 23002 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:20.637044 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:20.637879 23000 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:20.638545 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:20.639128 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:20.640379 22998 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:20.641669 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:20.610464 26762 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:20.644513 26912 consensus_meta.cc:287] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.971s	user 0.011s	sys 0.000s
W20260709 13:10:20.649044 27075 log.cc:927] Time spent T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
W20260709 13:10:20.654301 26740 consensus_meta.cc:287] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.955s	user 0.009s	sys 0.000s
I20260709 13:10:20.655483 27052 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:20.602070 26894 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:20.655556 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.683082 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:20.582746 27059 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:20.656738 26959 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:20.657696 26987 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:20.657905 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.696795 22929 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:20.658290 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.611124 27061 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.594110 27026 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:20.659785 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.705053 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:20.661789 27011 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.662410 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.662511 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.663213 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.668220 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:20.676337 23620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.017s
W20260709 13:10:20.738499 23620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.003s	sys 0.017s
I20260709 13:10:20.529199 26983 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.686094 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:20.697994 22922 raft_consensus.cc:2410] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:20.698572 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.703969 23075 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:20.728933 27059 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:20.737941 22931 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:20.729049 26953 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:20.745245 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2389) took 2168 ms. Trace:
I20260709 13:10:20.745491 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:20.635443 26759 consensus_queue.cc:260] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:20.738806 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 655486us
I20260709 13:10:20.739042 22925 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:10:20.734227 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 80828.7us
I20260709 13:10:20.745779 23074 rpcz_store.cc:276] 0709 13:10:18.576798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.649926 (+ 73128us) service_pool.cc:224] Handling call
0709 13:10:18.650210 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.329730 (+679520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.744978 (+1415248us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400268754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:20.745177 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388632448}
I20260709 13:10:20.746445 22929 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:20.692344 26912 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.696507 26987 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:20.731986 26766 consensus_meta.cc:287] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.005s
I20260709 13:10:20.754859 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:20.767354 23652 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.756742 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:20.770447 23657 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:20.771528 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:20.761178 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:20.730765 27061 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:20.744592 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 151984us
I20260709 13:10:20.686832 26740 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.778016 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:20.778976 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:20.778388 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:20.787804 23654 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:20.788298 23652 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:20.786684 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:20.746671 26894 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.791731 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:20.794876 23071 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:20.796087 23653 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:20.795953 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:20.762396 27059 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:20.765743 27052 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:20.779613 26941 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.819s	user 0.025s	sys 0.012s
I20260709 13:10:20.845703 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:20.863023 23650 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:20.773941 26912 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.848878 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:20.870524 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 80764.2us
I20260709 13:10:20.871348 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:20.848881 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:20.789676 26926 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.840s	user 0.002s	sys 0.010s
I20260709 13:10:20.763484 26953 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.863574 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:20.799356 23077 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:20.799273 26759 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:20.873548 23080 raft_consensus.cc:2410] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:10:20.862762 26941 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.906s	user 0.029s	sys 0.012s
I20260709 13:10:20.880575 23074 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:20.779047 26766 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:20.872699 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 101208us
I20260709 13:10:20.875151 23073 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:20.847265 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:20.884840 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:20.745282 27026 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:20.888787 23004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1934) took 2164 ms (client timeout 1528 ms). Trace:
I20260709 13:10:20.929229 23650 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
W20260709 13:10:20.891304 23004 rpcz_store.cc:269] 0709 13:10:18.718718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.718825 (+   107us) service_pool.cc:224] Handling call
0709 13:10:20.883253 (+2164428us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b540030e654. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:20.883366 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221881088}
I20260709 13:10:20.799515 26894 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:20.931785 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 47012.1us
I20260709 13:10:20.751008 27011 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:20.849826 27059 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:20.792196 27061 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:20.934713 23076 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:20.935086 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 136855us
I20260709 13:10:20.930800 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:20.885506 27023 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:20.869318 27052 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.929642 26996 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.880477 26926 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:20.935235 26913 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.958452 22931 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:20.938611 27094 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.943424 27012 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:20.942384 26793 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:20.888820 27049 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.963971 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:20.976091 23079 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:20.939349 27015 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.965106 27046 consensus_queue.cc:1059] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:20.965911 27080 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:20.961007 26690 ts_tablet_manager.cc:1434] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Time spent starting tablet: real 1.015s	user 0.004s	sys 0.030s
I20260709 13:10:20.968974 26912 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:20.955220 27044 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.000s
I20260709 13:10:20.971012 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:20.972637 23073 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:20.977628 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:20.957695 26754 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.964707 27012 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:20.983127 26910 consensus_meta.cc:287] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 1.022s	user 0.005s	sys 0.010s
I20260709 13:10:20.880636 26987 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.955363 27023 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:20.957647 26996 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.969522 26913 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:20.994426 27060 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:20.992596 27080 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:20.984042 26690 ts_tablet_manager.cc:1467] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Tablet startup took 1044ms
I20260709 13:10:20.999719 27012 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:21.007419 27085 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:21.043628 27091 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:20.996721 27044 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:21.019179 23072 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:21.020284 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:21.000319 26740 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.026520 27052 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.028999 27011 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.029333 27080 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:21.031536 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:21.006803 26983 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:21.004653 26910 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:21.002704 26754 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:21.048278 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:21.697243 23071 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
W20260709 13:10:21.532524 23080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.007s
W20260709 13:10:21.704051 23080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.006s	sys 0.009s
W20260709 13:10:21.482168 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 469841us
I20260709 13:10:21.705138 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:21.057323 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:21.706183 23079 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:21.707028 22929 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
W20260709 13:10:21.567729 23045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.005s	sys 0.009s
W20260709 13:10:21.740752 23045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.007s	sys 0.010s
I20260709 13:10:21.695946 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 889) took 2355 ms. Trace:
W20260709 13:10:21.087293 26817 consensus_meta.cc:287] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.004s
W20260709 13:10:21.488008 26759 consensus_meta.cc:287] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 13:10:21.781292 23001 rpcz_store.cc:276] 0709 13:10:19.340519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.340641 (+   122us) service_pool.cc:224] Handling call
0709 13:10:21.695706 (+2355065us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b540030f2d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:21.695880 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1893442304}
W20260709 13:10:21.251165 27099 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:10:21.629017 27012 consensus_meta.cc:287] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
I20260709 13:10:21.183947 26894 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.021636 27033 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 4, Time since last communication: 0.837s
W20260709 13:10:21.281443 26935 consensus_meta.cc:287] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.839s	user 0.007s	sys 0.003s
W20260709 13:10:21.821292 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.018s
I20260709 13:10:21.034207 26987 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:21.807945 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 102910us
W20260709 13:10:21.858368 23652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.008s	sys 0.029s
I20260709 13:10:21.086210 26953 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:21.114813 26766 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:21.208141 27059 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:21.265201 27049 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:21.050209 27087 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:10:21.862963 22924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 903) took 3147 ms (client timeout 2102 ms). Trace:
I20260709 13:10:21.044540 27015 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.164014 26996 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.807134 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:21.114882 26780 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:21.555056 27046 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:21.263167 26926 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.808563 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:21.044503 27091 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.814s
W20260709 13:10:21.881124 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.03387e+06us
I20260709 13:10:21.797243 27011 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:21.861172 26952 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.821867 26983 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:21.886268 26941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.014s	sys 0.027s
W20260709 13:10:21.889819 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.011s	sys 0.018s
I20260709 13:10:21.904054 23072 raft_consensus.cc:2410] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:21.913667 26916 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:21.997014 26941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.015s	sys 0.027s
W20260709 13:10:22.000854 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.895874 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:21.891891 23652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.008s	sys 0.029s
W20260709 13:10:21.928454 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.889305 23650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.011s	sys 0.060s
I20260709 13:10:21.891412 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:21.903286 22924 rpcz_store.cc:269] 0709 13:10:18.678558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.679019 (+   461us) service_pool.cc:224] Handling call
0709 13:10:21.809910 (+3130891us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002a8354. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:21.825802 (+ 15892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342411520}
I20260709 13:10:21.956336 26913 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:21.956477 26766 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.964013 22923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.007s	sys 0.015s
W20260709 13:10:22.029973 22923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.008s	sys 0.015s
I20260709 13:10:22.030619 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 910) took 1087 ms. Trace:
I20260709 13:10:21.899096 27023 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:21.861745 26817 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:21.905666 27092 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.940s	user 0.000s	sys 0.031s
I20260709 13:10:22.061197 26983 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.036832 26766 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:21.898641 26935 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.113189 22924 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:21.918780 26976 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:21.970943 27011 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:21.030236 26690 ts_tablet_manager.cc:1469] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Trace:
0709 13:10:09.629952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.634793 (+  4841us) service_pool.cc:224] Handling call
0709 13:10:10.330793 (+696000us) ts_tablet_manager.cc:934] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Initiating tablet copy from peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
0709 13:10:11.460340 (+1129547us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b4c004cf580. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f39232d6a20 00007f39232e7a29 00007f39232e813f 00007f39232ac2ab 00007f39232d9f3c 00007f39232da461 00007f39232da768 00007f39290602eb 00007f3929f85d3b 00007f3929f80008 00007f3929f7f405
0709 13:10:14.283902 (+2823562us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:15.290718 (+1006816us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:15.291975 (+  1257us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:15.633959 (+341984us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:15.656226 (+ 22267us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:15.656569 (+   343us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:15.656772 (+   203us) inbound_call.cc:177] Queueing success response
0709 13:10:16.550240 (+893468us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:10:19.946373 (+3396133us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:10:20.084154 (+137781us) tablet_replica.cc:261] Starting instrumentation
0709 13:10:20.084886 (+   732us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":7046,"mutex_wait_us":6505,"raft.queue_time_us":3513,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11874,"spinlock_wait_cycles":339438976,"tablet-copy.queue_time_us":628231,"tablet-download-pool.queue_time_us":234,"tablet-download-pool.run_cpu_time_us":1418,"tablet-download-pool.run_wall_time_us":385100,"thread_start_us":1040151,"threads_started":2}
I20260709 13:10:22.032727 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:22.132371 23655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1132) took 2145 ms (client timeout 2061 ms). Trace:
I20260709 13:10:21.965377 23045 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:22.132800 23655 rpcz_store.cc:269] 0709 13:10:19.987053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.987190 (+   137us) service_pool.cc:224] Handling call
0709 13:10:22.126255 (+2139065us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b540046e6d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:22.132304 (+  6049us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844766976}
W20260709 13:10:22.133366 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 168435us
W20260709 13:10:22.133750 22927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2498) took 2560 ms (client timeout 1915 ms). Trace:
W20260709 13:10:22.033440 23650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.014s	sys 0.067s
I20260709 13:10:22.030956 22923 rpcz_store.cc:276] 0709 13:10:20.943432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.943555 (+   123us) service_pool.cc:224] Handling call
0709 13:10:20.947026 (+  3471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.947209 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:20.957463 (+ 10254us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.030293 (+1072830us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.030341 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:22.030389 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.030465 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.030568 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11218,"prepare.queue_time_us":11922,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":596052,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1072392,"threads_started":2,"wal-append.queue_time_us":1042358}
I20260709 13:10:21.879627 27012 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:21.901024 26953 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.887391 27055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.009s	sys 0.031s
I20260709 13:10:21.917987 26641 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.138798 26754 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:21.958976 27046 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.138702 26953 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.140609 26766 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.140829 26953 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.141032 27046 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.114751 22924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 912) took 1167 ms. Trace:
I20260709 13:10:22.118918 26916 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.120790 27100 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:10:22.121963 27105 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:22.033859 26952 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:22.128648 27106 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:22.115017 27023 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:22.113251 26780 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:22.117627 27115 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.032891 23001 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:10:22.198446 23001 pending_rounds.cc:85] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 8
I20260709 13:10:22.198688 23001 pending_rounds.cc:107] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:10:22.198890 23001 raft_consensus.cc:2889] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:22.134331 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 218128us
W20260709 13:10:22.133997 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 171697us
W20260709 13:10:22.134903 22997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 1933) took 3416 ms (client timeout 1904 ms). Trace:
W20260709 13:10:22.199810 22997 rpcz_store.cc:269] 0709 13:10:18.718395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.718547 (+   152us) service_pool.cc:224] Handling call
0709 13:10:22.122801 (+3404254us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400211e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:22.134842 (+ 12041us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034597632}
W20260709 13:10:22.134115 22927 rpcz_store.cc:269] 0709 13:10:19.573314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.598419 (+ 25105us) service_pool.cc:224] Handling call
0709 13:10:22.123812 (+2525393us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b5400220e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:22.133686 (+  9874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215439104}
I20260709 13:10:22.138036 27107 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.138116 26910 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:22.138720 27055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.009s	sys 0.032s
I20260709 13:10:22.141321 27094 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.141666 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.032562 26926 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:22.211755 26926 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.212423 26817 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.212602 26952 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.213735 26926 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.142078 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.142333 27059 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.214877 27059 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.144956 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:22.146052 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 254816us
I20260709 13:10:22.216282 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:22.146543 27069 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:22.219972 27069 raft_consensus.cc:697] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:22.220875 27069 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.223876 27110 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:22.224589 27110 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:22.147337 27093 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 1.213s	user 0.026s	sys 0.009s
I20260709 13:10:22.147910 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.225435 27110 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.226241 22998 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:22.227072 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:22.227219 22998 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.227731 22997 raft_consensus.cc:2368] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:22.148041 26976 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:22.228204 23003 raft_consensus.cc:1217] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 13:10:22.228960 23003 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:22.229012 26976 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:22.230413 27111 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:10:22.150728 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.56217e+06us
W20260709 13:10:22.232245 27108 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:10:22.150849 27012 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.151885 27044 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.156361 22924 rpcz_store.cc:276] 0709 13:10:20.947578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.034058 (+1086480us) service_pool.cc:224] Handling call
0709 13:10:22.068798 (+ 34740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.114423 (+ 45625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.114676 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.157647 23071 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:22.115885 27022 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:22.205196 27115 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.236934 23004 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:22.237990 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.243989 23648 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:22.179338 26916 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:22.193427 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 81450.8us
I20260709 13:10:22.194641 23079 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.194658 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:22.195712 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.245800 23072 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:22.246147 23073 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.196834 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.203632 23655 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:22.246785 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.246807 23657 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.206218 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2341) took 1246 ms. Trace:
I20260709 13:10:22.207427 26772 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.248186 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.261384 23079 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
W20260709 13:10:22.207695 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 75999.3us
I20260709 13:10:22.208823 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.207464 26754 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.225235 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.263020 23001 raft_consensus.cc:2410] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:22.263192 23000 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 12: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:22.249536 23654 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:22.264940 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.265563 23654 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:22.250706 22971 leader_election.cc:336] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811): Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 2.061s (SENT)
I20260709 13:10:22.268148 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:22.274905 23654 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:22.280661 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:22.248783 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 97055.2us
I20260709 13:10:22.248674 23080 rpcz_store.cc:276] 0709 13:10:20.959832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.959966 (+   134us) service_pool.cc:224] Handling call
0709 13:10:20.978910 (+ 18944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.979159 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:20.985385 (+  6226us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.204593 (+1219208us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.205930 (+  1337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.205971 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.206012 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.206071 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.206164 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116054,"prepare.queue_time_us":7118,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":201426,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":6532,"thread_start_us":1063658,"threads_started":3,"wal-append.queue_time_us":917809}
I20260709 13:10:22.280864 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.295795 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:22.327582 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 193546us
I20260709 13:10:22.283530 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.201951 27107 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:22.204659 27023 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:22.376893 23004 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:22.285265 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.372987 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:22.369745 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 119078us
I20260709 13:10:22.390661 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.391476 23073 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:22.351603 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.392853 23648 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.393394 22928 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:22.203758 26780 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.394354 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:22.398662 23045 connection.cc:256] RPC call timeout handler was delayed by -2.4911340010000913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:10:22.402676 22928 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:22.403503 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.400795 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.401168 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.337242 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.404665 23654 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:22.405624 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.248335 27114 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.408682 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.409901 23657 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:22.411521 22924 raft_consensus.cc:2393] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 7: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:22.410980 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.412310 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.414938 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.416422 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.417080 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.408213 27115 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.417989 26766 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.418627 26766 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.419865 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.420939 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.327273 26940 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.421651 23080 raft_consensus.cc:2410] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:22.432582 23648 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:22.351534 27055 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.351347 27044 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:22.400343 26952 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:22.392700 27107 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.442214 23001 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:22.456899 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 911) took 1509 ms. Trace:
I20260709 13:10:22.458184 23654 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: [8.9-10.11]
I20260709 13:10:22.457417 22929 rpcz_store.cc:276] 0709 13:10:20.947266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.887812 (+940546us) service_pool.cc:224] Handling call
0709 13:10:21.888346 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.888705 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.888739 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.889222 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.155116 (+265894us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:22.155153 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.155212 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.456701 (+301489us) raft_consensus.cc:1685] finished
0709 13:10:22.456729 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.456849 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35151,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":68,"thread_start_us":248150,"threads_started":1,"wal-append.queue_time_us":430094}
I20260709 13:10:22.459554 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.459772 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.460479 23654 raft_consensus.cc:2393] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:22.442629 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.420578 26766 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.466187 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2514) took 1782 ms. Trace:
W20260709 13:10:22.447325 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 1049) took 1683 ms (client timeout 2171 ms). Trace:
W20260709 13:10:22.466951 23656 rpcz_store.cc:269] 0709 13:10:20.758968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.789403 (+ 30435us) service_pool.cc:224] Handling call
0709 13:10:22.420814 (+1631411us) spinlock_profiling.cc:243] Waited 904 us on lock 0x7b5800004598. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fd00a0 00007f3929fcf984 00007f392354a6d4 00007f392354a662
0709 13:10:22.441933 (+ 21119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078080}
I20260709 13:10:22.326555 27094 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.450519 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:22.325332 26772 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:22.451889 22926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 914) took 1498 ms. Trace:
I20260709 13:10:22.455755 27011 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:22.337443 26754 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:22.471035 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.473483 26772 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:22.474634 23005 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:22.475258 22999 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.476490 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:22.461609 22929 raft_consensus.cc:2410] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:22.461705 23654 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.479911 22971 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:22.463466 27023 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.464807 22925 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:22.465477 27084 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.590s	user 0.007s	sys 0.010s
I20260709 13:10:22.468601 23001 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.466531 22922 rpcz_store.cc:276] 0709 13:10:20.683628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.763287 (+ 79659us) service_pool.cc:224] Handling call
0709 13:10:20.774090 (+ 10803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.790148 (+ 16058us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:20.852687 (+ 62539us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.136416 (+1283729us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b18003cf760. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa23a 00007f3925014a2a
0709 13:10:22.202700 (+ 66284us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.205637 (+  2937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.213401 (+  7764us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.213533 (+   132us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:22.213568 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.213636 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.465995 (+252359us) raft_consensus.cc:1685] finished
0709 13:10:22.466016 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.466138 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2870,"prepare.queue_time_us":82484,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":96,"raft.queue_time_us":98953,"raft.run_cpu_time_us":7751,"raft.run_wall_time_us":52986,"spinlock_wait_cycles":16783616,"thread_start_us":65388,"threads_started":1,"wal-append.queue_time_us":1576567}
I20260709 13:10:22.400683 27010 consensus_queue.cc:1059] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:22.484926 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.485709 22922 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:22.486019 23657 raft_consensus.cc:2410] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:22.469290 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.404258 26958 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:10:22.487250 26786 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.490460 26780 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.422430 27114 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.444031 26940 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.491852 26916 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.492504 27059 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.492877 27114 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.492996 26754 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:22.493379 26987 consensus_meta.cc:287] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.007s
I20260709 13:10:22.493432 26940 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:22.443404 27026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.477s	user 0.005s	sys 0.058s
W20260709 13:10:22.494203 27026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.528s	user 0.005s	sys 0.058s
I20260709 13:10:22.464835 26935 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.496328 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.496879 23654 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.495400 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.500213 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.500850 23001 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:22.501221 22923 raft_consensus.cc:2410] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:22.469413 22926 rpcz_store.cc:276] 0709 13:10:20.953682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.078174 (+1124492us) service_pool.cc:224] Handling call
0709 13:10:22.112489 (+ 34315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.155416 (+ 42927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.155444 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.155894 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.388112 (+232218us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:22.409742 (+ 21630us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.409948 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.410015 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.451696 (+ 41681us) raft_consensus.cc:1685] finished
0709 13:10:22.451714 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.451835 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42549,"prepare.queue_time_us":24222,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":45149,"raft.run_cpu_time_us":8224,"raft.run_wall_time_us":56174,"thread_start_us":186543,"threads_started":1,"wal-append.queue_time_us":228776}
I20260709 13:10:22.483178 22971 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:22.411899 27123 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:10:22.502698 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:22.484047 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.510265 23657 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:22.486758 23656 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:22.502041 22927 raft_consensus.cc:2410] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:22.505079 23654 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
W20260709 13:10:22.519333 23045 connection.cc:256] RPC call timeout handler was delayed by -2.1527340009999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:10:22.520219 23045 connection.cc:256] RPC call timeout handler was delayed by -1.0245955909999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:10:22.520965 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.521859 22999 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:22.456470 27044 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.500010 26772 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:22.512835 26935 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:22.515564 27026 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:22.528672 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.529488 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.530681 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.531142 23073 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:22.522636 27115 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:22.483673 26959 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:10:22.530809 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.515357 26987 consensus_queue.cc:1059] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:10:22.530329 26772 raft_consensus.cc:697] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:22.538038 27059 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.550813 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:22.551163 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.552282 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.552472 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2334) took 2473 ms. Trace:
I20260709 13:10:22.552879 22998 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:22.552845 23075 rpcz_store.cc:276] 0709 13:10:20.079103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.086760 (+  7657us) service_pool.cc:224] Handling call
0709 13:10:20.087024 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.743124 (+656100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.552250 (+1809126us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400389ad4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:22.552397 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399825152}
I20260709 13:10:22.554186 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:22.554870 22998 raft_consensus.cc:2393] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:22.556208 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.556734 27094 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.557238 23016 tablet_copy_service.cc:342] P 216ff6323e434e399d196d8ba262c8f3: Request end of tablet copy session 01988c2c817947859340a730b7f1247d-5adc1058fd2948e382bcd0ee2213ab3a received from {username='slave'} at 127.0.0.1:41504
I20260709 13:10:22.557796 23016 tablet_copy_service.cc:434] P 216ff6323e434e399d196d8ba262c8f3: ending tablet copy session 01988c2c817947859340a730b7f1247d-5adc1058fd2948e382bcd0ee2213ab3a on tablet 5adc1058fd2948e382bcd0ee2213ab3a with peer 01988c2c817947859340a730b7f1247d
I20260709 13:10:22.557842 26772 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.537508 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.533047 26935 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:22.535856 27026 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:22.562142 27044 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.546355 26987 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:22.562637 26987 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:22.563445 26987 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.564514 26987 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.565014 27107 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.565935 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.566500 23080 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 4.
I20260709 13:10:22.567026 27107 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:22.530258 26766 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:22.548017 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.567691 26766 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.549573 23004 raft_consensus.cc:1240] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.568150 26766 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.550102 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.569308 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:22.536907 27115 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.571113 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1137) took 2544 ms. Trace:
I20260709 13:10:22.571597 27115 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.560607 26959 consensus_queue.cc:1059] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:22.576263 26959 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:22.576629 26959 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:22.577353 26959 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.578444 26959 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.561764 27026 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.547343 22896 leader_election.cc:400] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:22.580112 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1146) took 1820 ms. Trace:
I20260709 13:10:22.570004 23075 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:22.580623 23652 rpcz_store.cc:276] 0709 13:10:20.759274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.789335 (+ 30061us) service_pool.cc:224] Handling call
0709 13:10:20.794236 (+  4901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.794800 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.794844 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.884031 (+ 89187us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.024839 (+1140808us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:22.024895 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.024997 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.573741 (+548744us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b24002fbaa8. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921da39c4 00007f3921da1acb 00007f3921f5cdc9 00007f3921f5ca55 00007f3921f5bfb0 00007f3924bd2488 00007f3924bd2be8 00007f3924baa398 00007f3924ba576a 00007f3924ba4bb6
0709 13:10:22.579734 (+  5993us) raft_consensus.cc:1685] finished
0709 13:10:22.579763 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.580028 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":50799,"spinlock_wait_cycles":43019648,"thread_start_us":1073936,"threads_started":1,"wal-append.queue_time_us":1056069}
I20260709 13:10:22.581499 22896 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:22.571452 23653 rpcz_store.cc:276] 0709 13:10:20.026806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.035400 (+  8594us) service_pool.cc:224] Handling call
0709 13:10:20.053607 (+ 18207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.796489 (+742882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.570870 (+1774381us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54000a4bd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:22.571024 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707052800}
I20260709 13:10:22.563539 26983 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:22.583299 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:22.584568 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.584885 23652 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:22.587441 23002 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:22.590268 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.591056 23652 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:22.592129 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.593470 23652 raft_consensus.cc:2393] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:22.594319 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.595016 23653 raft_consensus.cc:2393] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:22.595466 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.595791 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.596328 23653 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:22.596572 23652 raft_consensus.cc:2410] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:10:22.589756 27097 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:10:22.603854 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.604789 26766 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.606846 26766 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:22.607143 23074 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 754) took 1842 ms (client timeout 1685 ms). Trace:
W20260709 13:10:22.607609 23074 rpcz_store.cc:269] 0709 13:10:20.764642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.764874 (+   232us) service_pool.cc:224] Handling call
0709 13:10:22.606967 (+1842093us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b540042ccd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:22.607058 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208560000}
I20260709 13:10:22.586848 27069 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:22.614442 22972 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:22.604965 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:22.616012 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 78602us
I20260709 13:10:22.618304 23649 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.618403 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.618510 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:22.620828 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:22.621858 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.631073 23649 raft_consensus.cc:2468] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:22.631834 26766 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:22.631944 23653 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:22.623528 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:22.653563 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.634672 23652 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:10:22.640316 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.642086 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:22.642970 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 61539.5us
I20260709 13:10:22.658039 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.644349 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.648485 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.620985 27080 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:22.633682 27115 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.662284 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:22.676065 23045 leader_election.cc:336] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.904s (SENT)
I20260709 13:10:22.624352 26944 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.661051 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.667524 23649 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:22.668562 23653 raft_consensus.cc:1217] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 7 LEARNER]: Deduplicated request from leader. Original: 6.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:10:22.623788 27107 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:22.680907 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.682103 23652 raft_consensus.cc:2393] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:22.644512 27097 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.687878 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.644145 27129 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.663784 27094 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.696787 23652 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: [2.5-8.10]
I20260709 13:10:22.674288 27080 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.679617 27115 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.676548 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.674067 26766 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:22.704605 26620 raft_consensus.cc:3055] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:22.705017 26620 raft_consensus.cc:740] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:22.704963 26766 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.706085 26620 consensus_queue.cc:260] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.707239 26620 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.707839 23657 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.698663 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.690253 26944 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:22.711781 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.713524 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.714464 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.691993 27012 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.717706 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.719614 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.675598 27069 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:22.727994 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.729485 22928 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:22.702940 27080 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.711971 27115 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:22.733166 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 45406.3us
I20260709 13:10:22.737979 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:22.742632 23071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43468 (request call id 764) took 1655 ms (client timeout 2077 ms). Trace:
I20260709 13:10:22.805655 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:22.805860 23071 rpcz_store.cc:269] 0709 13:10:21.086742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.808341 (+721599us) service_pool.cc:224] Handling call
0709 13:10:22.742349 (+934008us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400276854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:22.742544 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431756032}
I20260709 13:10:22.752719 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.761345 26940 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:22.766037 23076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2332) took 2689 ms. Trace:
I20260709 13:10:22.776787 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:22.731910 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.725184 27129 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.815296 23657 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:22.649209 26935 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.783212 26944 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:22.783790 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 107744us
I20260709 13:10:22.787175 22925 raft_consensus.cc:2410] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:10:22.792392 27132 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:22.809541 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.807931 23076 rpcz_store.cc:276] 0709 13:10:20.076915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.081459 (+  4544us) service_pool.cc:224] Handling call
0709 13:10:20.081747 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.939801 (+858054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.765789 (+1825988us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400277754. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:22.765976 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961214208}
I20260709 13:10:22.811450 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.812094 22929 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:22.812131 23079 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:22.696614 26941 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:10:22.698046 27097 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.817699 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.821679 22931 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:10:22.726094 27110 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:22.781123 26983 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.836823 26983 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.839139 26983 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.842101 27097 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:22.810947 26940 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:22.850194 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:22.850589 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:22.827454 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.833822 22931 pending_rounds.cc:85] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 6
I20260709 13:10:22.852304 22931 pending_rounds.cc:107] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:22.852660 22931 raft_consensus.cc:2889] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:22.864552 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 654940us
I20260709 13:10:22.864889 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1149) took 2104 ms. Trace:
I20260709 13:10:22.865389 27012 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.852761 27086 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.866396 23622 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:22.867786 23621 connection.cc:256] RPC call timeout handler was delayed by -1.3457292470000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 13:10:22.867709 22927 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
W20260709 13:10:22.821028 26949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.887s	user 0.016s	sys 0.025s
I20260709 13:10:22.810055 27085 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.872328 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.836238 26941 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:22.865240 23650 rpcz_store.cc:276] 0709 13:10:20.760207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.934169 (+173962us) service_pool.cc:224] Handling call
0709 13:10:20.942953 (+  8784us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:20.943408 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.943435 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:20.953515 (+ 10080us) log.cc:844] Serialized 52 byte log entry
0709 13:10:22.134377 (+1180862us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:22.171228 (+ 36851us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.171606 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.750035 (+578429us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b1800350800. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d522 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:22.864332 (+114297us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b1800350800. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3921f1fa40 00007f3921f1a4e4 00007f3921f1a455 00007f3925002060 00007f3925014716 00007f3925025287 00007f3925025208
0709 13:10:22.864523 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.864626 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.864663 (+    37us) raft_consensus.cc:1685] finished
0709 13:10:22.864675 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.864838 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8153,"prepare.queue_time_us":40663,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":7043,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":23534,"spinlock_wait_cycles":39879680,"thread_start_us":1140894,"threads_started":1,"wal-append.queue_time_us":991718}
I20260709 13:10:22.871343 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:22.872097 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.872792 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.888759 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.873672 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.874526 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.870373 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:22.876091 27113 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.875849 26740 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:22.871126 26949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.938s	user 0.016s	sys 0.025s
I20260709 13:10:22.876749 23655 raft_consensus.cc:2955] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:22.893036 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.877656 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:22.878345 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:22.870934 26944 consensus_queue.cc:1059] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:10:22.872879 26641 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:22.879482 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:22.919234 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 48923.9us
I20260709 13:10:22.919409 23080 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:22.880012 26954 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.880023 26953 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:22.889623 22928 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:22.889643 23072 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:22.887498 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.891875 23075 raft_consensus.cc:2410] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:10:22.892079 22970 connection.cc:256] RPC call timeout handler was delayed by -1.0161384939999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 13:10:22.936641 22931 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:22.938071 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.877524 27061 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:22.893114 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:22.886834 26941 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:22.910529 23073 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:10:22.913726 23621 connection.cc:256] RPC call timeout handler was delayed by -1.1855292469999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:10:22.914124 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 186816us
I20260709 13:10:22.912297 23078 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.915568 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:22.921170 23649 raft_consensus.cc:1240] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:22.912393 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.947793 23002 raft_consensus.cc:2410] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 14 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:10:22.928754 26940 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.930256 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.920179 23622 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.938638 22998 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:22.907831 27113 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:22.953063 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:22.907411 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.955214 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:22.943957 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50948us
I20260709 13:10:22.907600 27139 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:22.945933 22924 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:22.937490 23046 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:22.958611 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.930702 26641 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.886271 27080 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:22.960043 23046 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:22.940156 27061 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:22.958667 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.962953 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.975265 22998 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:22.968698 23078 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:22.961825 22895 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:22.958592 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.939862 27044 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:10:22.960353 23001 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:22.970311 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.978052 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.978364 23649 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:22.907670 27110 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:22.914215 26983 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:10:22.959077 27138 raft_consensus.cc:3055] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:22.888065 27085 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.952160 26944 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.983906 23046 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:22.937935 26954 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:22.982769 27123 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:22.982511 27141 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:10:22.960600 27113 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.995965 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.969381 27058 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.941166 27129 consensus_queue.cc:1059] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:10:22.973448 27059 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.973304 26940 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.977029 26641 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:23.014951 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53215.6us
I20260709 13:10:22.944317 26953 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:22.973296 26959 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:23.057331 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:22.983603 27139 consensus_queue.cc:1243] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:23.038648 23649 raft_consensus.cc:1275] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:23.000375 26987 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:23.044247 22895 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:22.992667 27138 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:23.057971 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:23.014123 27123 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:23.060906 23006 raft_consensus.cc:2393] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:23.014155 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:23.065075 23001 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:23.013867 27114 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.982590 27061 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.065685 27123 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.066208 22895 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:23.042722 27059 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.071846 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:23.075795 23078 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:23.077700 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:23.078435 23078 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:23.070393 26959 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:23.083287 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:23.070188 27061 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.087358 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:23.089138 27149 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:23.089769 27137 log.cc:927] Time spent T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:10:23.091020 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2493) took 3778 ms. Trace:
I20260709 13:10:23.091383 22930 rpcz_store.cc:276] 0709 13:10:19.312294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.312466 (+   172us) service_pool.cc:224] Handling call
0709 13:10:19.523625 (+211159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.603081 (+ 79456us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:19.603130 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.603758 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.692486 (+3088728us) spinlock_profiling.cc:243] Waited 7.87 ms on lock 0x7b18003f7480. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa0d1 00007f3924fc5a0f
0709 13:10:22.805076 (+112590us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:22.805112 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.805195 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.090749 (+285554us) raft_consensus.cc:1685] finished
0709 13:10:23.090767 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.090962 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78939,"raft.queue_time_us":99432,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":12316,"spinlock_wait_cycles":18100608,"thread_start_us":112402,"threads_started":1,"wal-append.queue_time_us":3261850}
I20260709 13:10:23.078277 27059 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.099031 26949 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:23.048509 27058 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.100687 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:23.101780 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:23.102352 23004 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:23.103123 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:23.103672 23004 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:23.067485 27114 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:23.108619 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:23.063712 27010 consensus_queue.cc:1059] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:23.070559 26987 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:23.110989 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:23.111917 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:23.122681 23074 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:23.088261 27139 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.084656 26959 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:23.110422 27114 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:23.129367 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.124495 27139 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.133798 27139 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.126588 26959 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.301398 27058 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:23.138401 26780 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.179s
I20260709 13:10:23.305549 27080 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:23.122208 27138 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.386206 26953 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:23.388002 26954 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.336151 26987 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.432418 26641 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:23.435011 26641 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:23.454641 27142 log.cc:927] Time spent T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:10:23.509608 26954 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:23.545611 27115 consensus_meta.cc:287] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.003s
I20260709 13:10:23.567808 27123 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:23.572319 27139 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:23.573983 27113 consensus_meta.cc:287] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 13:10:23.565714 27115 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:23.565075 27094 consensus_meta.cc:287] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.863s	user 0.005s	sys 0.007s
I20260709 13:10:23.549150 27114 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.556164 27059 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.877173 27094 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:23.874292 27113 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.898573 27139 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:23.905628 27061 consensus_meta.cc:287] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.000s
I20260709 13:10:23.905758 23648 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:10:23.907368 23654 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:23.903292 27123 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:23.908154 27085 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:23.904242 27059 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:23.905562 23657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 1053) took 1426 ms (client timeout 1825 ms). Trace:
W20260709 13:10:23.909081 23657 rpcz_store.cc:269] 0709 13:10:22.479229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.524563 (+ 45334us) service_pool.cc:224] Handling call
0709 13:10:23.905374 (+1380811us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54006ed054. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:23.905506 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405944704}
I20260709 13:10:23.909595 27113 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:23.904462 26959 consensus_meta.cc:287] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.000s
I20260709 13:10:23.910686 26959 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:23.913535 26959 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:23.906060 27114 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:23.959446 26655 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.959973 26655 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:23.960413 26655 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:23.961645 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.01626e+06us
I20260709 13:10:23.963099 23621 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:23.963737 23005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.012s	sys 0.013s
W20260709 13:10:23.964062 23005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.012s	sys 0.013s
I20260709 13:10:23.964097 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:23.966051 26620 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:23.966112 26740 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:23.966802 27070 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:23.961687 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 1.01626e+06us
I20260709 13:10:23.967780 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1143) took 3939 ms. Trace:
I20260709 13:10:23.968288 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1162) took 1460 ms. Trace:
I20260709 13:10:23.968152 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:23.969096 27062 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:23.969648 27070 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.969620 27062 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.970181 27070 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.970577 27070 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.971194 27046 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:23.972589 26655 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.974874 26655 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:23.974992 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1155) took 1722 ms. Trace:
I20260709 13:10:23.959993 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1160) took 1481 ms. Trace:
I20260709 13:10:23.968792 23650 rpcz_store.cc:276] 0709 13:10:22.507970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.893400 (+385430us) service_pool.cc:224] Handling call
0709 13:10:22.932027 (+ 38627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.960172 (+1028145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.960206 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.960632 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.967985 (+  7353us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:23.968022 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.968092 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.968130 (+    38us) raft_consensus.cc:1685] finished
0709 13:10:23.968142 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.968243 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1027705,"raft.queue_time_us":1028959,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":67,"thread_start_us":7059,"threads_started":1,"wal-append.queue_time_us":866}
I20260709 13:10:23.976509 23656 rpcz_store.cc:276] 0709 13:10:22.478105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.845508 (+367403us) service_pool.cc:224] Handling call
0709 13:10:22.845839 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.846072 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:22.846354 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.959550 (+1113196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.959619 (+    69us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:23.959702 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.959772 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.959923 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1067855,"prepare.queue_time_us":146,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":1069544,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":44948,"threads_started":1,"wal-append.queue_time_us":218090}
I20260709 13:10:23.975353 23655 rpcz_store.cc:276] 0709 13:10:22.252770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.252917 (+   147us) service_pool.cc:224] Handling call
0709 13:10:22.336837 (+ 83920us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:10:22.876553 (+539716us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:23.106523 (+229970us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.968588 (+862065us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:10:23.970960 (+  2372us) log.cc:844] Serialized 104 byte log entry
0709 13:10:23.971139 (+   179us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.971424 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.971719 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.971938 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.972058 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.972118 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.974795 (+  2677us) raft_consensus.cc:1685] finished
0709 13:10:23.974812 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.974941 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1112572,"prepare.queue_time_us":8946,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":1117544,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":334,"thread_start_us":238512,"threads_started":1,"wal-append.queue_time_us":305799}
I20260709 13:10:23.970196 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:23.968144 23651 rpcz_store.cc:276] 0709 13:10:20.028812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.066816 (+ 38004us) service_pool.cc:224] Handling call
0709 13:10:20.085363 (+ 18547us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:20.439359 (+353996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.439388 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:20.455542 (+ 16154us) log.cc:844] Serialized 78 byte log entry
0709 13:10:20.581564 (+126022us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:22.495806 (+1914242us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b18003798a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:22.568258 (+ 72452us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18003798a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3924bb24bc 00007f3921f0048b 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1a455 00007f3928a023c7 00007f39250149a7 00007f39250240bf
0709 13:10:22.568391 (+   133us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.883753 (+315362us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.014842 (+131089us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.967449 (+952607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.967523 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.967561 (+    38us) raft_consensus.cc:1685] finished
0709 13:10:23.967572 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.967729 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1186264,"prepare.queue_time_us":100766,"prepare.run_cpu_time_us":156,"prepare.run_wall_time_us":6611,"raft.queue_time_us":1346261,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":12636,"spinlock_wait_cycles":117320320,"thread_start_us":653699,"threads_started":5,"wal-append.queue_time_us":296623,"wal-append.run_cpu_time_us":2004,"wal-append.run_wall_time_us":1039668}
I20260709 13:10:23.981184 27061 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.981492 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2525) took 1328 ms. Trace:
I20260709 13:10:23.981657 27061 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.982066 27061 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.981873 22929 rpcz_store.cc:276] 0709 13:10:22.652988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.653357 (+   369us) service_pool.cc:224] Handling call
0709 13:10:23.981306 (+1327949us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400220e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:23.981437 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348203392}
I20260709 13:10:23.983422 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 892) took 1570 ms. Trace:
I20260709 13:10:23.983785 23653 rpcz_store.cc:276] 0709 13:10:22.413043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.668023 (+254980us) service_pool.cc:224] Handling call
0709 13:10:22.668389 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.884412 (+216023us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:22.991920 (+107508us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.959160 (+967240us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800350860. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3928ede58f 00007f3921f1d571 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd
0709 13:10:23.983083 (+ 23923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.983177 (+    94us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:23.983217 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.983275 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.983373 (+    98us) inbound_call.cc:177] Queueing success response
0709 13:10:23.983458 (+    85us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b1800350860. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d522 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
Metrics: {"mutex_wait_us":1050954,"prepare.queue_time_us":29754,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":209035,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8329,"spinlock_wait_cycles":36198528,"thread_start_us":258712,"threads_started":2,"wal-append.queue_time_us":402686}
I20260709 13:10:23.985855 27022 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:23.986433 27022 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.987958 27145 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.988443 27145 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:23.990497 27145 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:23.980445 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:23.993992 23620 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:23.995906 26620 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:23.996284 26620 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:23.996649 26620 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:23.997737 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 1.07756e+06us
I20260709 13:10:23.997835 27166 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:23.998872 23622 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.000079 26894 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.000623 27046 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:24.000231 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:24.001751 23006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.004s	sys 0.016s
W20260709 13:10:24.002043 23006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.005s	sys 0.017s
I20260709 13:10:24.002996 23621 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.003823 27145 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:24.004577 27145 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.008460 27166 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:24.009433 27166 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.000994 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.013371 27113 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:24.014990 27086 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:24.015511 27086 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.013108 26941 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:24.017568 27086 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.017802 26941 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.019642 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:24.020514 23621 connection.cc:256] RPC call timeout handler was delayed by -1.6477907490001371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2852s for a response
I20260709 13:10:24.021095 27145 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.022861 27145 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:24.023406 26655 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:24.024135 26655 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.025271 27115 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.025650 27149 raft_consensus.cc:3055] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:24.026012 27149 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.026741 27149 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.027871 27149 raft_consensus.cc:3060] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.032205 26620 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.037549 23651 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:24.032584 26655 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.033039 27070 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.036477 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.038682 23655 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:24.040671 23656 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:24.042007 23653 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.050401 23653 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.050470 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.054082 23653 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:24.055560 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.057858 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.060227 23657 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:24.064227 26620 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.065272 27070 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.066498 23622 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:24.067831 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.068646 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:24.070447 27145 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.071126 27145 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.072288 22929 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:24.067895 27165 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:24.074030 27143 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.739s	user 0.001s	sys 0.000s
I20260709 13:10:24.075541 23650 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.083443 23073 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.085489 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2353) took 1010 ms. Trace:
I20260709 13:10:24.085785 23073 rpcz_store.cc:276] 0709 13:10:23.075324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.075570 (+   246us) service_pool.cc:224] Handling call
0709 13:10:23.086964 (+ 11394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.083856 (+996892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.085291 (+  1435us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400088ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:24.085436 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291273472}
I20260709 13:10:24.089713 26958 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.090065 27061 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.091486 27159 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.094978 27070 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.094698 27080 raft_consensus.cc:3055] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:24.097278 27080 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.100433 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2242) took 1199 ms. Trace:
I20260709 13:10:24.100873 23005 rpcz_store.cc:276] 0709 13:10:22.901656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.901925 (+   269us) service_pool.cc:224] Handling call
0709 13:10:22.902592 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.905896 (+  3304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.905944 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.914735 (+  8791us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.964473 (+1049738us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:24.026015 (+ 61542us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.100042 (+ 74027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.100141 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.100207 (+    66us) raft_consensus.cc:1685] finished
0709 13:10:24.100225 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.100369 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73744,"prepare.queue_time_us":29490,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":75370,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":19051,"thread_start_us":1066100,"threads_started":2,"wal-append.queue_time_us":376868}
I20260709 13:10:24.100119 27080 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.103569 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:24.096035 27070 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.097723 26740 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:10:24.096572 27159 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.120257 27055 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.120685 22971 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:24.121066 27080 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.121469 27171 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:24.122997 27171 raft_consensus.cc:697] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.120525 27159 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.123988 27171 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.126678 23000 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:10:24.112177 27061 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:24.128299 23000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2232) took 1762 ms. Trace:
I20260709 13:10:24.128613 23000 rpcz_store.cc:276] 0709 13:10:22.365880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.366026 (+   146us) service_pool.cc:224] Handling call
0709 13:10:22.392536 (+ 26510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.127087 (+1734551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.128074 (+   987us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400097c54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:24.128245 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3987450240}
I20260709 13:10:24.129055 27070 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:24.132503 27148 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.773s	user 0.000s	sys 0.010s
I20260709 13:10:24.137045 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 897) took 1664 ms. Trace:
I20260709 13:10:24.137403 23652 rpcz_store.cc:276] 0709 13:10:22.472746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.698066 (+225320us) service_pool.cc:224] Handling call
0709 13:10:22.698722 (+   656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.885123 (+186401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.885169 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.887872 (+  2703us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.066255 (+178383us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.395020 (+328765us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.985748 (+590728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.985822 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.129949 (+144127us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:24.136752 (+  6803us) raft_consensus.cc:1685] finished
0709 13:10:24.136852 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.136979 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1809527,"prepare.queue_time_us":28750,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":783576,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13744,"spinlock_wait_cycles":12704640,"thread_start_us":408986,"threads_started":2,"wal-append.queue_time_us":200979}
I20260709 13:10:24.142079 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1963) took 1046 ms. Trace:
I20260709 13:10:24.143263 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 894) took 2003 ms. Trace:
I20260709 13:10:24.142419 23006 rpcz_store.cc:276] 0709 13:10:23.095871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.107898 (+ 12027us) service_pool.cc:224] Handling call
0709 13:10:23.122659 (+ 14761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.002322 (+879663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.002349 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.002801 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.095046 (+ 92245us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:24.099287 (+  4241us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.108084 (+  8797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.108155 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.141873 (+ 33718us) raft_consensus.cc:1685] finished
0709 13:10:24.141899 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.142030 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":767497,"prepare.queue_time_us":2948,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":192677,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":18832,"thread_start_us":963689,"threads_started":2,"wal-append.queue_time_us":100828}
I20260709 13:10:24.151824 22999 rpcz_store.cc:276] 0709 13:10:22.139481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.144736 (+  5255us) service_pool.cc:224] Handling call
0709 13:10:24.143090 (+1998354us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54000baed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:24.143204 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596433152}
W20260709 13:10:24.153843 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.154881 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.165542 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.165794 26944 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:24.166173 26944 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.166731 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.167189 27086 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.167534 22931 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
W20260709 13:10:24.171531 23621 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.646s (SENT) [suppressed 14 similar messages]
I20260709 13:10:24.168437 27086 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.172420 27149 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:24.166949 26944 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:10:24.178378 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50543.1us
I20260709 13:10:24.177170 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:24.179814 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:24.178646 23622 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:24.177923 27139 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:10:24.165788 26941 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:24.199983 27159 consensus_queue.cc:1059] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:24.201790 27171 raft_consensus.cc:3055] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.202263 27171 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.173547 27085 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:24.197204 27161 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:10:24.203219 27171 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.204741 27171 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.196664 27080 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:10:24.207770 26941 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:24.184026 27011 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.167830 26959 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:10:24.182945 27091 consensus_queue.cc:1059] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:24.223770 27139 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:24.219563 26944 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.231555 26959 raft_consensus.cc:3055] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:24.231983 26959 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.232748 26959 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.233948 26959 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.196480 27070 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.236174 27070 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.236572 27070 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:24.242241 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 45782us
I20260709 13:10:24.242743 27149 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.243193 27149 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.254926 27149 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.256122 27149 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.260285 27138 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.266571 22998 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.268730 22998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 1962) took 1187 ms. Trace:
I20260709 13:10:24.270944 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1165) took 1710 ms. Trace:
I20260709 13:10:24.271552 23654 rpcz_store.cc:276] 0709 13:10:22.560855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.926327 (+365472us) service_pool.cc:224] Handling call
0709 13:10:22.926681 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.907701 (+981020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.270673 (+362972us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b540044d9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:24.270876 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254571392}
I20260709 13:10:24.269166 22998 rpcz_store.cc:276] 0709 13:10:23.081710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.081895 (+   185us) service_pool.cc:224] Handling call
0709 13:10:24.266338 (+1184443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.267112 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.268469 (+  1357us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000baed0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:24.268657 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723274624}
I20260709 13:10:24.278110 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 883) took 1908 ms. Trace:
I20260709 13:10:24.278045 27070 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.278606 23648 rpcz_store.cc:276] 0709 13:10:22.370163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.566447 (+196284us) service_pool.cc:224] Handling call
0709 13:10:23.905531 (+1339084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.907152 (+  1621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.277907 (+370755us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54006ed050. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:24.278049 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3078820096}
I20260709 13:10:24.281257 26754 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:24.281793 26754 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.282879 26754 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.289722 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.295363 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.296217 22923 raft_consensus.cc:2410] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:10:24.299093 22927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 2039) took 1586 ms (client timeout 1803 ms). Trace:
W20260709 13:10:24.299486 22927 rpcz_store.cc:269] 0709 13:10:22.712977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.713187 (+   210us) service_pool.cc:224] Handling call
0709 13:10:24.298943 (+1585756us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002a2bd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:24.299040 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347116416}
I20260709 13:10:24.307379 27150 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.310137 27070 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:24.306972 26772 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:24.318032 26772 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.320266 26772 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.317531 27085 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.341274 27085 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.344112 27027 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:24.344570 27027 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.345336 27027 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.345980 26901 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.346364 27027 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.346596 26901 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:24.347770 26901 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.351413 26901 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.355744 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.356307 22930 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:24.360328 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.361989 22972 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:24.362254 27011 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.362756 27011 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:24.363107 26772 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.363833 27178 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.364306 27178 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.364703 27011 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.368216 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.369469 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.370051 22927 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:24.371188 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.371809 22923 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:24.373531 22923 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:24.378569 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.380043 22928 raft_consensus.cc:2410] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:24.376410 27097 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:24.382282 27097 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:24.383713 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.385494 27178 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.386200 27097 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.388150 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.388651 22928 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:24.388836 22926 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:24.389091 22928 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:24.389138 22926 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:24.389973 22997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 902) took 1840 ms (client timeout 1646 ms). Trace:
W20260709 13:10:24.390381 22997 rpcz_store.cc:269] 0709 13:10:22.549607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.550944 (+  1337us) service_pool.cc:224] Handling call
0709 13:10:24.389785 (+1838841us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540041fad4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:24.389911 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275277056}
I20260709 13:10:24.390961 22926 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.392956 22926 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.395195 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.395349 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:24.395823 22924 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:24.399279 22930 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:24.400049 22927 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.400832 22972 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:24.408888 22972 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:24.406037 27085 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.410027 27085 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.407501 27171 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:10:24.412068 27085 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.407341 27027 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:24.412778 27027 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:24.413096 27027 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.406780 26910 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:24.416040 26910 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.421797 26910 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.422087 27085 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:24.422591 27085 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:24.424918 27085 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.426267 27080 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:24.432677 27080 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:24.433182 27080 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.434407 26953 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.434900 26953 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:24.441429 26766 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:24.441497 27114 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:24.442096 26766 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.442615 27114 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.450002 26941 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.452099 27027 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.461010 27114 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.462909 22926 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:10:24.463343 22926 pending_rounds.cc:85] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 8
I20260709 13:10:24.463605 27027 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.447502 26901 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:24.464665 22926 pending_rounds.cc:107] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:24.465266 26953 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:24.468283 22926 raft_consensus.cc:2889] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.471993 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.473089 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.473567 22923 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.474045 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.474371 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.474934 22930 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.475155 22928 raft_consensus.cc:2410] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:24.476102 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:24.467746 26766 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.466501 26976 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:24.477993 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.481855 23076 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:24.479060 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.484910 23075 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:10:24.486106 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.487725 27062 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.488607 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.488543 27080 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.489691 23073 raft_consensus.cc:2393] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:24.482573 27114 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:24.490898 27114 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.491353 27114 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.491901 27080 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.501185 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.502429 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.502954 23079 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:10:24.504547 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.505252 22930 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:24.506608 22972 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:24.507145 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.507601 23071 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.494750 22926 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:24.496335 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.496891 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.508972 23080 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:24.497440 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.509779 22931 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.470983 26910 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:24.512296 23073 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.513306 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.513463 26910 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.513839 23073 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:24.514842 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.516103 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.523154 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.523418 23076 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:24.524441 23071 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:24.482980 26976 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.525466 23077 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 15: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:24.525833 23079 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:24.530171 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.530853 23073 raft_consensus.cc:2393] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:24.530635 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.531419 23080 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.533716 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.534401 22930 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.468743 26901 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.541863 23073 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:24.524129 27161 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:24.497927 27055 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:24.548396 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:24.550871 22929 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.558224 26901 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.558666 22931 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:24.558987 23075 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:24.561277 27139 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:10:24.561772 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:24.559528 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.564965 22931 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:10:24.565589 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.566300 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.567555 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:24.568325 22931 raft_consensus.cc:2410] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:10:24.569933 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.570472 23071 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:24.571556 22930 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:24.572626 22972 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:24.573980 23620 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.577263 23620 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.577560 22929 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:24.552932 27161 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.579241 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:24.582231 26949 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:24.583396 27113 consensus_queue.cc:1059] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.584167 27145 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.594991 27113 raft_consensus.cc:3055] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.584473 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:24.587985 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.595846 23073 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:24.597373 23620 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:24.584959 27166 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.589397 23075 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:24.599982 23080 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:24.576668 27139 consensus_queue.cc:1059] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:24.602742 27139 raft_consensus.cc:3055] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.563577 26976 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.603077 27139 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.603627 26976 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.599771 27159 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:24.605767 27139 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.606897 27139 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.608170 27161 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.573087 27171 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:24.659040 22970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.513s	user 0.010s	sys 0.009s
W20260709 13:10:24.659844 22970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.010s	sys 0.009s
W20260709 13:10:24.660200 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 1.52726e+06us
I20260709 13:10:24.610069 27165 raft_consensus.cc:2804] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:24.665622 27159 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.700173 22923 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:24.708256 27159 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:24.698520 27178 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.728361 27178 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:24.729875 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.730463 27178 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:24.737864 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.737900 27178 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.745388 27178 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:24.748399 27165 raft_consensus.cc:697] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:24.749015 27178 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.749533 27165 consensus_queue.cc:237] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:24.752830 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 154226us
I20260709 13:10:24.755601 27166 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:24.756526 27191 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:10:24.753525 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:24.764729 23620 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:24.609453 26620 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
I20260709 13:10:24.766191 26620 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:24.766533 26620 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:24.766863 26620 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.767063 27166 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:24.767429 27166 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.767793 27166 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.610193 26655 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:24.770471 26655 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:24.770821 26655 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.771831 27196 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.772228 27196 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:24.773018 27196 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.774222 27196 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.774899 27166 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.777125 27166 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.780162 23649 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:10:24.781121 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.782693 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.783288 23078 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.783574 27086 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.784358 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.784922 23650 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:24.785696 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:24.785482 26655 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.782693 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:24.791841 23078 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:24.794804 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.795411 23078 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.798915 23652 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:24.800158 23652 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:24.800253 26620 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.801170 23652 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:24.801259 23649 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:24.802220 27166 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.802352 27196 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.803046 27166 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.803179 27196 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.806342 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:24.806535 27196 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.806891 23073 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.809532 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.809831 27166 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:24.802242 26620 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.787423 26655 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:24.816473 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.817437 23071 raft_consensus.cc:2410] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:24.819909 23073 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:24.822283 23078 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
W20260709 13:10:24.830735 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.837056 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:24.835105 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:24.840103 23045 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:24.846818 26754 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.849690 23045 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:24.851374 23649 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:24.852414 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.853129 23649 raft_consensus.cc:2393] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 13: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:24.853564 23651 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:24.853981 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.854696 23649 raft_consensus.cc:2393] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:24.843539 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:24.855161 23650 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.841180 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:24.856397 23654 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.857509 23654 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:10:24.854530 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:24.844254 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:24.860086 23652 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:24.862318 23650 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 15.
I20260709 13:10:24.868884 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:24.875321 27199 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.875819 27199 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.877727 27199 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.878857 27199 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:24.879212 27199 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.879313 26766 raft_consensus.cc:2804] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:24.879599 27199 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.879838 26766 raft_consensus.cc:697] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:24.880716 26766 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.886693 27199 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.896055 26766 consensus_queue.cc:1059] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.897090 26766 consensus_queue.cc:1048] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:24.898178 27115 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:24.898761 27115 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:24.899873 27115 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.900864 27199 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.901564 27199 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:24.901928 27199 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.902285 27199 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:24.903558 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.907068 26766 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.908641 23072 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.909538 27199 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.912447 27199 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.913038 27199 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.913369 27199 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:24.914151 27199 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.915287 26766 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.917340 26766 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:24.918977 27199 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:24.926939 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 58137.5us
I20260709 13:10:24.928253 23045 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:24.930580 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:24.931586 27200 consensus_queue.cc:1059] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:24.932475 26786 raft_consensus.cc:3055] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.932895 27200 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:24.933516 27200 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:24.932902 26786 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:24.934520 27200 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.934975 26786 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.936195 26786 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.609650 26949 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.937664 26949 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.938406 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:24.939049 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:24.596247 26901 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.941071 26901 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:24.931310 27022 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:24.945854 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 283951us
I20260709 13:10:24.946590 22970 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:24.947592 27171 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:24.948722 27171 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:24.949299 27171 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.949644 27171 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:24.950389 27171 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:24.954836 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 161941us
I20260709 13:10:24.957679 27158 consensus_queue.cc:1059] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:24.972012 26766 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:24.974431 26766 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.974718 23077 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:24.975351 26766 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.975838 26766 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:24.983996 23045 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.528s (SENT)
I20260709 13:10:25.016868 26766 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:25.037165 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.038579 26901 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:25.039397 26901 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:25.039955 26901 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:25.040206 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 83920.4us
W20260709 13:10:25.041504 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.042651 26766 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:25.044142 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 60186us
I20260709 13:10:25.048144 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:24.595407 27113 raft_consensus.cc:740] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:25.050202 27158 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:25.051196 27158 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:25.052165 27158 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:25.052590 27158 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:25.053010 27158 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.054237 22927 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:25.053531 27171 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.051046 27113 consensus_queue.cc:260] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.051337 23620 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:25.055354 27113 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.056226 27062 raft_consensus.cc:2804] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:25.056934 27062 raft_consensus.cc:697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:25.057937 27062 consensus_queue.cc:237] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.066329 22928 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:10:25.066655 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:25.067602 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:25.068436 27022 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:25.068998 27022 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:25.069954 27022 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.072320 26655 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:25.072969 26655 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:25.073946 26655 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.040988 26901 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.102238 26754 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:25.103533 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 57879.1us
W20260709 13:10:25.141742 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 75358.8us
W20260709 13:10:25.198864 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 99285us
I20260709 13:10:25.102401 26949 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:25.476912 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 428824us
W20260709 13:10:25.486369 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 384429us
I20260709 13:10:25.496253 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:25.496819 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:25.487483 27061 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:25.489683 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.502322 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.499073 26949 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:25.534674 27061 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:25.535480 27062 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:25.502148 27113 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:25.498011 26754 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:25.541061 23045 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.171s (SENT)
I20260709 13:10:25.540155 27061 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:25.549152 26740 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.549238 27062 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:25.549882 26949 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:25.545778 26766 consensus_meta.cc:287] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.007s
I20260709 13:10:25.556653 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:25.555927 27158 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.502s	user 0.024s	sys 0.028s
W20260709 13:10:25.561851 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.561973 27209 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:25.565415 27114 consensus_meta.cc:287] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 1.073s	user 0.020s	sys 0.000s
I20260709 13:10:25.576892 27114 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:25.552006 27113 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.563452 27115 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:25.582271 27114 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:25.559175 26740 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.565069 27061 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.582647 27113 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:25.562307 27205 consensus_queue.cc:1059] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:10:25.584196 27209 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:25.594019 27210 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:25.595801 27210 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:25.597059 27210 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.597985 27210 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:25.627616 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 129633us
I20260709 13:10:25.632674 22970 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:25.646657 26740 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:25.647729 26740 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:25.648867 26740 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.652011 26740 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:25.590906 27061 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:25.654476 26786 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.005s
I20260709 13:10:25.655566 26754 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.658418 26754 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.565330 27062 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:25.660039 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.671669 27115 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.672456 27115 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.675776 27115 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:25.564180 27158 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:25.692866 27215 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:25.698673 27158 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:25.699970 26786 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.701000 26786 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:25.703920 23101 debug-util.cc:398] Leaking SignalData structure 0x7b080011e160 after lost signal to thread 21778
I20260709 13:10:25.704447 26786 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:25.707801 27159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.007s	sys 0.018s
W20260709 13:10:25.711818 27159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.007s	sys 0.018s
I20260709 13:10:25.707536 27158 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:25.716535 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 220232us
W20260709 13:10:25.715335 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 212308us
W20260709 13:10:25.723558 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08002fbfc0 after lost signal to thread 22863
W20260709 13:10:25.729928 27171 consensus_meta.cc:287] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.666s	user 0.017s	sys 0.006s
W20260709 13:10:25.737573 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001d05e0 after lost signal to thread 22955
W20260709 13:10:25.740015 23101 debug-util.cc:398] Leaking SignalData structure 0x7b080016c8a0 after lost signal to thread 23030
W20260709 13:10:25.740418 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9b40 after lost signal to thread 23031
W20260709 13:10:25.742221 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08003e04a0 after lost signal to thread 23104
W20260709 13:10:25.742571 23101 debug-util.cc:398] Leaking SignalData structure 0x7b0800379940 after lost signal to thread 23105
W20260709 13:10:25.748427 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 116100us
I20260709 13:10:25.749761 22970 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:25.759749 27022 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.765412 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.766005 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.766445 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.766799 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.768774 22925 raft_consensus.cc:1240] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:10:25.769557 22925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 937) took 1688 ms. Trace:
I20260709 13:10:25.769870 22925 rpcz_store.cc:276] 0709 13:10:24.081017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.767681 (+1686664us) service_pool.cc:224] Handling call
0709 13:10:25.768212 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.769199 (+   987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.769465 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:25.770823 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:25.771690 27171 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.775805 27022 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.784319 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:25.788631 23072 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:25.785723 23075 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:25.766907 22923 raft_consensus.cc:3055] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:25.791549 22923 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:25.792027 27159 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.793222 22923 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.794512 26754 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.796573 27022 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:25.795903 26754 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.792920 27159 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.800086 27011 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:25.800920 22927 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:25.816735 27159 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:25.786058 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:25.797103 27115 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.817883 27115 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.826162 26754 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:25.797271 26786 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.845558 27115 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:25.858383 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:25.859217 23655 raft_consensus.cc:2410] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:25.859623 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 906) took 1093 ms. Trace:
I20260709 13:10:25.861593 23655 rpcz_store.cc:276] 0709 13:10:24.765792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.857728 (+1091936us) service_pool.cc:224] Handling call
0709 13:10:25.859533 (+  1805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:25.873396 22817 maintenance_manager.cc:643] P 84f66d81ef21415a8d9a0c01ca7125b0: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.666s	user 0.190s	sys 0.099s Metrics: {"bytes_written":30874,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":88440,"dirs.run_cpu_time_us":408,"dirs.run_wall_time_us":34399,"drs_written":1,"lbm_read_time_us":558,"lbm_reads_lt_1ms":4,"lbm_write_time_us":157569,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":85751,"threads_started":2,"update_count":17,"wal-append.queue_time_us":102069}
I20260709 13:10:25.876448 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 2066) took 1403 ms. Trace:
I20260709 13:10:25.882078 22928 rpcz_store.cc:276] 0709 13:10:24.472486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.480169 (+  7683us) service_pool.cc:224] Handling call
0709 13:10:24.480498 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.066733 (+586235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.875877 (+809144us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54003b5454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:25.876239 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346464512}
W20260709 13:10:25.877981 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 63626.6us
W20260709 13:10:25.925165 27145 consensus_meta.cc:287] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 1.330s	user 0.016s	sys 0.000s
I20260709 13:10:25.925748 27145 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:25.941483 26655 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.942256 26655 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:25.944819 26655 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:25.949246 23655 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:25.949193 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:25.950258 23649 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:25.951985 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:25.952939 23649 raft_consensus.cc:2410] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:25.955765 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:25.956403 23655 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.959451 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:25.960093 23651 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:25.960878 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:25.961571 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.961575 23651 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:25.963641 23651 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:25.967670 27145 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:25.972188 22828 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35496 (request call id 375) took 17342 ms (client timeout 15000 ms). Trace:
I20260709 13:10:25.973927 23655 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:25.975297 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:25.975826 23651 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:25.976090 23655 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:25.977098 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:25.977561 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:25.978502 23651 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:25.983855 23655 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:10:25.983996 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.986565 23651 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:10:25.973917 22828 rpcz_store.cc:269] 0709 13:10:08.629217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.682229 (+ 53012us) service_pool.cc:224] Handling call
0709 13:10:25.971902 (+17289673us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:17.380505 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:17.381109 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:17.381159 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:10:17.381180 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:17.382678 (+  1498us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:17.382760 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:17.382789 (+    29us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:10:17.496523 (+113734us) tablet.cc:701] Row locks acquired
0709 13:10:17.517478 (+ 20955us) write_op.cc:260] PREPARE: finished
0709 13:10:17.582262 (+ 64784us) write_op.cc:270] Start()
0709 13:10:17.618954 (+ 36692us) write_op.cc:276] Timestamp: P: 1783602617546395 usec, L: 0
0709 13:10:17.624152 (+  5198us) op_driver.cc:348] REPLICATION: starting
0709 13:10:17.728507 (+104355us) log.cc:844] Serialized 6728 byte log entry
0709 13:10:18.549718 (+821211us) op_driver.cc:464] REPLICATION: finished
0709 13:10:18.695377 (+145659us) write_op.cc:301] APPLY: starting
0709 13:10:18.699835 (+  4458us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:18.962745 (+262910us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:19.033044 (+ 70299us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:19.207741 (+174697us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:19.208143 (+   402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0709 13:10:19.208192 (+    49us) write_op.cc:312] APPLY: finished
0709 13:10:19.208582 (+   390us) log.cc:844] Serialized 119 byte log entry
0709 13:10:19.209512 (+   930us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:19.209773 (+   261us) write_op.cc:454] Released schema lock
0709 13:10:19.213971 (+  4198us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:19.219769 (+  5798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:19.219807 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":911350,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":116854,"apply.run_cpu_time_us":15980,"apply.run_wall_time_us":536982,"num_ops":17,"prepare.queue_time_us":355865,"prepare.run_cpu_time_us":40811,"prepare.run_wall_time_us":733227,"raft.queue_time_us":241440,"raft.run_cpu_time_us":5974,"raft.run_wall_time_us":46280,"replication_time_us":925412,"thread_start_us":740295,"threads_started":4,"wal-append.queue_time_us":551919,"wal-append.run_cpu_time_us":80561,"wal-append.run_wall_time_us":1903703}]]}
I20260709 13:10:26.018362 27123 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:26.020872 27123 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.023896 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:26.024104 27094 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:26.024644 23656 raft_consensus.cc:1813] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Handling vote request from an unknown peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:26.025209 23656 raft_consensus.cc:2368] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11.
I20260709 13:10:26.025617 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1173) took 1246 ms. Trace:
I20260709 13:10:26.025727 27123 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.025942 23656 rpcz_store.cc:276] 0709 13:10:24.778981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.023399 (+1244418us) service_pool.cc:224] Handling call
0709 13:10:26.025548 (+  2149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.028860 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.032337 23651 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:26.025224 27094 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.038784 27094 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.044586 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:26.047807 27123 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:26.048552 27123 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.049130 27123 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.047375 23656 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:26.053228 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:26.054394 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.054719 23045 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.060967 26958 raft_consensus.cc:3055] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:26.061414 26958 raft_consensus.cc:740] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:26.062495 26958 consensus_queue.cc:260] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.064538 27115 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:26.064584 26954 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:26.065033 27115 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.065591 26954 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.065685 27115 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:26.065872 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 267399us
I20260709 13:10:26.066087 26954 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.068244 27123 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.064807 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.068935 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:26.070672 27123 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.070753 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:26.071592 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.071545 27123 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:26.073978 27123 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:26.074717 27123 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.076339 27123 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.078038 27115 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.080444 27115 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.084064 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:26.085363 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:26.085812 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68388.9us
I20260709 13:10:26.085995 23656 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.089479 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:26.090278 23651 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.085198 27115 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:26.094723 26958 raft_consensus.cc:3060] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.091388 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:26.100355 23649 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:26.100502 26954 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.103036 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.100924 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:26.097360 27115 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:26.104848 23650 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:26.113544 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.110318 27115 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.086998 27094 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:10:26.121150 27115 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.131090 26954 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:26.134145 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.136286 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:26.136458 27123 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:26.136953 23650 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.137101 27123 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:26.137737 27123 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.138001 23656 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:10:26.142482 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.146076 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1174) took 1366 ms. Trace:
I20260709 13:10:26.146481 23657 rpcz_store.cc:276] 0709 13:10:24.779251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.027497 (+1248246us) service_pool.cc:224] Handling call
0709 13:10:26.027957 (+   460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:26.028508 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.028538 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:26.029265 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 13:10:26.063921 (+ 34656us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:26.063969 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.064039 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.145737 (+ 81698us) raft_consensus.cc:1685] finished
0709 13:10:26.145757 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.145909 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1577,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"thread_start_us":34188,"threads_started":1,"wal-append.queue_time_us":94158}
I20260709 13:10:26.147992 23045 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.156616 27094 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.157053 27094 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.157423 27094 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.805560 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.158378 27115 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.167984 23622 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:26.162217 23650 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:26.173676 23075 raft_consensus.cc:2393] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:26.174083 23651 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:26.178042 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.180096 27114 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:26.180706 27114 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.181958 27114 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.186664 27145 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.191130 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.171276 27094 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.196642 27115 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.201028 27094 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.201874 27094 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:26.218950 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:26.219569 23651 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.202380 27094 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.219409 27230 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.220676 27230 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:26.221038 27230 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.220927 27094 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.205473 27238 consensus_queue.cc:1059] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:10:26.231594 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 482052us
I20260709 13:10:26.221874 26954 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:26.239934 23651 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:26.242758 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:26.243510 23649 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.248955 27123 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.237326 26954 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.253132 27123 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.256819 26954 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.251005 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.264302 23649 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:26.270802 27248 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:26.271267 27246 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.271905 27246 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.272718 27248 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.273414 27248 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.274475 27246 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.279520 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.282125 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:26.283105 23650 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:26.286201 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:26.287536 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.289857 27123 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:26.290556 27123 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.291744 27123 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.288056 23649 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.295972 27251 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:26.296875 27251 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.299801 27251 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.292546 27230 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.304214 27250 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:26.288934 27248 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.311352 27248 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.316161 27244 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:26.317090 27244 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.325259 27094 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:26.325974 27094 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.328114 27094 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.336951 27230 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.338050 27244 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.335376 27250 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.340394 27250 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.311910 27248 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:26.349186 27193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.647s	user 0.009s	sys 0.000s
W20260709 13:10:26.350646 27193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.649s	user 0.010s	sys 0.000s
I20260709 13:10:26.351867 27248 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.357110 27094 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.358978 27094 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:25.834807 26786 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.386073 26786 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.395345 26786 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.397836 26786 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.557191 22926 raft_consensus.cc:2393] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:26.577839 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:26.578698 23653 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
W20260709 13:10:26.579205 23653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 911) took 1800 ms (client timeout 2116 ms). Trace:
W20260709 13:10:26.579541 23653 rpcz_store.cc:269] 0709 13:10:24.778436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.577364 (+1798928us) service_pool.cc:224] Handling call
0709 13:10:26.579154 (+  1790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.580902 26772 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 2.013s
I20260709 13:10:26.625617 22923 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.636453 22923 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:26.637308 22923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2550) took 1584 ms. Trace:
I20260709 13:10:26.637720 22923 rpcz_store.cc:276] 0709 13:10:25.052810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.765662 (+712852us) service_pool.cc:224] Handling call
0709 13:10:25.766534 (+   872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.625363 (+858829us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b580053f6d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f660aa 00007f3924fe8447 00007f3925000fe7 00007f39250027de 00007f392500cb49 00007f392500d416 00007f3925009d8f 00007f392500983e 00007f3929fce419 00007f3923545bd4
0709 13:10:26.636968 (+ 11605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.637209 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906184064}
W20260709 13:10:26.642621 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.642820 27139 consensus_meta.cc:287] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 2.035s	user 0.018s	sys 0.009s
I20260709 13:10:26.643527 27139 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:26.644227 27139 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.646219 27139 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.646693 27139 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.647228 27139 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.648332 27012 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.648917 27012 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.649546 27139 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.650817 27012 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.656512 27149 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:26.657114 27149 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.659199 27149 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.662281 22818 maintenance_manager.cc:419] P 84f66d81ef21415a8d9a0c01ca7125b0: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10921 bytes on disk
I20260709 13:10:26.661401 22825 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 8, leader changed from <none> to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.664312 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:26.665697 22928 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:26.665869 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:26.668717 22925 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.669457 22817 maintenance_manager.cc:643] P 84f66d81ef21415a8d9a0c01ca7125b0: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":339,"lbm_reads_lt_1ms":4}
I20260709 13:10:26.669363 22825 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.673435 22825 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 4 to 6, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 6 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:26.666972 22931 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:26.675189 22825 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:26.676455 22925 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:26.677418 22825 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:26.679577 22825 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.681689 22825 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 9, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 9 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.683405 22825 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.684657 23648 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:26.685274 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 907) took 1919 ms. Trace:
I20260709 13:10:26.685640 23648 rpcz_store.cc:276] 0709 13:10:24.766071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.684076 (+1918005us) service_pool.cc:224] Handling call
0709 13:10:26.684385 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.685057 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.685228 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.685314 22825 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.687274 22825 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 6, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 6 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.688908 22825 catalog_manager.cc:5697] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:26.690789 23621 connection.cc:256] RPC call timeout handler was delayed by -1.3133702789998551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:10:26.690742 22825 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.692893 22825 catalog_manager.cc:5697] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 5, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 5 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.696290 22825 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 5, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 5 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.701011 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:26.701689 22925 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 6.
I20260709 13:10:26.702600 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:26.703179 22931 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:26.703970 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:26.706224 27059 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.706811 27059 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.708776 27059 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.710178 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:26.713078 23046 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:26.714356 23046 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:26.715150 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08004170e0 after lost signal to thread 23681
I20260709 13:10:26.717141 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:26.717420 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:26.717607 27246 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.717721 22928 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.718469 27246 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:26.718616 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:26.719013 27246 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.719841 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:26.720378 22931 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:26.723160 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.691473 23621 connection.cc:256] RPC call timeout handler was delayed by -1.0298702789999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 13:10:26.715226 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:10:26.724000 23621 connection.cc:256] RPC call timeout handler was delayed by -1.0124590729999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:10:26.731700 22928 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:26.734581 27200 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:26.734995 27200 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:26.735353 27200 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.738860 22931 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:26.740097 23046 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:26.739955 27246 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:26.744277 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.744877 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.746932 27254 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:24.595497 26953 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:26.745622 27059 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.748991 26953 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:26.749750 27254 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:10:26.755182 27149 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.755488 27251 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:26.756145 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.755847 27149 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.755981 27251 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:26.758399 27149 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.758582 27251 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.759183 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.759716 27250 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:26.760036 27059 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:26.755831 26953 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:26.765413 26959 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.765630 27059 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.765986 26959 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:26.766875 27059 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:26.768748 26959 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:26.761212 27149 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.769596 27149 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.771955 27149 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.761474 23046 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:26.762221 27200 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.774391 27200 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:26.774538 23046 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:26.775063 27200 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:26.775336 27254 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:26.775410 27200 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:26.775956 27254 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:26.777084 27254 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:26.787338 27187 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 2.117s	user 0.004s	sys 0.003s
I20260709 13:10:26.791944 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.788110 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.794149 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2542) took 2323 ms. Trace:
I20260709 13:10:26.794929 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.794685 22922 rpcz_store.cc:276] 0709 13:10:24.470159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.470269 (+   110us) service_pool.cc:224] Handling call
0709 13:10:24.479995 (+  9726us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:24.480375 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.480401 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:24.480896 (+   495us) log.cc:844] Serialized 52 byte log entry
0709 13:10:24.525406 (+ 44510us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:24.670732 (+145326us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.670992 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.671088 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.786761 (+2115673us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b2400185d08. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921da39c4 00007f3921da1acb 00007f3921f5cdc9 00007f3921f5ca55 00007f3921f5c09d 00007f3924b8e10e 00007f3924ba588c 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221
0709 13:10:26.793638 (+  6877us) raft_consensus.cc:1685] finished
0709 13:10:26.793749 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.793935 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174683,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":9167,"raft.queue_time_us":17877,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":19868,"spinlock_wait_cycles":4731494144,"thread_start_us":174508,"threads_started":2,"wal-append.queue_time_us":90575}
I20260709 13:10:26.796597 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.797279 23073 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:26.789893 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.777084 27200 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.798194 23078 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:26.789963 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.799144 23072 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:26.801463 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.804188 23077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2362) took 2276 ms. Trace:
I20260709 13:10:26.804527 23077 rpcz_store.cc:276] 0709 13:10:24.528144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.528267 (+   123us) service_pool.cc:224] Handling call
0709 13:10:24.974523 (+446256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.975413 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.803808 (+1828395us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540021b950. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:26.804004 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983078272}
I20260709 13:10:26.808066 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.809340 23075 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:26.809700 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.790827 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:26.810598 23080 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:26.796787 23654 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:26.789153 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:26.813133 27143 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 2.114s	user 0.007s	sys 0.005s
I20260709 13:10:26.814765 22924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2548) took 2203 ms. Trace:
I20260709 13:10:26.759723 27251 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.815114 22924 rpcz_store.cc:276] 0709 13:10:24.611206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.616947 (+  5741us) service_pool.cc:224] Handling call
0709 13:10:24.617324 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.617719 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.617758 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.618241 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.620260 (+  2019us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:24.620309 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.620831 (+   522us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.814381 (+2193550us) raft_consensus.cc:1685] finished
0709 13:10:26.814428 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.814595 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41808,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1112}
W20260709 13:10:26.825426 23649 consensus_meta.cc:287] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.002s
I20260709 13:10:26.825815 23649 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:10:26.845752 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.846176 23075 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:26.847325 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:26.848937 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:26.851032 23621 leader_election.cc:336] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.522s (SENT)
W20260709 13:10:26.851764 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.854445 22931 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.858470 27114 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.886952 22931 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:26.873631 27254 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.894169 27114 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:26.894955 27254 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.896713 27114 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:26.897086 27254 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:26.901069 22952 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad340 after lost signal to thread 21775
W20260709 13:10:26.901475 22952 debug-util.cc:398] Leaking SignalData structure 0x7b0800268660 after lost signal to thread 21778
W20260709 13:10:26.902467 22952 debug-util.cc:398] Leaking SignalData structure 0x7b080030a060 after lost signal to thread 22863
W20260709 13:10:26.902958 22952 debug-util.cc:398] Leaking SignalData structure 0x7b08002eeb80 after lost signal to thread 22883
I20260709 13:10:26.897253 27200 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:26.911290 23072 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:26.912784 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 60176.8us
W20260709 13:10:26.914667 22952 debug-util.cc:398] Leaking SignalData structure 0x7b080022e2e0 after lost signal to thread 22955
W20260709 13:10:26.916052 22952 debug-util.cc:398] Leaking SignalData structure 0x7b0800310d20 after lost signal to thread 23030
W20260709 13:10:26.916344 22952 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdae0 after lost signal to thread 23031
W20260709 13:10:26.918676 22952 debug-util.cc:398] Leaking SignalData structure 0x7b0800326240 after lost signal to thread 23104
W20260709 13:10:26.918968 22952 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebca0 after lost signal to thread 23105
W20260709 13:10:26.986609 23621 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.646s (SENT)
I20260709 13:10:26.987394 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:26.990119 26949 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.000681 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1081) took 1044 ms. Trace:
I20260709 13:10:27.001169 23652 rpcz_store.cc:276] 0709 13:10:25.956081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.110678 (+154597us) service_pool.cc:224] Handling call
0709 13:10:26.112724 (+  2046us) raft_consensus.cc:1471] Updating replica for 7 ops
0709 13:10:26.113431 (+   707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.113467 (+    36us) raft_consensus.cc:1539] Triggering prepare for 7 ops
0709 13:10:26.123926 (+ 10459us) log.cc:844] Serialized 182 byte log entry
0709 13:10:26.129428 (+  5502us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:26.199040 (+ 69612us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.199739 (+   699us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.545783 (+346044us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b1800360220. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:26.998881 (+453098us) spinlock_profiling.cc:243] Waited 989 us on lock 0x7b1800360220. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3921f1fa40 00007f3921f1a4e4 00007f3921f1a455 00007f3925002060 00007f3925014716 00007f3925025287 00007f3925025208
0709 13:10:26.999281 (+   400us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.999602 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.999924 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.000079 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.000175 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.000223 (+    48us) raft_consensus.cc:1685] finished
0709 13:10:27.000240 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.000445 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18577,"prepare.queue_time_us":66843,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":146,"raft.queue_time_us":1078,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":1148,"spinlock_wait_cycles":9390592,"thread_start_us":73823,"threads_started":2,"wal-append.queue_time_us":19217}
W20260709 13:10:27.003571 22952 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac480 after lost signal to thread 23681
W20260709 13:10:27.004686 22952 debug-util.cc:398] Leaking SignalData structure 0x7b080037af00 after lost signal to thread 27159
W20260709 13:10:27.007946 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.010s	sys 0.004s
W20260709 13:10:27.008309 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.010s	sys 0.004s
W20260709 13:10:27.009497 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.009919 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.010300 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.010583 22895 connection.cc:256] RPC call timeout handler was delayed by -1.611952059000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:10:27.011236 27251 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:27.012003 27251 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:27.014961 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.016574 27251 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:27.018867 27271 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.098s	user 0.005s	sys 0.000s
I20260709 13:10:27.020084 27200 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:27.023739 27251 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.041184 27229 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:27.041671 27229 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:27.041946 27097 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.042440 27097 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.042639 27229 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.046460 27097 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:27.048941 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.050757 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.035457 27251 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:27.051934 27200 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:27.052603 27200 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:27.053574 27251 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:27.053776 27200 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.056635 22929 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:10:27.058861 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.059805 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 819196us
I20260709 13:10:27.061215 22970 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:27.070827 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:27.071677 22924 raft_consensus.cc:2410] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:10:27.071291 23045 leader_election.cc:336] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.543s (SENT)
I20260709 13:10:27.074868 23045 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:27.078105 22928 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:27.078464 22928 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:27.079319 22928 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.080415 22928 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:27.082185 27269 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:10:27.077224 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:27.088781 22929 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:27.076774 27229 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.090162 27171 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:27.100378 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.101151 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.103173 27150 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:27.104346 27251 raft_consensus.cc:3055] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:27.104786 27251 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:27.105621 27251 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.106918 27251 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.122176 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:27.122839 22929 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.124449 22924 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:27.126575 22924 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:10:27.126880 22924 pending_rounds.cc:85] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 8
I20260709 13:10:27.127076 22924 pending_rounds.cc:107] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:27.127336 22924 raft_consensus.cc:2889] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:27.128669 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.130096 22929 raft_consensus.cc:2468] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:27.122118 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.131893 26901 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:27.141081 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.137101 27094 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:27.121922 27115 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:10:27.137885 23046 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.138901 22928 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:27.134742 27254 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:27.150380 22928 pending_rounds.cc:85] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 7
I20260709 13:10:27.150804 22928 pending_rounds.cc:107] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:27.151120 22928 raft_consensus.cc:2889] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:27.158293 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.159096 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 87868.5us
I20260709 13:10:27.151490 27254 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:27.161779 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53998.9us
I20260709 13:10:27.157963 27114 raft_consensus.cc:2804] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:27.158133 26954 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 13:10:27.194147 27272 log.cc:927] Time spent T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:10:27.195434 27258 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.196043 27258 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.198348 27258 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:27.199713 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 138606us
I20260709 13:10:27.200593 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:27.209141 23045 leader_election.cc:336] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.598s (SENT)
I20260709 13:10:27.137162 27058 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:27.164480 27254 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.211956 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:27.216384 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 1.14355e+06us
I20260709 13:10:27.230647 27209 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:27.231098 27209 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:27.231458 27113 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.232020 27113 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.210721 27114 raft_consensus.cc:697] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:27.247479 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.231496 27209 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:27.260691 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51582.7us
I20260709 13:10:27.239368 27246 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:27.263857 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1100) took 1022 ms. Trace:
W20260709 13:10:27.266836 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 280318us
W20260709 13:10:27.268272 23621 leader_election.cc:336] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.837s (SENT)
I20260709 13:10:27.268749 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:27.248339 27022 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:27.272400 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.276546 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.281610 22931 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:27.278913 27217 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.291452 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:27.278313 27113 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:27.294346 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.281198 27258 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.297492 23649 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:27.297509 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.299180 23651 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:27.301451 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:27.301972 23650 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.303771 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:27.304517 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:27.312657 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 91543.3us
I20260709 13:10:27.296952 27058 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:27.321547 27283 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.322060 23621 leader_election.cc:336] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.852s (SENT)
I20260709 13:10:27.323457 23621 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:27.327154 23652 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:27.324285 27283 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.330313 26935 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.330921 26935 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.331493 27283 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:27.291918 27250 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:27.334179 27282 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.296044 26954 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:10:27.338790 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.337893 27283 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.325181 27150 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:27.344997 26780 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:27.345082 27276 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.151s	user 0.005s	sys 0.000s
I20260709 13:10:27.346239 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:27.351346 22895 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.352386 22895 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:27.354035 22895 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.354514 26949 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:27.355254 26958 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:27.355952 26958 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.356954 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.357553 22998 raft_consensus.cc:2376] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12. Re-sending same reply.
I20260709 13:10:27.358317 26958 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:27.358474 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.359426 27161 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:27.359227 27204 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:27.360265 27204 consensus_queue.cc:1243] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:27.360103 27161 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.326598 27114 consensus_queue.cc:237] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.362672 27150 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.363755 22999 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:27.362372 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.332547 27058 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:27.367210 22997 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 13: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:27.313036 27258 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.364394 23652 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:27.342338 27248 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:27.392589 23652 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:27.365949 26780 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:27.369145 27011 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:27.368986 27097 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:27.420764 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.424317 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.435125 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 234636us
I20260709 13:10:27.446355 23650 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:27.436517 22895 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:27.438947 23652 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:27.340070 27282 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.400209 27229 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:27.399078 27248 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:27.437676 27211 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.450300 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:27.460156 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 156571us
I20260709 13:10:27.404472 27161 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:27.459872 23622 leader_election.cc:336] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.568s (SENT)
I20260709 13:10:27.460182 22998 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 5.
I20260709 13:10:27.465188 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.469192 26935 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:27.456394 26780 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.474476 27282 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:27.475205 27211 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.475615 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.476800 22997 raft_consensus.cc:1240] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:27.477349 27211 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:27.459160 27248 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.479940 27058 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.481813 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.482419 23003 raft_consensus.cc:2376] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7. Re-sending same reply.
I20260709 13:10:27.482740 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.483248 23005 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.484156 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.484736 23004 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:27.486060 23002 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:27.488667 23652 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:27.452129 27097 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:27.490723 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:27.491582 22922 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:27.457808 27011 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:27.505434 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:27.506898 22896 leader_election.cc:336] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.565s (SENT)
I20260709 13:10:27.505204 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.509002 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.510710 22999 raft_consensus.cc:2410] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:10:27.512259 22922 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.511531 23650 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:27.514500 26772 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.515112 26772 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.517814 26772 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:27.519428 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:27.520226 22931 raft_consensus.cc:2393] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:27.520829 22999 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:27.521415 22925 raft_consensus.cc:1217] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[5.6-8.8]   Dedup: 5.6->[6.7-8.8]
I20260709 13:10:27.521906 22925 pending_rounds.cc:85] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 6
I20260709 13:10:27.522176 22925 pending_rounds.cc:107] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:10:27.522408 22925 raft_consensus.cc:2889] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.523260 22972 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:27.523862 27150 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:27.524206 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:27.524761 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.525096 22930 raft_consensus.cc:2410] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:27.508925 27193 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:10:27.525660 27026 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.526108 27026 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:27.486701 27229 raft_consensus.cc:697] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:27.515389 27097 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.526525 27026 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.527175 27229 consensus_queue.cc:237] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:27.528311 27285 log.cc:927] Time spent T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:27.528469 22971 leader_election.cc:400] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11.
I20260709 13:10:27.528877 22971 leader_election.cc:403] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:27.491039 26949 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.514526 22997 raft_consensus.cc:3060] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.531245 23005 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
W20260709 13:10:27.532431 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 95983.7us
I20260709 13:10:27.532650 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.533583 23000 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:27.537036 26949 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.541419 26958 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.543375 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:27.544344 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.545043 23648 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:27.545974 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.546540 23648 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:27.548014 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:27.548158 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.548640 23657 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.549396 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.547394 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.510999 27251 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.538224 23652 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:27.536526 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.555140 23649 raft_consensus.cc:2368] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
W20260709 13:10:27.552547 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.556592 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.556936 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003eea80 after lost signal to thread 21775
W20260709 13:10:27.557405 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac200 after lost signal to thread 21778
W20260709 13:10:27.558662 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba060 after lost signal to thread 22863
W20260709 13:10:27.560492 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac6c0 after lost signal to thread 22955
I20260709 13:10:27.538749 22895 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.551432 23648 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:27.562901 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.563145 22997 raft_consensus.cc:2468] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:27.563625 23656 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
W20260709 13:10:27.565601 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee9e0 after lost signal to thread 23030
W20260709 13:10:27.566051 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003eea40 after lost signal to thread 23031
I20260709 13:10:27.568461 23651 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:27.569516 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.572461 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.573652 23000 raft_consensus.cc:2410] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:10:27.574636 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.576380 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.508265 27248 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.575431 23653 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 5.
I20260709 13:10:27.579830 23651 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:27.567457 23678 debug-util.cc:398] Leaking SignalData structure 0x7b0800394aa0 after lost signal to thread 23104
I20260709 13:10:27.511896 26655 consensus_queue.cc:1059] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:10:27.602289 23656 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:10:27.603709 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:27.604112 23622 leader_election.cc:336] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.707s (SENT)
I20260709 13:10:27.606510 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:27.582882 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.578635 27171 consensus_queue.cc:1059] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:27.590041 26958 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11.
I20260709 13:10:27.611622 27150 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:27.612006 27115 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:27.612251 23651 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:27.612637 27115 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.613109 27115 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.591785 23001 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:27.591823 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 53166.4us
I20260709 13:10:27.593274 27288 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:27.264271 23655 rpcz_store.cc:276] 0709 13:10:26.241768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.244134 (+  2366us) service_pool.cc:224] Handling call
0709 13:10:26.249181 (+  5047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.249368 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:26.249680 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.241511 (+991831us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.263266 (+ 21755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.263317 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:27.263364 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.263422 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.263790 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":965650,"prepare.queue_time_us":284,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":1003401,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":134,"thread_start_us":47008,"threads_started":1}
I20260709 13:10:27.594650 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.595640 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:27.596400 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:27.596767 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:27.615432 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.598420 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.599282 27248 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:27.599916 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.600296 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.600618 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.600867 23080 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:27.581300 23678 debug-util.cc:398] Leaking SignalData structure 0x7b0800428bc0 after lost signal to thread 23105
I20260709 13:10:27.608083 22922 raft_consensus.cc:1240] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.606716 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:27.610042 23649 raft_consensus.cc:2393] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:27.610399 27059 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:27.651678 23651 raft_consensus.cc:2393] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:27.616338 23622 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:27.611104 22896 leader_election.cc:400] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:27.652946 22896 leader_election.cc:403] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:27.653239 23678 debug-util.cc:398] Leaking SignalData structure 0x7b0800411dc0 after lost signal to thread 23629
W20260709 13:10:27.597620 27284 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:10:27.616671 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.537511 27080 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:10:27.665005 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.661108 23073 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:27.654556 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 43601.4us
W20260709 13:10:27.672183 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 65539.2us
I20260709 13:10:27.674880 23000 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:27.676558 22997 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:27.653016 22999 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:27.734938 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:27.779425 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08001cc640 after lost signal to thread 23634
I20260709 13:10:27.758975 23074 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:27.703987 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:27.780287 23678 debug-util.cc:398] Leaking SignalData structure 0x7b080005b8e0 after lost signal to thread 23662
W20260709 13:10:27.782126 23678 debug-util.cc:398] Leaking SignalData structure 0x7b0800335b00 after lost signal to thread 23666
W20260709 13:10:27.782487 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08000da980 after lost signal to thread 23668
W20260709 13:10:27.782860 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003990a0 after lost signal to thread 23671
W20260709 13:10:27.783428 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003938a0 after lost signal to thread 23676
I20260709 13:10:27.779640 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:27.783812 23678 debug-util.cc:398] Leaking SignalData structure 0x7b080034c040 after lost signal to thread 23681
I20260709 13:10:27.659864 23077 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
W20260709 13:10:27.784410 23678 debug-util.cc:398] Leaking SignalData structure 0x7b0800299700 after lost signal to thread 26953
W20260709 13:10:27.784925 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.785223 23678 debug-util.cc:398] Leaking SignalData structure 0x7b080035b920 after lost signal to thread 27159
I20260709 13:10:27.612082 27150 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.790944 23652 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:27.792227 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:27.596441 27258 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:27.796262 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.797087 23650 raft_consensus.cc:2368] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7.
I20260709 13:10:27.618800 27288 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:27.709218 27298 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:10:27.658085 27011 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8.
I20260709 13:10:27.713223 27058 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:27.808502 23000 raft_consensus.cc:2376] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7. Re-sending same reply.
I20260709 13:10:27.760842 26655 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.813477 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.810576 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.613819 27251 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.657828 27171 raft_consensus.cc:3055] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:27.789746 27150 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.827324 23650 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:27.815275 23649 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:27.825906 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.817960 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 203252us
I20260709 13:10:27.839577 23652 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:27.832444 22895 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:27.841904 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:27.842779 23656 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:27.845100 27307 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:27.846649 27307 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:27.758612 26766 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:10:27.801208 27288 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:27.707010 27209 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.706921 27254 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.862852 23657 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:27.863796 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.817619 27171 raft_consensus.cc:740] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:27.867000 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 87490.8us
I20260709 13:10:27.799988 27123 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:10:27.814553 27292 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.866009 23654 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.818359 27305 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:27.864416 23000 raft_consensus.cc:2376] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10. Re-sending same reply.
I20260709 13:10:27.868224 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:27.816495 27058 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.839598 27258 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:27.858565 27011 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:27.880463 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:27.880678 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 276588us
I20260709 13:10:27.885584 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.816293 27290 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:10:27.892318 23072 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:27.892486 22924 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:10:27.894387 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 49441.6us
I20260709 13:10:27.899494 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:27.878739 27305 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:27.884037 27058 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.903971 23000 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:10:27.901188 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.904000 22930 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:27.886765 27011 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:27.893395 26949 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:27.899111 27248 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:27.916399 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.899855 27229 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:27.924999 26655 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.925631 27287 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.389s	user 0.001s	sys 0.001s
I20260709 13:10:27.925830 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.964066 23000 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:27.933570 23077 raft_consensus.cc:1240] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:27.969110 27171 consensus_queue.cc:260] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.970429 27171 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.907862 27193 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:27.935973 23006 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:27.936949 27300 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:28.000419 27193 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.916191 27290 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:28.003064 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:27.948307 27309 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:28.003731 23075 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.905356 27258 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.948083 27059 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:27.880668 27292 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.006228 27258 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.006973 27292 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:28.007957 27292 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:28.008394 27292 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.008788 27292 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:27.924346 27248 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.957533 23654 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
W20260709 13:10:27.961025 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.933984 23078 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:10:27.950704 27229 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:28.010541 27229 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.973572 27306 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:28.011917 27306 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.012288 27306 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.012362 23000 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:27.983425 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.013016 27282 raft_consensus.cc:3055] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:27.984185 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.013434 27282 raft_consensus.cc:740] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:27.985291 22999 raft_consensus.cc:1275] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:27.985937 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.014731 23005 raft_consensus.cc:2376] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7. Re-sending same reply.
I20260709 13:10:28.014434 27282 consensus_queue.cc:260] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:27.986143 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.015578 23001 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:27.986760 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.987061 23003 raft_consensus.cc:1275] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:10:28.016803 23003 pending_rounds.cc:85] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 11
I20260709 13:10:28.017025 23003 pending_rounds.cc:107] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:10:28.017246 23003 raft_consensus.cc:2889] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.987461 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:27.988785 27251 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:28.013454 22998 raft_consensus.cc:2376] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10. Re-sending same reply.
I20260709 13:10:27.989872 27209 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:27.990633 27026 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:27.997072 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:27.999804 27299 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:10:28.003165 27193 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:27.905486 27305 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.910657 27011 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.981483 27288 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:28.016443 23002 raft_consensus.cc:2376] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7. Re-sending same reply.
W20260709 13:10:28.107388 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.109887 23075 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:28.009646 27248 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.121639 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.020007 27282 raft_consensus.cc:3060] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.009006 27254 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:28.116817 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:28.138984 23622 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.999s (SENT)
I20260709 13:10:28.141785 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.142350 23002 raft_consensus.cc:2376] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12. Re-sending same reply.
I20260709 13:10:28.008895 26655 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.172395 22929 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:28.171017 23078 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:28.166579 27193 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.185006 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.185779 23002 raft_consensus.cc:2376] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11. Re-sending same reply.
I20260709 13:10:28.171759 27217 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.181803 27115 consensus_meta.cc:287] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.568s	user 0.004s	sys 0.006s
W20260709 13:10:28.194077 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 294649us
W20260709 13:10:28.194886 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 362531us
I20260709 13:10:28.200551 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:28.212167 27026 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.208191 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:28.213243 23077 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:28.195405 27097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.001s	sys 0.008s
I20260709 13:10:28.215610 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.170218 27058 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.212641 26655 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.201236 27217 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.229965 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.230787 23622 leader_election.cc:336] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 2.053s (SENT)
W20260709 13:10:28.219878 27097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.002s	sys 0.008s
I20260709 13:10:28.234762 27314 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:28.235522 27058 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:28.237609 27217 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.239562 23073 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:28.241809 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.242904 23003 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:28.243520 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.244328 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.246565 23080 raft_consensus.cc:1240] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 13:10:28.247406 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.250965 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.190030 27193 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.253300 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.254223 23004 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.209723 27115 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.261348 23002 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 10. Ops: []
I20260709 13:10:28.257655 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:28.262811 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.263015 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.269605 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.273774 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.274427 23005 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:28.281311 22997 raft_consensus.cc:1217] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-6.7]   Dedup: 6.7->[]
I20260709 13:10:28.281937 22997 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:10:28.283628 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.284420 23653 raft_consensus.cc:1240] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:28.284627 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.293352 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.320798 23001 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:28.357664 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 110696us
I20260709 13:10:28.359963 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.360603 22999 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:28.354710 27150 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.384264 27315 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:28.391160 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:28.391848 22924 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.257246 27292 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:28.399945 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.406263 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.412192 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.414287 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.390293 27315 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.419850 23003 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:28.414876 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:28.422583 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.394942 27288 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.430709 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.434568 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.431946 22926 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:28.436522 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.439142 22997 raft_consensus.cc:2410] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:28.438966 27011 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.441088 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.441792 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.436654 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.442425 23000 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:28.427521 23001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:28.444334 23001 raft_consensus.cc:606] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:10:28.444684 23001 raft_consensus.cc:614] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:28.446122 22926 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:28.446493 27011 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:28.447192 22929 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 12. Ops: []
I20260709 13:10:28.447211 22926 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:28.436239 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 153120us
I20260709 13:10:28.449258 22999 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:28.418678 27315 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.450281 22971 leader_election.cc:400] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7.
I20260709 13:10:28.450775 22971 leader_election.cc:403] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:28.450347 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.434052 27026 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.454269 27292 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:28.447902 27251 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:28.460848 27150 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:28.462337 27193 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.463146 23074 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:10:28.464090 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.464663 23002 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:28.469681 27229 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:28.470541 27306 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.484144 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.473356 22923 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:10:28.474767 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.486003 23045 leader_election.cc:336] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.615s (SENT)
I20260709 13:10:28.476016 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.478113 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.478653 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.482389 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.478946 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.481362 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 911) took 1124 ms. Trace:
I20260709 13:10:28.483349 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:28.487100 22924 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
W20260709 13:10:28.482543 22896 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.604s (SENT)
I20260709 13:10:28.490080 23006 rpcz_store.cc:276] 0709 13:10:27.357100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.368460 (+ 11360us) service_pool.cc:224] Handling call
0709 13:10:27.398667 (+ 30207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.000516 (+601849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.481138 (+480622us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54003e7e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:28.481286 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096722176}
I20260709 13:10:28.485241 22923 pending_rounds.cc:85] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 6
I20260709 13:10:28.496294 22923 pending_rounds.cc:107] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:28.496012 22971 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:28.496562 22923 raft_consensus.cc:2889] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.494884 23080 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:28.497862 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.498492 22997 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:28.493075 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:28.475188 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:28.500465 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.501538 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:28.504114 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:28.506705 22926 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:28.507285 23004 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:28.507670 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.508064 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.512277 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:28.494349 27318 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:28.506536 23005 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:28.517406 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.517951 22997 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.471632 27229 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.480190 27115 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:28.551192 23080 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:28.552767 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 70250.7us
W20260709 13:10:28.553324 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.528183 23006 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:28.514818 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.494688 27171 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 6. Current term is 7.
I20260709 13:10:28.516695 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.512856 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.519379 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.520020 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.520749 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.521692 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:28.522331 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:28.523128 23654 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:28.558002 23004 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:28.528162 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:28.529546 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:28.530784 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 44806.4us
I20260709 13:10:28.531392 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.532332 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:28.559301 23045 leader_election.cc:336] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.617s (SENT)
I20260709 13:10:28.538830 27315 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:28.563071 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 54786.4us
I20260709 13:10:28.557173 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.558148 23654 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:28.523717 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.565773 22999 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:28.559737 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:28.561879 22926 raft_consensus.cc:2368] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 7. Current term is 8.
I20260709 13:10:28.567025 23000 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:28.570119 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.570765 22924 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:28.571622 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.572837 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.578167 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.578970 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.583189 27251 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:28.583636 27251 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.583719 27193 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:28.583674 23073 raft_consensus.cc:1240] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:28.586748 23005 raft_consensus.cc:2393] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:28.549554 27209 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:28.587854 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.585857 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.583011 27055 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:28.579766 23620 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:28.591619 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.596172 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.604964 23002 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:28.605710 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.606236 23002 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.501032 27080 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:10:28.561200 27292 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:28.607057 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.609375 22997 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:28.610335 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.607908 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.613371 23620 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:28.616391 22997 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:28.614812 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.624850 22924 raft_consensus.cc:2393] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 6: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:28.627646 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.615406 26655 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:28.629623 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:28.607805 27059 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.629426 23000 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:28.596647 27209 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.638427 23004 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:28.649631 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:28.652500 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.650326 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:28.653800 23650 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:28.654253 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 94968.6us
I20260709 13:10:28.653273 23655 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:28.654989 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:28.655057 23045 leader_election.cc:336] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.667s (SENT)
I20260709 13:10:28.657577 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.659169 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.659778 22999 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:28.658255 22998 raft_consensus.cc:2376] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11. Re-sending same reply.
I20260709 13:10:28.618933 27193 consensus_queue.cc:1243] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer b655449a388a41e3a606c6ea794825ad log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:28.588074 26740 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:10:28.658841 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.664507 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.662544 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.662633 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.587373 27282 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:28.632205 26655 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.632989 27026 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:28.673096 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:28.677255 23004 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.675480 23006 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:28.596947 27305 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:28.654883 27209 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.683012 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.683749 22999 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:28.685020 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.677258 26655 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.647380 22928 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:28.704397 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.704599 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.706918 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 142156us
W20260709 13:10:28.678282 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.712306 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.712724 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.713557 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.656450 27248 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:28.720155 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.720815 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.738052 22999 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:28.738121 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.739552 23006 raft_consensus.cc:2368] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
W20260709 13:10:28.743342 22896 leader_election.cc:336] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.786s (SENT)
I20260709 13:10:28.744657 23650 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:28.748027 22931 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:28.755138 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.753822 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.762086 23004 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:28.762987 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.763540 23004 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
W20260709 13:10:28.749090 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 198557us
W20260709 13:10:28.764379 22896 leader_election.cc:336] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.803s (SENT)
I20260709 13:10:28.761183 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.774686 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.776790 23655 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
I20260709 13:10:28.713729 27094 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:28.782245 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.783602 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.784698 22998 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:28.788453 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.800307 22999 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 12: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:28.789746 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.792397 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.793547 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.794808 22896 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:28.803467 22896 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:28.799532 23077 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.000s
I20260709 13:10:28.805229 23077 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:28.807274 23079 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:28.810140 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 155111us
W20260709 13:10:28.812944 23045 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.721s (SENT)
I20260709 13:10:28.812875 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.812816 22928 raft_consensus.cc:1240] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:28.813611 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:28.813860 23000 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:28.817999 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.824642 22896 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.870s (SENT)
I20260709 13:10:28.826249 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.827842 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.831125 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.806631 27061 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:28.833292 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.834069 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.834854 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.808470 27229 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:28.841195 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.841461 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.843880 22997 raft_consensus.cc:2393] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:28.841696 23621 leader_election.cc:336] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.568s (SENT)
W20260709 13:10:28.844725 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.844910 23621 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:28.809042 27292 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:28.846827 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.842706 22998 raft_consensus.cc:2376] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11. Re-sending same reply.
W20260709 13:10:28.852829 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.820628 27305 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.856971 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.858469 23003 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:28.862377 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.862540 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.854948 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:28.821198 27315 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:28.863283 23000 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 13: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:28.863534 23003 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:28.832319 27307 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:28.867250 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.867486 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.868002 23004 raft_consensus.cc:2376] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12. Re-sending same reply.
I20260709 13:10:28.835924 27061 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.873085 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.873596 22998 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:28.868844 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 55925.8us
I20260709 13:10:28.871281 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.876973 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.877585 22997 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:28.888955 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.889899 22924 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:28.894582 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.895488 22924 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:28.856292 27229 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:28.906471 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.907090 23004 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.867285 27217 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:28.908842 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 143838us
W20260709 13:10:28.914932 23621 leader_election.cc:336] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.619s (SENT)
W20260709 13:10:28.908699 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 146324us
I20260709 13:10:28.914346 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:28.886005 27011 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:28.879074 27061 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.918994 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.920326 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.878895 27292 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:28.926728 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:28.927608 23622 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Timed out: RequestConsensusVote RPC to 127.21.67.193:39171 timed out after 1.619s (SENT)
W20260709 13:10:28.929091 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.929600 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.929388 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:28.930994 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:28.933276 22924 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:28.925017 23000 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:28.935916 23000 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:28.935444 22924 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:28.937402 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:28.943631 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.944355 22924 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:28.952067 23656 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:28.953908 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:28.956496 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.944087 27291 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.412s	user 0.004s	sys 0.008s
I20260709 13:10:28.933259 27011 raft_consensus.cc:697] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:28.962340 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.964627 27341 consensus_queue.cc:1059] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:28.965706 27150 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:28.968184 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:28.968919 27331 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:10:28.961390 22896 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.524s (SENT)
I20260709 13:10:28.938212 27217 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:28.980638 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.936776 27258 consensus_queue.cc:1059] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:28.981302 23000 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:28.985035 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 76164.4us
I20260709 13:10:28.987288 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:28.988371 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:28.981578 27325 log.cc:927] Time spent T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:10:28.989691 23080 raft_consensus.cc:2393] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 7: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:28.981700 27326 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:10:28.975888 27346 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:28.997058 23004 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
W20260709 13:10:28.992208 22896 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.525s (SENT)
I20260709 13:10:28.993046 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:29.001881 23074 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 12: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:29.001335 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:28.995280 23000 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.992043 23002 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:29.009882 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.012265 27288 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:29.018195 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:29.017467 27317 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.619s	user 0.001s	sys 0.003s
W20260709 13:10:29.019228 27227 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:10:25.962547 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.67.194:39749 (local address 127.0.0.1:45784)
0709 13:10:26.004895 (+ 42348us) negotiation.cc:107] Waiting for socket to connect
0709 13:10:26.013490 (+  8595us) client_negotiation.cc:175] Beginning negotiation
0709 13:10:26.014044 (+   554us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:10:28.765578 (+2751534us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0709 13:10:28.780656 (+ 15078us) client_negotiation.cc:404] Received NEGOTIATE response from server
0709 13:10:28.807125 (+ 26469us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0709 13:10:28.998072 (+190947us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:10:28.998178 (+   106us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:10:28.998603 (+   425us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.21.67.194:39749: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":41370,"thread_start_us":45216,"threads_started":1}
I20260709 13:10:29.025933 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:29.021425 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 122942us
I20260709 13:10:29.024438 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 2103) took 1745 ms. Trace:
I20260709 13:10:29.000344 27097 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:28.987974 27217 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.030683 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.017689 27248 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.039327 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:29.027819 22927 rpcz_store.cc:276] 0709 13:10:27.278942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.279195 (+   253us) service_pool.cc:224] Handling call
0709 13:10:27.284186 (+  4991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.298557 (+ 14371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.298590 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.301109 (+  2519us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.394215 (+ 93106us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:27.394254 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.394323 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.619509 (+1225186us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:29.021553 (+402044us) raft_consensus.cc:1685] finished
0709 13:10:29.021574 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.024359 (+  2785us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16091,"raft.queue_time_us":24881,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8414,"spinlock_wait_cycles":10833152,"thread_start_us":89447,"threads_started":1,"wal-append.queue_time_us":89897}
W20260709 13:10:29.034644 27337 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:10:29.074194 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 2112) took 1050 ms. Trace:
I20260709 13:10:28.995246 27229 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.076520 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.077057 22997 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:29.077498 27338 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:10:29.078914 27332 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:10:29.079171 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:29.079916 23075 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:29.069382 23654 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.029642 27097 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:29.095297 23654 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:29.096517 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 168919us
I20260709 13:10:29.085944 23001 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:29.100802 22997 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:29.101933 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.000147 27292 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.076653 27352 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:29.024639 27150 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.105415 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.105553 23000 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:10:29.094623 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 76955.5us
I20260709 13:10:29.075714 22930 rpcz_store.cc:276] 0709 13:10:28.023847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.024857 (+  1010us) service_pool.cc:224] Handling call
0709 13:10:28.111388 (+ 86531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.111792 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.111831 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.124992 (+ 13161us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.433327 (+308335us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:28.433369 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.433459 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.073966 (+640507us) raft_consensus.cc:1685] finished
0709 13:10:29.073986 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.074128 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":550,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4705,"thread_start_us":257982,"threads_started":1,"wal-append.queue_time_us":512783}
W20260709 13:10:29.101732 27329 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:10:29.114457 23000 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:29.096139 27328 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:10:29.109323 22997 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.118889 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:29.119621 23075 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:29.122565 23654 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:29.029836 27342 raft_consensus.cc:3055] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:29.124752 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.106909 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 164928us
I20260709 13:10:29.108666 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.127141 23003 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:10:29.127625 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.128803 27250 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.128931 23003 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:29.129387 23003 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:29.129556 27217 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:29.130086 23003 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:29.131249 23003 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.074862 26655 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:29.132850 27251 consensus_meta.cc:287] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
I20260709 13:10:29.133234 27251 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.134444 26655 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:29.128268 27342 raft_consensus.cc:740] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:29.135152 27251 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.034708 27011 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.136054 27342 consensus_queue.cc:260] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:29.130509 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.137809 27250 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.138878 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.140565 27250 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.146358 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.147346 27250 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.148109 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:29.149055 27250 raft_consensus.cc:2764] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:29.149811 23045 leader_election.cc:400] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
I20260709 13:10:29.150265 23045 leader_election.cc:403] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:29.150915 27250 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
I20260709 13:10:29.154404 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.155637 27250 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:29.156369 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.156840 23080 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:29.157522 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.157915 23076 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:29.157829 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.158788 23072 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:29.158901 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.159638 23076 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.158799 23080 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 12: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:29.164510 23003 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:29.166172 22997 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 15.
I20260709 13:10:29.163486 22998 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:29.167928 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:29.031555 27305 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:10:29.171815 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 248222us
I20260709 13:10:29.172799 23000 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:29.173586 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.174932 22997 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:29.179623 23072 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:29.180449 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 56584.3us
I20260709 13:10:29.183295 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.181171 23622 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.183869 23073 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.180013 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.182785 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:29.179297 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.189622 23079 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.188602 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.191779 23072 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.147277 27061 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:29.192381 27348 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:10:29.183000 27290 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.190466 27258 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:29.193351 27059 consensus_meta.cc:287] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.005s
I20260709 13:10:29.185966 26655 consensus_queue.cc:1059] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:10:29.193650 27251 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:29.196338 27323 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:10:28.099921 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.21.67.194:39749)
0709 13:10:28.555202 (+455281us) server_negotiation.cc:207] Beginning negotiation
0709 13:10:28.561359 (+  6157us) server_negotiation.cc:400] Waiting for connection header
0709 13:10:28.572990 (+ 11631us) server_negotiation.cc:408] Connection header received
0709 13:10:28.615570 (+ 42580us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:10:28.618451 (+  2881us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:10:28.715030 (+ 96579us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:10:28.773476 (+ 58446us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0709 13:10:29.012284 (+238808us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45784: BlockingRecv error: recv got EOF from 127.0.0.1:45784 (error 108)
Metrics: {"server-negotiator.queue_time_us":317768,"thread_start_us":220762,"threads_started":1}
W20260709 13:10:29.200598 22815 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 94246.8us
I20260709 13:10:29.200716 27022 consensus_queue.cc:1059] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:10:29.202118 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:29.202818 27353 log.cc:927] Time spent T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:29.203213 23622 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.229084 27059 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.229576 26655 raft_consensus.cc:3055] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:29.229193 27251 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.263563 26655 raft_consensus.cc:740] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:29.267128 27193 raft_consensus.cc:2764] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:29.267580 26655 consensus_queue.cc:260] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.268854 26655 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.181499 27097 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.270370 27061 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:29.272372 27022 consensus_queue.cc:1243] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:29.272837 27258 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:29.276250 27345 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 13:10:29.192658 27357 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:29.293776 27258 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:29.288568 23620 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:29.296175 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:29.299804 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 106089us
W20260709 13:10:29.304415 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.304236 22895 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:29.308327 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 106299us
I20260709 13:10:29.309670 23621 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.312014 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.322369 22931 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.323274 22930 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:29.327462 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.328137 22895 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.326809 27305 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:29.340344 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 167790us
I20260709 13:10:29.339680 27022 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:29.342343 22972 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:29.342603 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.344250 23077 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.329026 27248 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:29.348502 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 52402us
I20260709 13:10:29.349540 23073 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:29.349957 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.356624 23076 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:29.343791 27022 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.346365 27061 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.369221 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.343935 27055 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:10:29.359853 27059 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.361788 27115 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:29.364570 27357 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.343509 27355 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:29.368876 27022 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:29.392940 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 50698.7us
I20260709 13:10:29.368261 27251 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.402057 27355 consensus_queue.cc:1243] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:29.404135 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.405443 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:29.406430 23079 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 15.
I20260709 13:10:29.398912 27150 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.407099 27115 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:29.407812 27209 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.693s	user 0.016s	sys 0.000s
I20260709 13:10:29.368346 27258 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:29.365048 27193 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:10:29.411693 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 48434.6us
I20260709 13:10:29.399705 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.401310 23077 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
W20260709 13:10:29.415884 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 71211.6us
I20260709 13:10:29.366926 27094 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:10:29.391867 27310 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:29.435230 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.415390 23045 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.687s (SENT) [suppressed 76 similar messages]
I20260709 13:10:29.382014 27307 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:10:29.425181 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:29.456816 23045 connection.cc:256] RPC call timeout handler was delayed by -1.2048662320000858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24220000000000003s for a response
I20260709 13:10:29.465312 23620 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:29.466673 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 67087.6us
I20260709 13:10:29.468252 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:29.469336 23648 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:29.469643 23649 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.468379 23656 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:29.471028 23622 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.473989 23653 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:10:29.524919 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 174971us
W20260709 13:10:29.526295 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 125291us
W20260709 13:10:29.575313 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 79640us
I20260709 13:10:29.422730 27209 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:29.526597 27171 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:10:29.425601 27258 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.618966 23648 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:29.608907 23649 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
W20260709 13:10:29.612533 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.565677 27352 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:29.627031 23072 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:29.633504 23006 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 13: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:29.563446 27055 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:29.577507 27375 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:29.526311 27373 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 13:10:29.633729 27290 raft_consensus.cc:2764] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:10:29.636668 27193 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:29.643078 27289 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.581187 27372 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:29.661500 27258 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:29.656630 27289 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:29.667186 27289 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:29.673004 22998 raft_consensus.cc:3055] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:29.673372 22998 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:29.674022 22998 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:29.674867 22998 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.676610 27209 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.682427 27346 raft_consensus.cc:3055] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:29.682842 27310 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:29.683518 27372 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:29.684485 27372 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.657979 27352 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.688177 27055 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.688817 27055 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.682834 27346 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:29.690537 27346 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.695703 27171 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.696372 27171 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.698714 27171 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.699352 27171 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:29.700011 27352 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.723790 27171 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:29.724766 27171 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:29.725415 27352 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:29.675455 27022 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.726071 27171 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.727505 27022 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:29.648113 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 177157us
I20260709 13:10:29.729290 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:29.729974 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:29.729295 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:29.730517 23654 raft_consensus.cc:2376] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12. Re-sending same reply.
I20260709 13:10:29.730832 23655 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.736202 23622 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:29.737130 23622 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.737984 27229 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:29.738368 27229 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:29.577553 27357 consensus_queue.cc:1048] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:10:29.740135 23655 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:29.741180 27282 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:29.741596 27282 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:29.741987 27282 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.742869 23620 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:29.743850 27389 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.744540 27389 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:29.739133 27229 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:29.745707 27229 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:29.702515 27340 log.cc:927] Time spent T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.716s	user 0.003s	sys 0.000s
I20260709 13:10:29.753357 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:29.753984 23648 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.754097 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:29.754689 23079 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.707544 27055 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.708464 27376 consensus_queue.cc:1059] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:29.708961 27305 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.709569 27375 raft_consensus.cc:697] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:29.712056 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.712934 27150 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.758442 27375 consensus_queue.cc:237] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:29.713593 27342 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.765017 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:29.717764 27306 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:29.766523 22929 raft_consensus.cc:1240] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:29.719475 23001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2272) took 1240 ms (client timeout 1548 ms). Trace:
W20260709 13:10:29.767067 23001 rpcz_store.cc:269] 0709 13:10:28.479049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.494732 (+ 15683us) service_pool.cc:224] Handling call
0709 13:10:29.719258 (+1224526us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400097c54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:29.719384 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330603904}
I20260709 13:10:29.753468 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:29.768303 23654 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:29.768800 22923 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:29.769789 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:29.770484 22925 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:29.703480 27346 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:29.756558 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 98820.2us
W20260709 13:10:29.751413 22896 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.078s (SENT)
I20260709 13:10:29.791553 23656 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:10:29.811858 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 60465us
I20260709 13:10:29.813092 22998 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:29.814540 23079 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:29.816419 23620 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:29.818881 22896 leader_election.cc:336] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.081s (SENT)
I20260709 13:10:29.819612 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:29.821121 23045 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:29.823235 27250 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:29.825428 27250 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:29.826327 27250 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:29.824718 27394 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:29.826992 27250 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:29.831779 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 356457us
I20260709 13:10:29.832517 23621 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:29.836928 23045 leader_election.cc:336] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.422s (SENT)
I20260709 13:10:29.837374 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:29.839413 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 200400us
W20260709 13:10:29.843060 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.843978 27282 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.844487 23653 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 7 LEARNER]: Advancing to term 9
I20260709 13:10:29.847249 27282 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:29.848343 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:29.848718 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:29.849637 23649 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:29.850257 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.819412 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.853947 22926 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:29.858753 22925 raft_consensus.cc:1240] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:29.864485 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.865386 22998 raft_consensus.cc:2410] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:29.866617 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.868081 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.867409 23001 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:29.868091 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.758876 27150 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.871397 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.873605 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.895687 23002 raft_consensus.cc:2376] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8. Re-sending same reply.
I20260709 13:10:29.897128 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.876801 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:29.882189 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.900843 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:29.902511 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51007.7us
I20260709 13:10:29.902782 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:29.903779 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 91180.7us
I20260709 13:10:29.904096 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.905815 23004 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:29.902556 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 65653.4us
I20260709 13:10:29.891454 27310 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.817155 26655 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.912103 26655 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.914517 23653 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 9 LEARNER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:29.915584 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:29.915704 23621 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:29.916534 23649 raft_consensus.cc:2410] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:10:29.917785 27352 consensus_queue.cc:1048] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:29.918246 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:29.919332 27352 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.920034 27397 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:29.915957 27292 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:29.920274 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.853083 27258 raft_consensus.cc:2804] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:29.851138 27193 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.799548 27022 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:29.940045 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.894960 23006 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:29.926890 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.973129 23005 raft_consensus.cc:2376] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12. Re-sending same reply.
I20260709 13:10:29.932037 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:29.920967 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:29.974766 22998 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 13: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:29.935199 23003 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:29.869604 27358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.010s	sys 0.014s
I20260709 13:10:29.835345 27250 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:29.816322 27094 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
W20260709 13:10:29.972241 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 67784.6us
W20260709 13:10:29.981105 22896 leader_election.cc:336] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.105s (SENT)
W20260709 13:10:29.976882 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.971171 23000 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:29.978276 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.979944 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 85503.2us
I20260709 13:10:29.975049 27355 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.996099 22896 leader_election.cc:336] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.116s (SENT)
I20260709 13:10:29.997169 22999 raft_consensus.cc:2468] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
W20260709 13:10:29.999289 27382 log.cc:927] Time spent T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.339s	user 0.003s	sys 0.000s
I20260709 13:10:29.973688 27258 raft_consensus.cc:697] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:30.026664 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 69000.5us
W20260709 13:10:30.032008 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 49315.4us
I20260709 13:10:30.030869 23621 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.034117 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.035544 23621 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.040005 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:29.994422 27352 consensus_queue.cc:1059] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:10:30.052865 27376 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:30.058944 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 741608us
I20260709 13:10:30.059912 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:30.065510 23045 leader_election.cc:336] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.429s (SENT)
I20260709 13:10:30.002733 27355 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:30.073836 27391 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:10:30.073650 27396 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:30.076303 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.076964 23003 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:30.080096 27150 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:30.079888 27330 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:30.082427 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.084331 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.085161 23005 raft_consensus.cc:2410] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:30.064824 27339 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.088330 27339 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.090379 27339 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:30.091087 23003 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:30.093066 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.096642 23648 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:30.100417 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 47525.6us
I20260709 13:10:30.103096 22931 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:30.061129 27022 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:30.051469 27341 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:10:30.095965 27411 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:30.132315 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:30.116686 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.098760 27412 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:30.099364 27061 raft_consensus.cc:2764] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:10:30.138339 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 89008.7us
I20260709 13:10:30.148452 23620 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:30.148627 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.150660 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.153178 27352 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.136610 27413 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:30.154074 27409 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:10:30.114063 27375 consensus_queue.cc:1059] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:30.166128 27413 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:30.168009 27413 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.168182 27375 raft_consensus.cc:3055] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:30.168609 27375 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:30.169539 27375 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.163977 27362 consensus_queue.cc:1059] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:10:30.165002 27355 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:30.149945 26901 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:30.171931 26901 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.174990 26901 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:30.165004 27405 log.cc:927] Time spent T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:10:30.161818 27330 consensus_queue.cc:1059] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:30.177649 27330 consensus_queue.cc:1243] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:30.178134 27330 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:30.178416 27330 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:30.178954 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.179375 27330 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.180676 27330 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.181140 27026 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:30.188715 23045 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.633s (SENT)
I20260709 13:10:30.189322 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.162070 27411 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.138316 27258 consensus_queue.cc:237] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.201478 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:30.207515 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.209944 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:30.210593 23648 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:30.195458 26901 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:30.216984 27354 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.218254 23652 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:30.219272 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:30.195472 27411 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.223917 27026 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:30.224448 27026 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:30.225418 27026 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.230755 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:30.231786 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.232787 22970 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.236398 22970 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.240525 27341 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:30.241482 27416 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:30.200521 27022 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.251725 26901 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:30.253970 26901 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:30.256279 27305 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:30.257843 27411 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:30.258831 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.260458 27097 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:30.237392 27354 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:30.265738 27250 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:10:30.275511 27394 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:30.275938 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.276746 22999 raft_consensus.cc:2410] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 13 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:30.266501 26901 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:10:30.301241 27413 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.304159 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:30.304661 27229 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.001s
I20260709 13:10:30.304704 22999 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.316157 27413 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:30.317873 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.325837 22999 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:30.328615 23621 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:30.339548 22929 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:30.341404 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.342029 22923 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 7.
I20260709 13:10:30.347458 27413 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:30.363642 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 303808us
I20260709 13:10:30.364756 27292 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.364991 22895 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.365180 27292 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:30.365549 27292 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.370472 23046 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:30.367451 22895 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:30.376885 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:30.381654 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.376036 27058 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:10:30.376562 27150 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:30.379892 27251 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:10:30.379738 27248 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:10:30.391597 27011 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:30.392169 27011 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:30.393059 27011 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.381713 27305 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:30.378813 27384 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:30.380033 27288 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:30.406891 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 274620us
I20260709 13:10:30.407819 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:30.409652 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.413753 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.380906 27413 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:30.418202 27413 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:30.421137 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44347.9us
I20260709 13:10:30.424746 22896 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.425081 22928 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:30.427155 22896 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.398408 27384 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.422842 27305 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:30.422322 22895 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:30.424366 27251 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:30.426033 27150 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:30.426859 27288 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:30.429392 27097 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:30.457413 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:30.442659 27384 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:30.493930 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:30.494903 23073 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:30.497016 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:30.497778 23073 raft_consensus.cc:2410] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:30.485219 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:30.499725 23073 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:30.501232 23077 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:30.454879 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.492749 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:30.493000 27387 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:30.506312 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.509853 23001 raft_consensus.cc:2376] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13. Re-sending same reply.
I20260709 13:10:30.452114 27305 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:30.507725 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.511384 22999 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.453507 27248 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:30.508955 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.458122 27403 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.517074 23005 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:30.514112 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.519922 23001 raft_consensus.cc:2376] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10. Re-sending same reply.
I20260709 13:10:30.518473 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.520875 22997 raft_consensus.cc:2376] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9. Re-sending same reply.
I20260709 13:10:30.522408 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.549263 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.516690 27305 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.551082 22999 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
W20260709 13:10:30.555498 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 100665us
I20260709 13:10:30.556447 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.560530 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.561262 23001 raft_consensus.cc:2368] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13.
I20260709 13:10:30.562072 23001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:30.562686 23001 raft_consensus.cc:606] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:30.562204 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.559592 27097 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.559803 27248 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:30.565266 27248 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:30.566407 27430 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:10:30.571705 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.572045 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.572428 27384 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.572842 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:30.573150 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:30.573381 22929 raft_consensus.cc:3060] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.574182 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.575103 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.577900 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.560797 27369 raft_consensus.cc:3055] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:30.656677 23005 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:30.606732 27288 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.667160 23006 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:30.657581 22999 raft_consensus.cc:2376] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10. Re-sending same reply.
I20260709 13:10:30.658717 23076 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:30.658905 22929 raft_consensus.cc:2468] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:30.659811 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:30.660784 23648 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:30.660259 27097 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:30.677237 27026 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.699815 27339 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:30.699923 27026 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.700456 27339 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.702175 27026 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:30.691871 27428 log.cc:927] Time spent T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.005s
I20260709 13:10:30.694590 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.705651 23000 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.695246 27011 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:30.695626 23002 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:30.713726 23002 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:30.698470 27251 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:30.708178 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.709116 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.722100 23000 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
W20260709 13:10:30.723791 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.679726 27372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.003s	sys 0.008s
I20260709 13:10:30.720556 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.726377 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.663291 27369 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:30.732609 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.736707 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:30.737534 22929 raft_consensus.cc:2410] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:30.727974 27011 raft_consensus.cc:697] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:30.753290 27436 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.753315 27011 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.756699 27422 consensus_queue.cc:1059] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:10:30.757575 22929 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:30.758833 27229 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:30.759199 27229 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:30.727609 27282 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.738582 27022 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.765108 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:30.729272 27372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.003s	sys 0.008s
I20260709 13:10:30.785908 22896 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.793488 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.794231 23000 raft_consensus.cc:2376] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10. Re-sending same reply.
I20260709 13:10:30.796590 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.727713 27097 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:10:30.802496 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:30.803042 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:30.803755 23002 raft_consensus.cc:2393] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:30.804816 23002 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:30.805277 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 72716.9us
I20260709 13:10:30.789597 27436 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:30.807749 23622 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:30.799754 27390 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.770s	user 0.000s	sys 0.006s
I20260709 13:10:30.759636 27305 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.797721 27251 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:30.736997 27397 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:10:30.759979 27229 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:30.800828 27438 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.806401 27355 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:30.823094 22929 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:30.823035 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.826069 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.828466 23648 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:30.814505 27251 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:30.827267 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:30.819047 27022 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:30.832190 27429 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.005s
I20260709 13:10:30.826236 27248 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.839227 22896 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:30.826586 27150 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:30.821755 27403 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:10:30.833539 27251 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:30.824492 27372 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:30.833765 27438 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:30.844683 27011 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:30.845332 27441 log.cc:927] Time spent T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:10:30.845809 27305 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:30.847085 27378 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:30.836890 27397 consensus_queue.cc:1243] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:30.839526 27292 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:30.863324 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:30.880724 27442 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:30.865069 23652 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:30.872208 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:30.882014 27292 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:30.870118 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1126) took 1457 ms. Trace:
I20260709 13:10:30.811703 27369 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.886322 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.884356 23651 rpcz_store.cc:276] 0709 13:10:29.410198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.410632 (+   434us) service_pool.cc:224] Handling call
0709 13:10:29.410920 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.427169 (+ 16249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.427201 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.427575 (+   374us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.862072 (+434497us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.862141 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.862237 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.589541 (+727304us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:30.856607 (+267066us) raft_consensus.cc:1685] finished
0709 13:10:30.856635 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.867078 (+ 10443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15903,"raft.queue_time_us":19891,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":15394048,"thread_start_us":299030,"threads_started":1,"wal-append.queue_time_us":489438}
I20260709 13:10:30.872761 27011 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:30.893627 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:30.865195 27248 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:30.892903 27436 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:30.891860 27292 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.889959 27378 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.010448 27436 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.012054 27378 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:30.967787 27387 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:31.012519 26655 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.012985 27387 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.015269 27387 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:30.911899 27011 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.913204 27397 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.912707 27330 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.895455 27305 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:30.956149 27455 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:10:31.018187 27448 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 13:10:30.889447 27150 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:10:30.996979 22926 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:30.976176 27307 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:31.001928 27290 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.035205 27397 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.045485 27307 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.035372 27330 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.047049 27397 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:31.036782 27292 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:31.047601 27307 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.047976 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.048156 27330 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.048645 22927 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:31.051054 23622 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:31.048000 27292 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.030642 27097 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:31.055413 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.056063 27097 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.057528 27011 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.058321 27097 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.059469 27061 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:31.070855 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.054035 27292 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:30.973295 27418 raft_consensus.cc:3055] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:30.972111 27443 log.cc:927] Time spent T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:10:31.059667 27372 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.081463 27011 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.081166 27372 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.086784 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.063702 27397 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.087767 27397 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.083613 27372 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:30.959102 27413 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:31.089164 27374 raft_consensus.cc:3055] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:31.089624 27374 raft_consensus.cc:740] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:31.089839 27397 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:31.090330 27307 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.090504 27374 consensus_queue.cc:260] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.090869 27307 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.091542 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.092182 22927 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:31.092797 27307 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.070657 27061 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.093420 27061 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.093647 23622 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:31.095700 27397 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:31.096109 27397 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.089268 27413 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.104259 22927 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:31.096480 27397 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.106364 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:31.108805 23001 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:31.107043 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.078585 27418 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:31.071306 27290 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.112592 27418 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.113617 27418 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:31.114054 27290 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:31.117914 27445 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 13:10:31.119236 23656 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:31.119594 23656 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:31.120406 23656 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.121505 23656 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:31.103330 27248 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.124487 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:31.125690 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:31.126236 23001 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:31.132607 27339 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:31.133381 27457 log.cc:927] Time spent T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:10:31.133915 22997 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:31.134507 23001 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:31.136222 27402 raft_consensus.cc:993] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:31.136674 27402 raft_consensus.cc:1081] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
W20260709 13:10:31.140147 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.143200 22924 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:31.147940 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:31.147959 23073 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:31.148536 23072 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.150118 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.155474 23077 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:31.104063 27011 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:31.157965 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.109680 27374 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:31.158532 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:31.161741 23075 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.164086 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.174495 23072 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
W20260709 13:10:31.176103 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 113391us
I20260709 13:10:31.177749 22895 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:31.180055 23656 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:31.176908 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.180948 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1209) took 1304 ms. Trace:
I20260709 13:10:31.164708 22927 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:31.181699 23656 rpcz_store.cc:276] 0709 13:10:29.876052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.876987 (+   935us) service_pool.cc:224] Handling call
0709 13:10:29.900549 (+ 23562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.119143 (+1218594us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b54005e22a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f81dc0 00007f392500c1c0 00007f392500d231 00007f3925009d8f 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c
0709 13:10:31.180640 (+ 61497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.180883 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57959680}
I20260709 13:10:31.183801 22972 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:31.166872 27434 log.cc:927] Time spent T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.646s	user 0.007s	sys 0.000s
I20260709 13:10:31.151475 27387 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:31.185048 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:31.151243 27250 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:31.188846 23656 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.157158 27290 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:31.189666 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:31.190704 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.196640 23080 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:31.197081 27387 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.191367 27209 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.201472 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:31.185554 27283 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:31.206321 23075 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:31.202363 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.206656 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.219131 23072 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:31.182581 27288 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:31.221019 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 2121) took 1941 ms. Trace:
I20260709 13:10:31.243598 22928 rpcz_store.cc:276] 0709 13:10:29.279542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.292358 (+ 12816us) service_pool.cc:224] Handling call
0709 13:10:29.292702 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.425469 (+1132767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.220775 (+795306us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003935d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:31.220964 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603493120}
I20260709 13:10:31.204030 27209 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.205124 27115 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:31.166987 27011 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.225072 27251 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.226053 22923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:10:31.249929 22923 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:31.250407 22923 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:31.202801 27290 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.227962 27460 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:10:31.229025 27388 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.570s	user 0.004s	sys 0.000s
I20260709 13:10:31.230170 22926 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:10:31.231273 27447 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:10:31.231822 23656 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:31.232713 27061 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:31.234416 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.235852 27330 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.182183 27248 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:10:31.183931 27339 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:10:31.180227 27354 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:31.211688 27250 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.251142 27288 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:31.251523 23648 raft_consensus.cc:1240] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:31.249327 27209 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.259984 23650 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:31.270239 23656 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:31.249344 27115 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:31.277761 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:31.281229 22924 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.275506 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.285727 27250 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.286499 27413 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.289011 27115 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.290010 27115 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.280730 27381 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:10:31.294369 27381 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:31.294750 27381 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:31.271420 27330 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.299502 27229 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.300238 27330 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.300451 27288 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:31.304240 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:31.304977 22926 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.306681 22928 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:31.307315 27397 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.305542 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:31.308949 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.311610 22924 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:31.312212 22928 raft_consensus.cc:2393] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:31.282361 27061 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:31.312906 23622 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:31.318452 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:31.320670 27307 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.320813 23045 leader_election.cc:400] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13.
I20260709 13:10:31.322569 22923 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.323689 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.387921 22925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49902 (request call id 2132) took 1069 ms. Trace:
I20260709 13:10:31.388322 23649 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:31.306480 27114 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:31.330569 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.389631 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:31.389942 22928 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:31.390225 22927 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.331303 22926 raft_consensus.cc:2468] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:31.331987 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:31.321882 27413 raft_consensus.cc:2804] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:31.332602 27250 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:31.333666 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.391703 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 143067us
W20260709 13:10:31.392001 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.327944 27378 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:31.400736 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68826.3us
W20260709 13:10:31.340514 27451 log.cc:927] Time spent T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.381s	user 0.002s	sys 0.000s
W20260709 13:10:31.341903 27450 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 13:10:31.346827 27011 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.354899 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:31.358908 27397 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:31.360124 27387 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:31.295552 27381 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:31.376150 27209 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.388448 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2583) took 1625 ms. Trace:
I20260709 13:10:31.394511 22924 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:31.402956 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:31.450459 23005 raft_consensus.cc:3060] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.404064 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:31.405707 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:31.363543 27290 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.444326 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.388331 22925 rpcz_store.cc:276] 0709 13:10:30.318948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.319749 (+   801us) service_pool.cc:224] Handling call
0709 13:10:30.320032 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.388661 (+ 68629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.388706 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.391304 (+  2598us) log.cc:844] Serialized 26 byte log entry
0709 13:10:31.126686 (+735382us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b180048f3a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa0d1 00007f3924fc5a0f
0709 13:10:31.202595 (+ 75909us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:31.233428 (+ 30833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.234074 (+   646us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.329420 (+ 95346us) raft_consensus.cc:1685] finished
0709 13:10:31.329439 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.387858 (+ 58419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61616,"raft.queue_time_us":62001,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":5171,"spinlock_wait_cycles":11750144,"thread_start_us":75755,"threads_started":1,"wal-append.queue_time_us":862468}
I20260709 13:10:31.458132 23656 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:31.446959 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:31.459199 23651 raft_consensus.cc:2376] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8. Re-sending same reply.
I20260709 13:10:31.460188 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.409224 27436 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.476362 22928 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:31.476624 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.445134 27283 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:31.444612 22923 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.448518 23001 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:31.449524 22922 rpcz_store.cc:276] 0709 13:10:29.763018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.763132 (+   114us) service_pool.cc:224] Handling call
0709 13:10:29.763447 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.763789 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.763815 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.764192 (+   377us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.932113 (+167921us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.976071 (+ 43958us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.363091 (+387020us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b1800453880. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3921f1fa40 00007f3921f1a4e4 00007f3921f1a455 00007f3925002060 00007f3925014716 00007f3925025287 00007f3925025208
0709 13:10:30.363307 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.363378 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.381335 (+1017957us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b1800453880. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:31.383641 (+  2306us) raft_consensus.cc:1685] finished
0709 13:10:31.388255 (+  4614us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.388395 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2637,"prepare.queue_time_us":41712,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":6398,"raft.queue_time_us":388652,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":162,"spinlock_wait_cycles":49133696,"thread_start_us":167468,"threads_started":1,"wal-append.queue_time_us":240850}
W20260709 13:10:31.424291 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 69469.4us
I20260709 13:10:31.451859 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:31.456581 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 52608.8us
I20260709 13:10:31.461985 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1135) took 1628 ms. Trace:
I20260709 13:10:31.473225 27209 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.475337 27381 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.488533 23654 rpcz_store.cc:276] 0709 13:10:29.833552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.833695 (+   143us) service_pool.cc:224] Handling call
0709 13:10:29.834014 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.913496 (+ 79482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.913539 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.913593 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:29.913636 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.461733 (+1548097us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54004763d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:31.461791 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.461923 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":438,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":182004096}
I20260709 13:10:31.493896 22925 raft_consensus.cc:1240] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:31.487588 23648 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:31.516713 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:31.517997 22922 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.518723 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:31.410184 27413 raft_consensus.cc:697] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:31.491310 22927 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:31.460371 27011 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.524035 27306 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:31.526341 22925 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:31.457245 27363 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.416507 27150 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:10:31.539083 22896 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:31.400426 27114 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.495447 27358 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.412698 27055 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:10:31.518127 27283 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:31.505383 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.420976 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.516798 27310 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:31.578594 27310 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.580603 27310 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.553181 23005 raft_consensus.cc:2468] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:31.566303 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.503937 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:31.582446 22999 raft_consensus.cc:3060] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.541198 27460 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:31.583578 23622 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:31.592718 22999 raft_consensus.cc:2468] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:31.516609 27061 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:10:31.597240 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:31.634755 23649 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:31.549372 27011 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:31.604936 27306 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:31.638115 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.638852 23656 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:31.547840 27363 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:31.630601 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.632524 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 289877us
W20260709 13:10:31.575511 27438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.011s	sys 0.023s
I20260709 13:10:31.599313 26740 raft_consensus.cc:2804] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:31.646581 27114 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:31.667318 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.575626 27358 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.674039 23656 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:31.587922 27283 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.670822 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:31.680071 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:31.681604 23654 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:31.672070 27438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.011s	sys 0.023s
I20260709 13:10:31.677811 27362 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.690819 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:31.686362 27171 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.670806 26740 raft_consensus.cc:697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:31.698370 27283 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.689412 27209 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:10:31.699671 27402 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:31.700063 27402 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.698185 27470 consensus_queue.cc:1059] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:31.700414 27402 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.701664 27396 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:31.702847 27396 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:31.703168 27396 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:31.708771 23649 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:31.664816 27306 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.684327 27472 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.709993 22896 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:31.687749 27438 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:31.725224 22999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:31.759179 22999 raft_consensus.cc:606] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:10:31.726341 22970 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:31.759569 22999 raft_consensus.cc:614] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:31.664254 27413 consensus_queue.cc:237] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.768893 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet adf5adaae5184191bdaff064d051da2a with delete_type TABLET_DATA_TOMBSTONED (TS 216ff6323e434e399d196d8ba262c8f3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:45790
W20260709 13:10:31.769627 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.770118 27358 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.770648 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.785770 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.786499 23080 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:31.705265 27055 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:10:31.775820 27369 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:31.776811 26740 consensus_queue.cc:237] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.777938 27438 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.717839 27452 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:10:31.800549 23076 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:31.786451 23072 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:31.775638 27384 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:31.703971 27396 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.716605 27378 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:31.743362 27288 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:31.840888 27288 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:31.841992 27288 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.766521 27374 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:31.805155 27454 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.772s	user 0.004s	sys 0.001s
I20260709 13:10:31.798377 27386 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.806442 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:31.853204 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45541.9us
I20260709 13:10:31.853468 23071 raft_consensus.cc:3060] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.761670 27251 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.855472 27386 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.855901 22970 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:31.808970 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.815086 23076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e257e4274a884c2b87551c41d6072956"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:10:31.857167 23072 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:31.857095 27339 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:31.857564 27386 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:31.857671 23076 raft_consensus.cc:606] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:31.858568 27339 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.859090 27339 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.820696 27363 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:31.825073 27408 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.859583 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:31.798761 27472 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:10:31.860355 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:31.824011 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.861066 22927 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:31.860857 27408 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.834129 22998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 960) took 1758 ms. Trace:
I20260709 13:10:31.800292 27250 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.861780 22998 rpcz_store.cc:276] 0709 13:10:30.075413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.075774 (+   361us) service_pool.cc:224] Handling call
0709 13:10:30.076162 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.076577 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.076618 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.378810 (+1302192us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b2c000af478. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3923903a11 00007f3923913372 00007f3925045a01 00007f392500a43a 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2
0709 13:10:31.379270 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:10:31.676985 (+297715us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:31.677018 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.677173 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.833772 (+156599us) raft_consensus.cc:1685] finished
0709 13:10:31.833805 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.834061 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5162,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":49005312,"thread_start_us":297349,"threads_started":1,"wal-append.queue_time_us":402550}
I20260709 13:10:31.862912 27408 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.862774 27250 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:31.789175 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:31.876755 22999 raft_consensus.cc:3055] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:31.852197 23075 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:31.858630 23076 raft_consensus.cc:614] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:31.826357 27378 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:31.859457 27339 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.840022 27473 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:31.834424 27396 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.751823 27283 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:31.869436 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:31.877184 22999 raft_consensus.cc:740] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:31.885056 22922 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:31.762216 27470 consensus_queue.cc:1059] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
W20260709 13:10:31.895562 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 248583us
I20260709 13:10:31.896445 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.890870 27357 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:31.863524 27408 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:31.900635 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.877995 23072 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
W20260709 13:10:31.905738 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 214982us
I20260709 13:10:31.918967 23649 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:10:31.904462 27473 consensus_queue.cc:1243] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:31.923132 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:31.923780 27381 consensus_queue.cc:1059] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:31.926785 22931 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:31.935038 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.948773 23649 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:31.951452 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.940222 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.929394 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:31.952664 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:31.953085 22971 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:31.953392 22922 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:31.955020 23003 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:31.959357 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:31.960114 23003 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:31.961040 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:31.962042 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:31.956141 22931 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:31.915277 27408 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.972178 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:31.981354 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 70367.8us
I20260709 13:10:31.910459 27283 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.021229 27330 raft_consensus.cc:3055] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:32.021683 27330 raft_consensus.cc:740] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:32.022068 27488 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.917135 27357 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.022778 27488 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:32.033092 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.968289 27358 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.034626 23075 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:32.030315 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:32.037089 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 55156.6us
I20260709 13:10:32.034004 22895 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:32.050493 22929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 984) took 1229 ms. Trace:
I20260709 13:10:31.972229 27408 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.052306 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.069566 22997 raft_consensus.cc:2368] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
I20260709 13:10:31.972414 27306 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:31.987872 27475 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.069164 22929 rpcz_store.cc:276] 0709 13:10:30.820905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.821030 (+   125us) service_pool.cc:224] Handling call
0709 13:10:30.821273 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.823490 (+  2217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.050228 (+1226738us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5400220e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:32.050429 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3796736}
I20260709 13:10:32.076331 22895 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:32.078528 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:32.029523 27492 tablet_replica.cc:333] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
W20260709 13:10:32.056140 27445 log.cc:927] Time spent T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:32.084105 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:32.088773 22997 raft_consensus.cc:606] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:32.089108 22997 raft_consensus.cc:614] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:31.974296 27402 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.022516 27330 consensus_queue.cc:260] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.092499 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:32.093883 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.055858 27490 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.044045 27473 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.051008 27419 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.094964 22972 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:32.096843 23001 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.115070 23071 raft_consensus.cc:2468] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:32.075273 27358 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.056902 27250 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.100101 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:32.129673 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:32.131352 27290 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.100986 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:32.131778 27290 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:32.132587 27290 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.133594 27290 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.030701 27022 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.087390 27413 consensus_queue.cc:1059] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:10:32.087894 27475 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.105275 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:32.109364 23000 raft_consensus.cc:2410] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:32.110431 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2030) took 1592 ms. Trace:
I20260709 13:10:32.110839 27485 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:32.084409 27436 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:32.081409 27375 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.112751 23652 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.082789 27248 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:32.111426 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:32.119021 27307 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.124408 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.084703 27420 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.116307 22970 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:32.165910 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 49672.7us
I20260709 13:10:32.035517 27386 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:10:32.146759 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 112496us
I20260709 13:10:32.084240 27055 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:32.143069 23006 rpcz_store.cc:276] 0709 13:10:30.517864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.673025 (+155161us) service_pool.cc:224] Handling call
0709 13:10:30.704103 (+ 31078us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:30.704491 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.704520 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:30.705068 (+   548us) log.cc:844] Serialized 52 byte log entry
0709 13:10:30.882663 (+177595us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:30.887160 (+  4497us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.889469 (+  2309us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.889678 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.889741 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.123955 (+234214us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18001027c0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:31.804885 (+680930us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b2400109778. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921da39c4 00007f3921da1acb 00007f3921f5cdc9 00007f3921f5ca55 00007f3921f5c09d 00007f3924b8e10e 00007f3924ba588c 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221
0709 13:10:32.110241 (+305356us) raft_consensus.cc:1685] finished
0709 13:10:32.110260 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.110380 (+   120us) inbound_call.cc:177] Queueing success response
0709 13:10:32.118488 (+  8108us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b18001027c0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d522 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
Metrics: {"mutex_wait_us":11240,"prepare.queue_time_us":242130,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":4218,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":17169,"spinlock_wait_cycles":97372672,"thread_start_us":176393,"threads_started":1,"wal-append.queue_time_us":274321}
I20260709 13:10:32.134219 27369 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:32.134485 27358 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.178144 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:32.092247 27115 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:10:32.146656 27485 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.181548 27485 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.184306 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.184949 22997 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:32.185820 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.186815 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.184347 27357 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.188216 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:32.189021 27470 consensus_queue.cc:1059] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:32.151058 27402 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.177695 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:32.134119 27419 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.192221 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:32.192914 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.193696 27419 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.195070 27150 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.195590 27150 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.197240 27475 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:32.197666 27150 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.198237 27150 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:32.202952 22999 consensus_queue.cc:260] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.204711 27488 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.205619 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:32.205873 27283 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.128504 27473 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.206784 27475 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.206883 23046 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:32.207248 27475 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:32.207664 27475 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.208176 27114 raft_consensus.cc:2804] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:32.208333 27473 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.208725 27114 raft_consensus.cc:697] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:32.209746 27114 consensus_queue.cc:237] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.210299 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:32.210882 23652 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.170675 27354 raft_consensus.cc:2804] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:32.157580 27436 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:32.215582 27436 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.218848 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:32.171627 27420 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.219735 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:32.221066 27420 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.227254 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:32.236706 23046 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:32.201473 27485 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.216637 27369 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.254717 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:32.260444 22925 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:32.146937 27022 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.229439 27288 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.117182 27490 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.243355 27354 raft_consensus.cc:697] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:32.250098 27355 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.169912 27307 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.249650 27413 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.281090 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:32.255376 27420 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.256057 27499 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.258664 27369 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:32.289848 23652 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:32.245064 27339 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.293846 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:32.284235 27491 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:10:32.334708 23080 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:32.327860 27171 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.340181 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:32.340556 27171 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.342916 27171 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.331401 27467 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:32.344234 27467 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:32.345257 27467 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.375113 27374 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.375809 27374 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.378350 27490 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:32.388269 27500 log.cc:927] Time spent T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:10:32.397034 27307 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:32.400827 27229 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.401187 27475 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.401496 27229 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.404891 27022 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.405939 27229 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.411931 27354 consensus_queue.cc:237] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.413103 27492 raft_consensus.cc:2243] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:32.413221 27055 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.413887 27055 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.414335 27492 raft_consensus.cc:2272] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:32.277853 27288 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.292387 27357 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.423151 23003 raft_consensus.cc:2393] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
W20260709 13:10:32.459403 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 202526us
I20260709 13:10:32.458562 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2321) took 1050 ms. Trace:
I20260709 13:10:32.462772 23002 rpcz_store.cc:276] 0709 13:10:31.407010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.407138 (+   128us) service_pool.cc:224] Handling call
0709 13:10:31.407492 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.425296 (+ 17804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.425338 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.446592 (+ 21254us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.057897 (+611305us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b1800370a80. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1cc02 00007f3924ba420b 00007f3924ba9d23 00007f3924baa0d1 00007f3924fc5a0f
0709 13:10:32.147988 (+ 90091us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:32.148052 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.148144 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.416629 (+268485us) raft_consensus.cc:1685] finished
0709 13:10:32.416647 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.457808 (+ 41161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17362,"raft.queue_time_us":37345,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2258,"spinlock_wait_cycles":8497536,"thread_start_us":89756,"threads_started":1,"wal-append.queue_time_us":821611}
I20260709 13:10:32.465214 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.472772 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.413113 27402 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:32.284090 27413 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.481734 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:32.458652 27396 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.003s
I20260709 13:10:32.457315 27022 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.484072 27055 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.479602 23002 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:32.499490 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.500187 23002 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:32.501124 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.497517 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.441102 27357 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:32.293308 27420 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.298282 27358 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.284646 27355 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.493616 23650 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:32.444285 27475 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:32.505144 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:32.509270 23002 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:32.514755 23080 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:32.515120 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.515609 23073 raft_consensus.cc:1275] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:32.508867 23652 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:32.516690 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.517925 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.519284 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.521008 23650 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: [8.9-12.12]
I20260709 13:10:32.513419 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.530005 23071 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:32.532677 23000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2313) took 1736 ms (client timeout 2092 ms). Trace:
I20260709 13:10:32.534880 23005 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:32.535324 23005 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:32.540832 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.541155 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.507174 27357 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:32.533172 23000 rpcz_store.cc:269] 0709 13:10:30.796193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.796340 (+   147us) service_pool.cc:224] Handling call
0709 13:10:32.532455 (+1736115us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400097254. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:32.532625 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016918400}
I20260709 13:10:32.545888 23004 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:32.546777 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.553433 23655 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 9 LEARNER]: Advancing to term 10
I20260709 13:10:32.554504 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.560384 23079 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:32.509694 27472 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.557251 23005 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.522080 27055 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.564898 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.497958 27402 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.568449 23651 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:10:32.505321 27022 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.587638 23005 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.620452 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.507804 27505 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:10:32.623394 23080 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:32.627758 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:32.543536 27150 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:10:32.635407 23078 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:32.637971 23655 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:32.639621 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:32.640628 23078 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:32.581279 27485 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.586866 27055 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.664755 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.648478 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.651506 22929 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:32.665545 23080 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
W20260709 13:10:32.672194 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.661634 27251 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.673383 27251 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:32.674312 27251 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.674881 27475 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:32.646912 27114 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.676048 27114 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.677970 27114 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.678399 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:32.673321 27501 log.cc:927] Time spent T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:10:32.679678 23620 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:32.680761 27408 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.590s	user 0.005s	sys 0.004s
I20260709 13:10:32.681190 27408 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.681630 27373 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:32.682592 23006 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 13: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:32.653260 23005 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:10:32.653978 23622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.687757 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:32.678989 23078 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:32.589663 27472 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.588349 27369 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:32.693861 27436 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:32.698616 27150 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:32.675573 27251 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.702461 27397 raft_consensus.cc:3055] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:32.702946 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.835379 23005 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:32.704942 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 958) took 1139 ms. Trace:
I20260709 13:10:32.838146 23654 rpcz_store.cc:276] 0709 13:10:31.565868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.566016 (+   148us) service_pool.cc:224] Handling call
0709 13:10:32.704591 (+1138575us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54005b36d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:32.704849 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228252544}
I20260709 13:10:32.683025 27339 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:32.745527 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 262761us
W20260709 13:10:32.754473 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.715763 27209 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:10:32.841276 23005 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:10:32.859277 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 167475us
W20260709 13:10:32.878064 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 196885us
I20260709 13:10:32.879580 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:32.879797 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:32.822906 27288 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.828262 27413 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.871789 22997 raft_consensus.cc:2368] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:32.884296 23078 raft_consensus.cc:2393] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:32.874989 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 185571us
W20260709 13:10:32.862430 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 172567us
W20260709 13:10:32.885609 22896 leader_election.cc:336] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 2.092s (SENT)
I20260709 13:10:32.886691 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:32.835544 27358 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.835134 27397 raft_consensus.cc:740] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:32.859750 27355 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:32.870661 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 231090us
I20260709 13:10:32.859431 27283 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:10:32.896420 27523 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.862367 27436 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:10:32.900650 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:32.882617 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.903965 23005 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:32.906917 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:32.896956 27525 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:32.912381 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:32.912004 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.924918 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:32.925043 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:32.925549 22925 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:32.892863 27402 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.892577 27492 ts_tablet_manager.cc:1916] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:10:32.936209 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 56752us
I20260709 13:10:32.937403 23620 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:32.940869 23620 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:32.889285 27373 consensus_queue.cc:1048] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:10:32.915518 27355 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:32.951629 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:32.952210 23078 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:10:32.956300 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 69658.6us
I20260709 13:10:32.957568 27369 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.966040 23045 leader_election.cc:400] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
I20260709 13:10:32.966557 23045 leader_election.cc:403] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:32.927068 27150 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:32.930224 27521 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:32.934218 27358 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:32.938436 27022 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:32.978127 27436 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.978715 27436 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.979215 27436 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.981400 27546 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.981979 27546 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.982570 27533 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:32.983342 27533 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.974982 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:32.987021 23075 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:32.989243 22970 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:32.997153 23078 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:32.942795 27536 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:32.984889 27519 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:10:32.999096 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:32.999167 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:32.985049 27489 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 1.004s	user 0.003s	sys 0.001s
I20260709 13:10:32.984800 27546 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.948498 27532 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:33.012398 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 55371.1us
I20260709 13:10:33.013340 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.017163 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:32.922775 27523 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.022945 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:32.930891 27525 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:32.967861 27355 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.003783 27310 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.015002 27522 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:33.010653 27512 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.035146 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:33.000784 27402 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:33.040585 27485 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.043871 27543 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.044260 27472 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:32.998546 27533 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.016537 27115 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.046501 27408 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.050711 27538 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:33.052104 27529 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:10:33.052837 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:33.054991 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:33.021498 27516 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 13:10:33.151693 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.993539 27531 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11.
I20260709 13:10:33.098331 27290 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:33.015358 27369 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:32.948693 27397 consensus_queue.cc:260] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:33.067202 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.061252 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 91381.1us
I20260709 13:10:33.018980 27532 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:32.994226 27358 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:33.055523 27499 consensus_meta.cc:287] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.002s
I20260709 13:10:33.014097 27483 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:10:33.154955 27357 consensus_meta.cc:287] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:10:33.102378 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.034682 27546 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:33.119091 27115 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.119671 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:33.120281 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 1.0031e+06us
I20260709 13:10:33.168605 23620 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.124006 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.124505 27459 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:33.127418 27508 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.545s	user 0.000s	sys 0.001s
I20260709 13:10:33.127918 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:33.128417 27489 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:33.076869 27512 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.130439 27011 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:33.098891 27522 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.133205 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:32.976447 27150 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.090934 27402 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.166311 27499 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:33.117610 27472 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:33.169746 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:33.178181 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 75351.9us
I20260709 13:10:33.181260 22928 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:33.159825 27408 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:33.162150 27229 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:33.158707 27532 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.165194 22929 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:33.113794 27543 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.214962 27543 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.202488 22895 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:33.206650 27472 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.216044 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.216958 27472 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.218914 27525 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.219832 27540 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.220870 27559 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.222193 27355 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:33.170285 27357 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.168192 27369 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:33.225185 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.208084 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.186033 27512 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.180131 26740 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:33.181066 27459 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.236322 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.212350 27522 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.210817 27550 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:33.180341 27545 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.221304 27559 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.198356 27402 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:33.171099 27546 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.209419 27408 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.238286 27459 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:33.246631 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:33.226269 27538 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.223861 27288 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.254765 23655 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.246158 27533 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.247611 27545 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.257912 27546 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.240141 27378 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.248616 27559 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.237599 27229 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.254143 27408 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.266180 27538 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.271112 27378 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:33.270088 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 100614us
W20260709 13:10:33.282532 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.285401 27355 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.286321 27374 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.286185 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.289935 27357 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.290776 27115 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.291327 27541 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:33.291366 27310 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:33.296646 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.297581 23073 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.300015 23655 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:33.353323 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2326) took 1237 ms. Trace:
W20260709 13:10:33.355033 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 68959us
I20260709 13:10:33.512864 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:33.356812 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:33.513455 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.357878 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:33.514210 22929 raft_consensus.cc:2410] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:33.357656 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.381552 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:33.393694 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:33.377713 23078 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:33.377696 27150 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:33.392694 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.381052 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.432336 22928 raft_consensus.cc:1240] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:33.433037 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:33.523646 22930 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:33.417874 27374 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.526206 27374 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.528692 27374 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.281611 27369 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.354185 27355 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.447459 27523 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.452625 27420 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.457165 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.460448 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:33.472337 23074 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:33.473014 27097 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.474036 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:33.474745 27503 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:33.543991 27533 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:33.544723 27503 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:33.545727 27503 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.546757 27503 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.476648 27545 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.478075 27538 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.426236 27358 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.482826 27229 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.484390 27483 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:33.548578 27483 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.550686 27483 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:33.489441 27378 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.551594 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:33.553119 27097 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.558593 27055 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.560055 27419 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:33.560348 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.560647 27419 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.561796 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.562566 27420 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.563067 27420 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.566716 27420 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.567617 27419 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:33.490475 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.569645 23079 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:33.491864 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.492805 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.496886 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.572582 23080 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:33.574118 27355 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:33.574847 23657 raft_consensus.cc:2393] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:33.518846 27022 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:33.580713 27022 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.583120 27022 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:33.512295 27532 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.590010 27532 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.497339 27459 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.489545 27512 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.504168 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:33.508683 27558 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.510951 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 966) took 1382 ms. Trace:
I20260709 13:10:33.378458 27115 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.377070 27310 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.513501 23655 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:33.516010 23654 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:33.396257 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.516971 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:33.434859 27546 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.442601 27436 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.532582 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:33.512387 23003 rpcz_store.cc:276] 0709 13:10:32.116070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.713864 (+597794us) service_pool.cc:224] Handling call
0709 13:10:32.714156 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.714372 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:33.001968 (+287596us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.352976 (+351008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.353026 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:33.353072 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.353139 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.353258 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16506,"prepare.queue_time_us":475537,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":298,"raft.queue_time_us":3970,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":21154,"thread_start_us":635296,"threads_started":2,"wal-append.queue_time_us":406850}
I20260709 13:10:33.493624 27402 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.536446 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.541013 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.523716 27541 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:33.591358 23076 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:33.606369 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.646556 23079 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:10:33.646953 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:33.620545 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 116433us
I20260709 13:10:33.648247 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:33.648986 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.605814 22930 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:33.649547 22924 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:33.650084 22927 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:33.650400 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.646503 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.651554 22926 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 14: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:33.647584 23003 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:33.621730 23650 rpcz_store.cc:276] 0709 13:10:32.139790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.556054 (+416264us) service_pool.cc:224] Handling call
0709 13:10:32.556513 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.556822 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:32.603797 (+ 46975us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.604327 (+   530us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.458699 (+854372us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b1800350b60. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3924bc0d70 00007f3924bb4293 00007f3924ba9cea 00007f3924baa23a 00007f3925014a2a 00007f39250240bf 00007f3925024038
0709 13:10:33.510550 (+ 51851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.510613 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:33.510667 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.510748 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.510890 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75805,"prepare.queue_time_us":29611,"prepare.run_wall_time_us":34,"raft.queue_time_us":52548,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":8625,"spinlock_wait_cycles":21804032}
I20260709 13:10:33.620489 27097 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.644622 27115 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
I20260709 13:10:33.662402 27483 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:33.663702 27171 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:33.664302 27171 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.666632 27171 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.667160 27171 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.667881 27396 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.668473 27396 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.670809 27396 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.682775 27545 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.683456 27545 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.686100 27545 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:33.689512 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 172630us
I20260709 13:10:33.693352 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.694571 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:33.699892 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 55913.4us
W20260709 13:10:33.700901 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.703035 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.616541 27229 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:33.709398 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.710204 23003 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:33.671355 27396 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:33.733891 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.743382 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.744505 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.745364 23003 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:33.748389 23002 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:33.749557 22928 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:33.525135 27408 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.757714 22925 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:33.757750 22924 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:33.762938 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.765542 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.766726 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:33.767045 27506 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.343s	user 0.003s	sys 0.000s
I20260709 13:10:33.767820 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.767077 22930 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:33.770495 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.771463 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.773185 23080 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:33.631091 27532 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:33.687196 27510 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.779446 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.790213 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.792706 22972 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:33.796074 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.715029 27358 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:33.798156 27545 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:33.810595 27545 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.810997 27545 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:33.813158 27514 log.cc:927] Time spent T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 1.049s	user 0.001s	sys 0.001s
I20260709 13:10:33.813506 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:33.813881 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.814114 22929 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.814612 22924 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:33.800866 27544 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:33.816293 22922 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:33.817227 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.818200 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.819191 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.820761 27420 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:33.821260 27420 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.821604 27355 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:33.822137 27355 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.798117 27487 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:33.823866 27420 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:33.824394 27436 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:33.824777 27552 log.cc:927] Time spent T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.466s	user 0.001s	sys 0.000s
I20260709 13:10:33.825778 22929 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:33.826139 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2405) took 1242 ms. Trace:
I20260709 13:10:33.826555 23071 rpcz_store.cc:276] 0709 13:10:32.584069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.635550 (+ 51481us) service_pool.cc:224] Handling call
0709 13:10:32.646332 (+ 10782us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:32.902650 (+256318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.903174 (+   524us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:32.916813 (+ 13639us) log.cc:844] Serialized 52 byte log entry
0709 13:10:33.067828 (+151015us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:33.067866 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.067933 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.824137 (+756204us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:33.825831 (+  1694us) raft_consensus.cc:1685] finished
0709 13:10:33.825858 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.826069 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31768,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":42603904,"thread_start_us":354218,"threads_started":2,"wal-append.queue_time_us":298748}
I20260709 13:10:33.827723 27512 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.828589 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.808012 27363 raft_consensus.cc:3055] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:33.830010 23071 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:33.830108 27363 raft_consensus.cc:740] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:33.831100 27363 consensus_queue.cc:260] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.832185 27363 raft_consensus.cc:3060] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.835786 27402 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.815346 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.636313 27558 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.837996 27355 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.840240 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:33.842100 23000 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 16: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:33.844841 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.847976 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:33.848739 22922 raft_consensus.cc:2393] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:33.850112 23652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47786 (request call id 968) took 1600 ms. Trace:
I20260709 13:10:33.850504 23652 rpcz_store.cc:276] 0709 13:10:32.249258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.333797 (+ 84539us) service_pool.cc:224] Handling call
0709 13:10:33.849963 (+1516166us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400930154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:33.850058 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386005888}
I20260709 13:10:33.749130 27229 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:33.851877 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2311) took 3059 ms. Trace:
I20260709 13:10:33.852082 22925 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:33.852244 23004 rpcz_store.cc:276] 0709 13:10:30.792301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.792424 (+   123us) service_pool.cc:224] Handling call
0709 13:10:32.532594 (+1740170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.551643 (+ 19049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.851637 (+1299994us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400097250. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:33.851784 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3981105920}
I20260709 13:10:33.853371 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.854527 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.853376 27229 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.859869 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:33.861963 27115 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:33.863350 27558 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:33.805830 27492 ts_tablet_manager.cc:1929] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.9
I20260709 13:10:33.865206 27492 log.cc:1199] T adf5adaae5184191bdaff064d051da2a P 216ff6323e434e399d196d8ba262c8f3: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/wals/adf5adaae5184191bdaff064d051da2a
I20260709 13:10:33.866799 27492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45790 (request call id 0) took 2195 ms. Trace:
W20260709 13:10:33.867527 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.870102 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 2046) took 1767 ms. Trace:
I20260709 13:10:33.870540 23006 rpcz_store.cc:276] 0709 13:10:32.102806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.192015 (+ 89209us) service_pool.cc:224] Handling call
0709 13:10:33.869882 (+1677867us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540030edd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:33.870040 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125892480}
I20260709 13:10:33.871585 27523 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.872133 23005 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:10:33.872553 27523 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.879997 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.880558 23006 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 6.
I20260709 13:10:33.881436 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.882339 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:33.882826 23006 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:33.873999 27459 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:33.891987 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:33.895049 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 54933us
I20260709 13:10:33.645748 27546 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.786486 27532 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.895579 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:33.896453 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:33.841157 27358 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.775400 27396 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:34.199458 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 303969us
I20260709 13:10:34.201395 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:34.184135 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:33.955066 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 196062us
I20260709 13:10:33.667616 27171 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.898577 27355 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:33.706594 27541 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:33.841324 27510 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:10:34.079787 27354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.028s	sys 0.036s
I20260709 13:10:34.076103 27459 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.023269 23072 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.050s	sys 0.094s
W20260709 13:10:34.238901 23072 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.052s	sys 0.103s
I20260709 13:10:34.183424 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:34.241375 23006 raft_consensus.cc:2393] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:33.867211 27492 rpcz_store.cc:276] 0709 13:10:31.710374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.724624 (+ 14250us) service_pool.cc:224] Handling call
0709 13:10:32.029176 (+304552us) ts_tablet_manager.cc:1151] Deleting tablet adf5adaae5184191bdaff064d051da2a
0709 13:10:32.029260 (+    84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:33.122644 (+1093384us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:33.788253 (+665609us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:33.866710 (+ 78457us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243420,"tablet-delete.queue_time_us":221377,"thread_start_us":164950,"threads_started":1}
W20260709 13:10:34.210433 27535 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.000s	sys 0.017s
I20260709 13:10:33.898717 27521 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:34.197757 23003 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:34.199188 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 445678us
W20260709 13:10:34.211529 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:34.210589 23620 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.015s	sys 0.003s
W20260709 13:10:34.137050 27381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.011s	sys 0.057s
W20260709 13:10:34.234704 22896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.032s	sys 0.055s
I20260709 13:10:34.230321 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:34.235004 22923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.003s	sys 0.025s
I20260709 13:10:34.243443 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 2052) took 1234 ms. Trace:
W20260709 13:10:34.194660 23654 consensus_meta.cc:287] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.011s
I20260709 13:10:34.203016 27358 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:34.295607 22896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.262s	user 0.032s	sys 0.056s
W20260709 13:10:34.298956 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 1.28175e+06us
I20260709 13:10:34.245730 23004 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:34.211855 27413 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:34.258659 27503 consensus_meta.cc:287] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 13:10:34.202219 27022 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:34.247339 27523 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.218158 27560 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:34.238690 27470 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:34.322242 27566 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:34.322023 27470 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:34.245487 27459 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.265522 27545 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:34.240124 27559 consensus_meta.cc:287] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.937s	user 0.007s	sys 0.006s
I20260709 13:10:34.268982 27541 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:34.242244 27354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.028s	sys 0.036s
I20260709 13:10:34.270381 27546 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:34.270963 27310 consensus_meta.cc:287] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.000s
W20260709 13:10:34.274029 27535 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.000s	sys 0.021s
I20260709 13:10:34.275517 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:34.277097 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.277837 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.333472 23076 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:34.334652 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.239219 27251 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:10:34.217919 27339 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.234555 27355 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:34.325623 27369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.009s	sys 0.026s
W20260709 13:10:34.281142 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.316287 27538 consensus_queue.cc:1059] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 13:10:34.294185 23620 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.015s	sys 0.003s
W20260709 13:10:34.342383 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 827190us
W20260709 13:10:34.342188 23079 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.004s
I20260709 13:10:34.343513 22971 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:34.295797 22923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.004s	sys 0.025s
W20260709 13:10:34.344178 23079 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.017s	sys 0.005s
I20260709 13:10:34.296255 23654 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:34.345901 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1234) took 1078 ms. Trace:
I20260709 13:10:34.346189 23654 rpcz_store.cc:276] 0709 13:10:33.267785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.393419 (+125634us) service_pool.cc:224] Handling call
0709 13:10:34.345848 (+952429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.297120 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:34.279626 27387 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:34.314200 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:34.314918 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:34.357860 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:34.295547 27381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.011s	sys 0.058s
I20260709 13:10:34.318881 23080 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
W20260709 13:10:34.323642 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 478200us
I20260709 13:10:34.279947 27505 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:34.331277 27541 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.304461 27413 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.335330 23076 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:34.365443 23648 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:10:34.366322 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.304734 27229 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:34.339592 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2324) took 2544 ms. Trace:
I20260709 13:10:34.372030 23001 rpcz_store.cc:276] 0709 13:10:31.795598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.795738 (+   140us) service_pool.cc:224] Handling call
0709 13:10:31.832088 (+ 36350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.115242 (+283154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.339386 (+2224144us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400097c54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:34.339540 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608443136}
I20260709 13:10:34.373449 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.374534 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.199293 27532 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.318245 27150 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:10:34.295921 23006 rpcz_store.cc:276] 0709 13:10:33.009055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.900239 (+891184us) service_pool.cc:224] Handling call
0709 13:10:34.243372 (+343133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.283100 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:34.349825 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.352922 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.354105 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:34.378604 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.355265 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.356418 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.367602 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:34.379254 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:34.379485 23649 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:34.360430 23657 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:34.380697 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:34.289309 27521 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.362630 23651 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:34.341492 27369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.009s	sys 0.027s
I20260709 13:10:34.405807 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.407238 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.408363 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:34.411315 22896 connection.cc:256] RPC call timeout handler was delayed by -1.3807575719999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:10:34.412123 22896 connection.cc:256] RPC call timeout handler was delayed by -1.1791575719998946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:10:34.370183 23652 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:34.336738 23003 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:34.341420 27355 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.378496 23650 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 8: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:34.381878 23655 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:34.431157 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.378161 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:34.432080 23006 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.329216 27559 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:34.433974 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:34.385434 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 102455us
I20260709 13:10:34.375540 27387 consensus_queue.cc:1243] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:34.386953 27544 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.419395 27538 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.390192 22999 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.393024 27330 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:34.361128 27354 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:34.396425 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:34.396857 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.398536 27533 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.377719 27022 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:34.369639 27560 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.399681 23620 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:34.401059 27459 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.375850 27413 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.403059 27534 raft_consensus.cc:3055] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:34.403689 27521 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:34.472807 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 73237.3us
I20260709 13:10:34.403059 27520 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:34.338245 27310 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.416247 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.417217 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.418915 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:34.341938 27339 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.382792 27150 consensus_queue.cc:1243] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:10:34.418460 27250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.022s
W20260709 13:10:34.424578 23077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.003s	sys 0.029s
W20260709 13:10:34.426132 23078 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.017s	sys 0.085s
I20260709 13:10:34.426079 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.376569 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:34.483670 23077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.003s	sys 0.029s
I20260709 13:10:34.484436 23001 raft_consensus.cc:2410] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:34.404515 27115 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:34.387930 27470 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:34.415171 27251 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.448632 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.460600 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.469215 22999 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:34.404433 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.473951 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:34.475934 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.428642 27546 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.428440 27402 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.483791 23078 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.017s	sys 0.085s
I20260709 13:10:34.438843 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:34.485042 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 66243.9us
I20260709 13:10:34.461010 27533 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.485265 23649 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:34.492596 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:34.493707 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.494297 23652 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:34.495231 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:34.497175 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:34.498257 23655 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.472185 27534 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:34.510901 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:34.511001 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:34.477671 27520 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:34.485908 27250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.008s	sys 0.023s
W20260709 13:10:34.515345 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 311864us
I20260709 13:10:34.542923 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:34.516242 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 314878us
I20260709 13:10:34.516498 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.544028 23001 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:34.545148 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.546522 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:34.547138 23001 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.477566 27193 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:34.547960 27193 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.548063 23621 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:34.548677 27193 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.530289 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.471391 27538 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:34.552016 27538 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:34.490777 27531 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:34.552754 27531 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.553258 27531 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:34.512348 27026 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:34.470415 27022 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:34.556188 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 45284us
I20260709 13:10:34.508315 27541 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:34.529690 27567 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.559823 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.508041 27474 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:34.540612 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 58211us
I20260709 13:10:34.515254 27115 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:34.508663 27251 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.569851 27251 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.566315 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:34.571785 22928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2630) took 1046 ms. Trace:
I20260709 13:10:34.572031 27548 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:34.572170 22928 rpcz_store.cc:276] 0709 13:10:33.534090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.534298 (+   208us) service_pool.cc:224] Handling call
0709 13:10:34.571579 (+1037281us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003c91d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.571729 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248005888}
I20260709 13:10:34.572571 27548 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.575117 27548 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:34.575158 22896 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.194:39749 timed out after 1.750s (SENT) [suppressed 8 similar messages]
I20260709 13:10:34.558995 27055 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.585494 27581 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:34.584657 27548 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.585866 27055 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.587560 27548 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.588492 27530 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:34.590272 27530 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:34.591152 27530 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:34.591487 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.591780 27310 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.592433 27530 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.592597 23080 raft_consensus.cc:2410] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:34.593604 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2330) took 2455 ms. Trace:
I20260709 13:10:34.593674 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.594048 23005 rpcz_store.cc:276] 0709 13:10:32.138581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.922514 (+783933us) service_pool.cc:224] Handling call
0709 13:10:33.871856 (+949342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:33.872570 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.593409 (+720839us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540030edd0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.593544 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2182066432}
I20260709 13:10:34.594517 23080 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:34.595254 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:34.595752 22997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 2042) took 2493 ms (client timeout 2926 ms). Trace:
W20260709 13:10:34.533763 22999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2322) took 2734 ms (client timeout 1750 ms). Trace:
W20260709 13:10:34.596261 22997 rpcz_store.cc:269] 0709 13:10:32.101882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.186615 (+ 84733us) service_pool.cc:224] Handling call
0709 13:10:34.595557 (+2408942us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54003aa054. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.595698 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554382720}
W20260709 13:10:34.596832 22999 rpcz_store.cc:269] 0709 13:10:31.779145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.788896 (+  9751us) service_pool.cc:224] Handling call
0709 13:10:32.202629 (+413733us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4c00134540. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f39232d6a20 00007f39232e7a29 00007f39232ad644 00007f39232d4f2d 00007f39232d4b93 00007f392500518b 00007f3925005cb5 00007f3925000f30 00007f39250027de 00007f392500e27c 00007f3929fcfb17
0709 13:10:34.389684 (+2187055us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b58003ffed0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3924f660aa 00007f3924fe8447 00007f3925000fe7 00007f39250027de 00007f392500e27c 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c
0709 13:10:34.513082 (+123398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205553408}
I20260709 13:10:34.532307 27546 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.598067 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.599225 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:34.599583 27568 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:10:34.588512 27559 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:34.589591 23002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 2053) took 1580 ms (client timeout 1882 ms). Trace:
W20260709 13:10:34.604689 23002 rpcz_store.cc:269] 0709 13:10:33.009618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.132992 (+123374us) service_pool.cc:224] Handling call
0709 13:10:34.589342 (+1456350us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54003e7e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.589518 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286720896}
I20260709 13:10:34.539671 27520 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.597504 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:34.563537 27570 log.cc:927] Time spent T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:34.530572 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.613955 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 2049) took 1606 ms. Trace:
I20260709 13:10:34.614382 23003 rpcz_store.cc:276] 0709 13:10:33.007849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.530340 (+1522491us) service_pool.cc:224] Handling call
0709 13:10:34.613878 (+ 83538us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:34.610145 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 115506us
I20260709 13:10:34.616065 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:34.622450 23001 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:34.508217 27402 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.606021 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.659142 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 988) took 2405 ms. Trace:
I20260709 13:10:34.659472 23002 rpcz_store.cc:276] 0709 13:10:32.253278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.658365 (+2405087us) service_pool.cc:224] Handling call
0709 13:10:34.658658 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.658844 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.658868 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.658908 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:34.658944 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.658999 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.659091 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.659984 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:34.660550 22930 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.608959 23653 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:34.631346 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 987) took 2379 ms. Trace:
I20260709 13:10:34.661417 23001 rpcz_store.cc:276] 0709 13:10:32.251495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.630521 (+2379026us) service_pool.cc:224] Handling call
0709 13:10:34.630880 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.631040 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.631083 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.631127 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:34.631157 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.631208 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.631299 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.602957 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.638731 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:34.600811 27567 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.639969 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.665124 23078 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:34.640319 27022 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:34.558521 27229 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:10:34.608366 27541 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.564421 27515 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:34.653475 27510 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:34.585086 27339 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.656347 27115 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.661814 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 1001) took 1094 ms. Trace:
W20260709 13:10:34.636926 27580 log.cc:927] Time spent T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:10:34.638083 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.668956 27022 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:34.663532 23005 raft_consensus.cc:2393] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:34.666137 23003 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:34.665630 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 840) took 2151 ms. Trace:
I20260709 13:10:34.666951 27503 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.670509 27515 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:34.669737 23002 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:34.687484 23074 rpcz_store.cc:276] 0709 13:10:32.514557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.515412 (+   855us) service_pool.cc:224] Handling call
0709 13:10:33.472017 (+956605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.542581 (+ 70564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.661094 (+1118513us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b540042d1d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.665556 (+  4462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133891840}
I20260709 13:10:34.666435 23006 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:34.674551 22930 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:34.679291 23004 rpcz_store.cc:276] 0709 13:10:33.567477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.854281 (+286804us) service_pool.cc:224] Handling call
0709 13:10:34.661670 (+807389us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54000c7bd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.661764 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898458368}
I20260709 13:10:34.683087 23001 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:34.692966 22972 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:34.693293 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2332) took 2413 ms. Trace:
W20260709 13:10:34.693419 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 396338us
W20260709 13:10:34.663311 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 47399.7us
I20260709 13:10:34.692579 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 986) took 2444 ms. Trace:
I20260709 13:10:34.695693 23003 rpcz_store.cc:276] 0709 13:10:32.248562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.632132 (+2383570us) service_pool.cc:224] Handling call
0709 13:10:34.665843 (+ 33711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.692293 (+ 26450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.692518 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:34.693336 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 335513us
I20260709 13:10:34.701355 23005 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:34.703146 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2054) took 1693 ms. Trace:
I20260709 13:10:34.703552 23006 rpcz_store.cc:276] 0709 13:10:33.010031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.702169 (+1692138us) service_pool.cc:224] Handling call
0709 13:10:34.702640 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.702838 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.702873 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.702936 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.702975 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.703020 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.703101 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.687590 23655 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:34.704815 23004 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:34.682458 27541 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:34.705535 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2055) took 1695 ms. Trace:
I20260709 13:10:34.710695 23006 raft_consensus.cc:1240] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:34.710551 23004 rpcz_store.cc:276] 0709 13:10:33.010344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.704299 (+1693955us) service_pool.cc:224] Handling call
0709 13:10:34.704627 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.705228 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.705472 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.708981 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2048) took 1702 ms. Trace:
W20260709 13:10:34.709825 23000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 994) took 1428 ms (client timeout 1725 ms). Trace:
W20260709 13:10:34.712438 23000 rpcz_store.cc:269] 0709 13:10:33.280980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.561528 (+280548us) service_pool.cc:224] Handling call
0709 13:10:34.709641 (+1148113us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400096d54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.709773 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642617216}
I20260709 13:10:34.713629 23005 rpcz_store.cc:276] 0709 13:10:33.006786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.700708 (+1693922us) service_pool.cc:224] Handling call
0709 13:10:34.701087 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.701917 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.708914 (+  6997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.714666 23074 raft_consensus.cc:1240] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:34.693724 23001 rpcz_store.cc:276] 0709 13:10:32.279939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.670555 (+2390616us) service_pool.cc:224] Handling call
0709 13:10:34.682787 (+ 12232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.693049 (+ 10262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.693232 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.715413 23005 raft_consensus.cc:1275] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:34.687968 27229 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.706059 27420 raft_consensus.cc:2764] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:34.764500 23002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 989) took 2507 ms. Trace:
I20260709 13:10:34.703307 27515 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.761363 27413 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.765035 23002 rpcz_store.cc:276] 0709 13:10:32.257459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.660512 (+2403053us) service_pool.cc:224] Handling call
0709 13:10:34.660806 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.700140 (+ 39334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.764201 (+ 64061us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b54002e36d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:34.764431 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19896192}
I20260709 13:10:34.710799 27022 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:34.738395 27363 raft_consensus.cc:2804] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:34.738253 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 992) took 1458 ms. Trace:
I20260709 13:10:34.767611 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1231) took 1512 ms. Trace:
I20260709 13:10:34.713018 27541 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:34.783849 27541 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:34.784219 22825 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 259) took 28157 ms (client timeout 15000 ms). Trace:
I20260709 13:10:34.787137 27545 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.774762 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:34.771410 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:34.777304 23656 rpcz_store.cc:276] 0709 13:10:33.265588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.552643 (+287055us) service_pool.cc:224] Handling call
0709 13:10:33.552915 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.248895 (+695980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.248925 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.248969 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:34.249005 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.767380 (+518375us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540044d9d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:34.767434 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.767563 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600116096}
I20260709 13:10:34.779450 27567 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.776971 27583 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:34.780108 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2056) took 1657 ms. Trace:
I20260709 13:10:34.790118 23006 rpcz_store.cc:276] 0709 13:10:33.122753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.704783 (+1582030us) service_pool.cc:224] Handling call
0709 13:10:34.710493 (+  5710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.711311 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.779911 (+ 68600us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5400096d50. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:34.780050 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12357376}
I20260709 13:10:34.780627 27363 raft_consensus.cc:697] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:34.781802 27408 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:34.791812 23045 leader_election.cc:400] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
W20260709 13:10:34.784581 22825 rpcz_store.cc:269] 0709 13:10:06.626539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.629354 (+  2815us) service_pool.cc:224] Handling call
0709 13:10:34.783737 (+28154383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:26.784989 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:26.785692 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:26.785747 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:10:26.785768 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:26.787029 (+  1261us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:26.787154 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:26.787189 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:10:26.817791 (+ 30602us) tablet.cc:701] Row locks acquired
0709 13:10:26.828271 (+ 10480us) write_op.cc:260] PREPARE: finished
0709 13:10:26.828438 (+   167us) write_op.cc:270] Start()
0709 13:10:26.828571 (+   133us) write_op.cc:276] Timestamp: P: 1783602626828371 usec, L: 0
0709 13:10:26.828605 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:10:26.867369 (+ 38764us) log.cc:844] Serialized 5516 byte log entry
0709 13:10:27.015175 (+147806us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:27.142452 (+127277us) op_driver.cc:464] REPLICATION: finished
0709 13:10:27.266915 (+124463us) write_op.cc:301] APPLY: starting
0709 13:10:27.267038 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:27.935642 (+668604us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:27.964854 (+ 29212us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:28.540083 (+575229us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:28.540551 (+   468us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:10:28.540596 (+    45us) write_op.cc:312] APPLY: finished
0709 13:10:28.540995 (+   399us) log.cc:844] Serialized 129 byte log entry
0709 13:10:28.820306 (+279311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.840027 (+ 19721us) write_op.cc:454] Released schema lock
0709 13:10:28.859979 (+ 19952us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:28.924508 (+ 64529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.928266 (+  3758us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1351735,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":117693,"apply.run_cpu_time_us":105722,"apply.run_wall_time_us":1645827,"cfile_cache_hit":54,"cfile_cache_hit_bytes":56592,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6223,"cfile_init":2,"lbm_read_time_us":58879,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":3,"lbm_reads_lt_1ms":8,"num_ops":14,"prepare.queue_time_us":81057,"prepare.run_cpu_time_us":9610,"prepare.run_wall_time_us":174710,"raft.queue_time_us":121946,"raft.run_cpu_time_us":18580,"raft.run_wall_time_us":59569,"replication_time_us":313654,"spinlock_wait_cycles":17066752,"thread_start_us":537191,"threads_started":5,"wal-append.queue_time_us":371043,"wal-append.run_cpu_time_us":29672,"wal-append.run_wall_time_us":2374456}]]}
I20260709 13:10:34.800737 23045 leader_election.cc:403] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.787484 27193 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.795902 22829 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 8, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 8 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.795540 23005 rpcz_store.cc:276] 0709 13:10:33.280375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.714679 (+1434304us) service_pool.cc:224] Handling call
0709 13:10:34.715027 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.737927 (+ 22900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.738179 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.801957 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:34.711874 27355 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.767907 27474 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.806367 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:34.824729 23074 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:34.806838 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:34.807358 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.826056 23005 raft_consensus.cc:2410] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:34.716607 27584 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:10:34.828147 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:34.830519 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:34.831677 27193 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:34.832338 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 997) took 1548 ms. Trace:
I20260709 13:10:34.832818 23005 rpcz_store.cc:276] 0709 13:10:33.283642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.831481 (+1547839us) service_pool.cc:224] Handling call
0709 13:10:34.831799 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.831981 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.832014 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.832064 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:34.832108 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.832173 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.832280 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.834789 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2058) took 1122 ms. Trace:
I20260709 13:10:34.710600 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet adf5adaae5184191bdaff064d051da2a (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:10:34.799574 27517 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:34.805258 27518 log.cc:927] Time spent T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 1.935s	user 0.007s	sys 0.000s
I20260709 13:10:34.836202 22829 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 7 to 10, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 10 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:34.665223 27534 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.769630 27229 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:34.845520 23654 raft_consensus.cc:2468] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:34.829200 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:34.819439 23003 raft_consensus.cc:1275] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:34.828334 27387 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.843364 27521 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.837100 27408 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.852212 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 995) took 1571 ms. Trace:
W20260709 13:10:34.853366 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 310545us
I20260709 13:10:34.845182 27512 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:34.854146 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 293096us
I20260709 13:10:34.804720 27483 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10.
I20260709 13:10:34.852545 22829 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 9 to 10, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:34.864359 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.835155 23005 rpcz_store.cc:276] 0709 13:10:33.712402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.833931 (+1121529us) service_pool.cc:224] Handling call
0709 13:10:34.834227 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.834412 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.834434 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.834475 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.834534 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.834600 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.834732 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.863400 22927 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
W20260709 13:10:34.866147 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 318158us
I20260709 13:10:34.866496 22927 pending_rounds.cc:85] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 10
I20260709 13:10:34.866801 22927 pending_rounds.cc:107] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:10:34.867026 22927 raft_consensus.cc:2889] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.867694 22927 pending_rounds.cc:107] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:10:34.867981 22927 raft_consensus.cc:2889] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.861574 23622 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:34.861045 23003 rpcz_store.cc:276] 0709 13:10:33.281246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.769754 (+1488508us) service_pool.cc:224] Handling call
0709 13:10:34.819044 (+ 49290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.850475 (+ 31431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.852147 (+  1672us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:34.839669 22815 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 132157us
I20260709 13:10:34.855338 27517 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:34.873992 22829 catalog_manager.cc:5697] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:34.870352 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 433412us
I20260709 13:10:34.867136 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2059) took 1154 ms. Trace:
W20260709 13:10:34.861272 27358 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.547s	user 0.003s	sys 0.007s
I20260709 13:10:34.858166 27487 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:34.877373 23005 rpcz_store.cc:276] 0709 13:10:33.712909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.866407 (+1153498us) service_pool.cc:224] Handling call
0709 13:10:34.866676 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.866830 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.866854 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.866893 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:34.866928 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.866977 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.867081 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.870626 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2060) took 1157 ms. Trace:
I20260709 13:10:34.912117 23003 rpcz_store.cc:276] 0709 13:10:33.713189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.869857 (+1156668us) service_pool.cc:224] Handling call
0709 13:10:34.870178 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.870336 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.870358 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.870398 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:34.870431 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.870482 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.870581 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.866987 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:34.863943 27534 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.884014 23656 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.916209 23005 raft_consensus.cc:1275] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:10:34.917790 23005 pending_rounds.cc:85] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 5
I20260709 13:10:34.918273 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:34.918963 23656 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:34.921538 23005 pending_rounds.cc:107] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 13:10:34.922920 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 347752us
I20260709 13:10:34.967324 23005 raft_consensus.cc:2889] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.974781 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2062) took 1222 ms. Trace:
I20260709 13:10:34.975246 23005 rpcz_store.cc:276] 0709 13:10:33.752390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.915376 (+1162986us) service_pool.cc:224] Handling call
0709 13:10:34.915764 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.974476 (+ 58712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.974712 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.983726 23005 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:34.993257 22896 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:34.994568 23005 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:34.996330 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 111722us
I20260709 13:10:34.996605 22896 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:34.873024 27512 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:34.999203 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:34.994949 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2061) took 1281 ms. Trace:
I20260709 13:10:35.003037 23003 rpcz_store.cc:276] 0709 13:10:33.752078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.930346 (+1178268us) service_pool.cc:224] Handling call
0709 13:10:34.994450 (+ 64104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.994632 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.994660 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.994698 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.994733 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.994783 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.994892 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.884816 27487 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.023310 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:35.000092 27150 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.009882 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:35.004371 27559 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:35.001405 27548 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:34.864189 27363 consensus_queue.cc:237] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.003896 27538 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:34.916874 27358 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:35.033006 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.033978 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 227682us
I20260709 13:10:35.037007 22829 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 6 to 9, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 9 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.007244 22895 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:35.022863 27532 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 13:10:35.021759 27487 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.803289 27583 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:34.875898 27022 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.001464 27209 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:10:34.836205 27474 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.044751 22999 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 12: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:35.004511 27535 consensus_queue.cc:1059] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:35.029726 27593 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.050556 23651 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:35.031985 27559 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.024701 27596 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:35.058652 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.071406 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:35.059515 27548 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:35.082046 22829 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 5 to 6, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 6 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:35.061184 27355 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:35.062094 27229 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.049054 27387 consensus_queue.cc:1059] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:10:35.047423 27251 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:35.062790 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2057) took 1797 ms. Trace:
I20260709 13:10:35.064198 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:35.102692 22927 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:35.065034 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:35.040141 27413 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:35.046198 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 273698us
W20260709 13:10:35.078998 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 217496us
I20260709 13:10:35.032841 27150 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.070791 27535 consensus_queue.cc:1243] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:35.049185 27517 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:35.121140 27589 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:10:35.122557 27150 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:35.122779 27585 log.cc:927] Time spent T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:10:35.101930 23004 rpcz_store.cc:276] 0709 13:10:33.265205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.718479 (+1453274us) service_pool.cc:224] Handling call
0709 13:10:34.718848 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:34.720749 (+  1901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.720792 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:34.738935 (+ 18143us) log.cc:844] Serialized 52 byte log entry
0709 13:10:35.009108 (+270173us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:35.009171 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.009273 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.062568 (+ 53295us) raft_consensus.cc:1685] finished
0709 13:10:35.062594 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.062727 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16393,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1879,"thread_start_us":229718,"threads_started":1,"wal-append.queue_time_us":293275}
I20260709 13:10:35.124251 23004 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:10:35.124876 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 858) took 1626 ms. Trace:
I20260709 13:10:35.048386 27532 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.125255 23072 rpcz_store.cc:276] 0709 13:10:33.498035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.498581 (+   546us) service_pool.cc:224] Handling call
0709 13:10:33.498875 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.499083 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:34.243170 (+744087us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.686848 (+443678us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.688118 (+  1270us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.688261 (+   143us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:34.758968 (+ 70707us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.759227 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.759331 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.124688 (+365357us) raft_consensus.cc:1685] finished
0709 13:10:35.124707 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.124822 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70419,"prepare.queue_time_us":857273,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":7114,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":23032,"thread_start_us":1160529,"threads_started":2,"wal-append.queue_time_us":597581}
I20260709 13:10:35.127295 27532 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:35.095256 27512 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:35.128989 27587 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:10:35.130793 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2420) took 1377 ms. Trace:
I20260709 13:10:35.131110 23071 rpcz_store.cc:276] 0709 13:10:33.753803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.830824 (+ 77021us) service_pool.cc:224] Handling call
0709 13:10:33.831127 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:34.247637 (+416510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.247710 (+    73us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:34.289392 (+ 41682us) log.cc:844] Serialized 52 byte log entry
0709 13:10:34.686461 (+397069us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.769063 (+ 82602us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.769317 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.769383 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.130593 (+361210us) raft_consensus.cc:1685] finished
0709 13:10:35.130615 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.130739 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":422725,"prepare.queue_time_us":76352,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":413778,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":23482,"spinlock_wait_cycles":8149376,"thread_start_us":363318,"threads_started":1,"wal-append.queue_time_us":565918}
I20260709 13:10:35.133054 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:35.134481 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:35.116917 27545 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.136135 27545 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.113938 27229 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:35.140733 27474 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:35.142117 27592 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:10:35.114321 27251 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:35.143337 27251 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.144435 23073 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 12: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:35.146608 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:35.045313 27597 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:10:35.082398 27559 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:35.143425 27594 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:10:35.086427 27595 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:35.151358 22971 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.127336 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:35.147338 23073 raft_consensus.cc:2376] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13. Re-sending same reply.
I20260709 13:10:35.094198 27598 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:35.161772 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.113628 27355 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:35.086542 27310 consensus_queue.cc:1048] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:10:35.117551 27558 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:35.159490 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 68473.9us
I20260709 13:10:35.156412 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:35.168710 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 301786us
I20260709 13:10:35.167078 22971 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:35.191335 22829 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.192195 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.156646 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 996) took 1875 ms. Trace:
I20260709 13:10:35.139590 27459 raft_consensus.cc:3055] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:35.085378 27593 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.159229 27115 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:35.204171 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.204650 23006 rpcz_store.cc:276] 0709 13:10:33.281499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.791005 (+1509506us) service_pool.cc:224] Handling call
0709 13:10:34.791258 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.791453 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:35.036414 (+244961us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.156334 (+119920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.156383 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:35.156431 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.156490 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.156589 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4234,"prepare.queue_time_us":376815,"raft.queue_time_us":9035,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":21976,"thread_start_us":337809,"threads_started":2}
W20260709 13:10:35.204386 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 133045us
I20260709 13:10:35.211532 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.217526 23652 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:35.217631 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.218365 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.159866 27521 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.159415 27595 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.219686 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.183987 27339 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.226307 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:35.166718 27026 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.216084 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:35.213270 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:35.194350 27355 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.231132 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.231845 23655 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:35.235471 23072 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:35.228334 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:35.200348 27330 consensus_meta.cc:287] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.004s
I20260709 13:10:35.198218 27358 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.166867 27171 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.203855 27408 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:35.239461 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:35.239625 27408 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.240026 23649 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.240216 27408 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.236258 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:35.222463 22971 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:35.239195 22998 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 8.
I20260709 13:10:35.246106 27472 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.246397 27358 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:35.246953 27358 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:35.246609 27472 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.247841 27358 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.248895 23649 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
W20260709 13:10:35.253840 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 206579us
I20260709 13:10:35.223248 27548 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.200737 27459 raft_consensus.cc:740] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:35.258663 23649 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:35.261258 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:35.215898 27560 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.264091 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:35.269093 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 77532.3us
I20260709 13:10:35.269838 23621 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:35.224565 27470 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:35.270208 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:35.274232 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:35.280000 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:35.280157 22929 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.272406 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:35.283962 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 66405.9us
I20260709 13:10:35.284179 22926 raft_consensus.cc:2368] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 12. Current term is 13.
I20260709 13:10:35.236733 27355 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.284683 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.295743 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:35.293659 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:35.236899 27521 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.228119 27595 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.291746 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:35.296942 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:35.270380 27503 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:10:35.311878 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:35.313477 22924 raft_consensus.cc:2368] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
I20260709 13:10:35.311203 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:35.314508 22931 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:35.314644 23622 leader_election.cc:400] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 12. Current term is 13.
I20260709 13:10:35.315107 23622 leader_election.cc:403] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.324239 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:35.324433 23075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2416) took 1592 ms. Trace:
I20260709 13:10:35.324774 23075 rpcz_store.cc:276] 0709 13:10:33.731975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.732083 (+   108us) service_pool.cc:224] Handling call
0709 13:10:33.732394 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:33.732745 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.732773 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:34.394307 (+661534us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b2c0009b2b8. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3923903a11 00007f3923913372 00007f3925045a01 00007f392500a43a 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2
0709 13:10:34.394798 (+   491us) log.cc:844] Serialized 52 byte log entry
0709 13:10:34.686601 (+291803us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:34.686634 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.686695 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.299875 (+613180us) raft_consensus.cc:1685] finished
0709 13:10:35.299897 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.324363 (+ 24466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":226643,"raft.queue_time_us":339,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":20885,"spinlock_wait_cycles":39848704,"thread_start_us":291425,"threads_started":1,"wal-append.queue_time_us":476438}
I20260709 13:10:35.267794 22829 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 6, now has a pending config: VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194), VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195), NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 6 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:10:35.236343 27530 consensus_queue.cc:1059] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:35.223613 27115 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.279858 27597 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.296484 27548 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.310604 27310 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.268661 27532 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:10:35.328934 27503 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.342785 22829 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 6, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 6 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.289944 22929 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:35.355897 23046 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:35.347159 27548 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:35.362676 27614 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:35.364306 27115 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:35.364727 27541 consensus_meta.cc:287] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 13:10:35.365150 27541 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.367137 27541 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:35.367949 27601 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:10:35.368346 27593 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.368527 27420 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:35.368885 27420 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:35.369067 27531 consensus_meta.cc:287] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.001s
I20260709 13:10:35.369246 27420 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.369519 27531 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.328462 27521 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.372593 23078 raft_consensus.cc:1240] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:35.355487 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 129267us
I20260709 13:10:35.375372 23077 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:35.378521 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:35.381500 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:35.382154 23006 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:35.371500 27531 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.429312 23003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2339) took 1117 ms. Trace:
I20260709 13:10:35.429888 23003 rpcz_store.cc:276] 0709 13:10:34.311583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.006364 (+694781us) service_pool.cc:224] Handling call
0709 13:10:35.007145 (+   781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.008939 (+  1794us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:35.168992 (+160053us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.428833 (+259841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.428908 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:35.428978 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.429083 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.429242 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215615,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":419180,"threads_started":2}
I20260709 13:10:35.430965 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:35.372689 27229 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.344596 27596 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
W20260709 13:10:35.434751 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 150118us
I20260709 13:10:35.441738 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:35.377761 27617 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.337073 27459 consensus_queue.cc:260] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.417084 27532 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.344525 27597 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.364324 27548 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.414522 27150 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:35.485976 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 171485us
I20260709 13:10:35.507117 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:35.457283 23653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1238) took 1063 ms. Trace:
I20260709 13:10:35.510432 23653 rpcz_store.cc:276] 0709 13:10:34.393570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.405522 (+ 11952us) service_pool.cc:224] Handling call
0709 13:10:35.457067 (+1051545us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400709ed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:35.457209 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465324800}
I20260709 13:10:35.442387 22829 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 8 to 9, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 9 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:35.448663 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:35.514434 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 65871.8us
I20260709 13:10:35.530464 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:35.483408 27604 log.cc:927] Time spent T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
W20260709 13:10:35.459020 27613 log.cc:927] Time spent T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:35.480496 27596 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:35.480057 27396 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.447618 27620 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 12. Current term is 13.
I20260709 13:10:35.441879 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:35.545966 22829 catalog_manager.cc:5697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.548640 23622 leader_election.cc:400] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
W20260709 13:10:35.469514 27533 consensus_meta.cc:287] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.936s	user 0.009s	sys 0.000s
I20260709 13:10:35.443121 27115 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:35.572417 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:35.459488 27615 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:10:35.513216 27625 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.481645 27521 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.461279 27381 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:35.513348 27530 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:35.576247 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 349417us
I20260709 13:10:35.613852 23656 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:35.607450 23622 leader_election.cc:403] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:10:35.908558 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 360018us
I20260709 13:10:35.529132 27548 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:35.571527 27515 consensus_meta.cc:287] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.783s	user 0.005s	sys 0.010s
W20260709 13:10:35.798502 27634 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:10:35.580611 27459 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.580857 27596 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:35.798851 27558 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:35.799356 27630 log.cc:927] Time spent T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:10:35.799526 27617 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:35.472203 27408 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.466713 27559 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.583444 27358 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:35.927875 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:35.928186 27358 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.928802 27408 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.929092 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:35.929998 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.930274 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:35.930954 23073 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:35.931692 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:35.624603 27533 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:35.802518 27487 consensus_meta.cc:287] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.751s	user 0.020s	sys 0.000s
I20260709 13:10:35.802372 27611 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.802964 27474 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.619166 27595 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:35.856073 27626 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
W20260709 13:10:35.868956 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 71113.5us
I20260709 13:10:35.632673 27402 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.618479 27115 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.946969 27115 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.529698 27251 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.584254 27150 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:10:35.614694 27396 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.618239 27633 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:35.618590 27632 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:35.870262 27520 consensus_meta.cc:287] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 1.214s	user 0.008s	sys 0.004s
I20260709 13:10:35.913918 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.958279 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.959285 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:35.871892 27534 consensus_meta.cc:287] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.900s	user 0.016s	sys 0.000s
I20260709 13:10:35.905752 27624 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:35.925279 27645 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:35.930176 27358 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.931915 27483 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:35.445466 27229 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.907275 27381 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:35.966042 27559 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.957816 27633 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:35.966763 27633 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.966663 27381 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.957337 27520 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.968235 27381 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.969491 27520 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:35.960273 27396 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:35.970628 27355 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.002s
I20260709 13:10:35.971029 27355 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.922225 27521 raft_consensus.cc:3060] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.944959 27474 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.946223 27595 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.933036 27617 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:35.955279 27652 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:35.960880 27567 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:35.956013 27251 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.956880 27533 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.921133 27515 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.920050 27530 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.921973 27548 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.956544 27632 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.906687 27625 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.963635 27645 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.964490 27624 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:35.967456 27420 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.001s
I20260709 13:10:35.976938 27652 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.982955 27420 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.984745 27652 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.963798 27483 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:35.987053 27483 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.988643 27483 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:35.989291 27606 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.989687 27606 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:35.990439 27606 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.991539 27606 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.992924 27474 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:35.994701 27624 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:35.945973 27596 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.995752 27596 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.996321 27597 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:35.998208 27545 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.000679 27546 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.001062 27645 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.001646 27558 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.980989 27548 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.980988 27632 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.004765 27607 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:36.005342 27607 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:36.006403 27607 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:35.974673 27617 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.981247 27567 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.008981 27515 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:36.009405 27567 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:35.938791 27487 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:35.994949 27530 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.013197 27487 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.014147 27633 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.014914 27521 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
I20260709 13:10:36.016212 27633 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:36.007215 27628 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:10:36.017417 27625 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:35.943205 27611 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:36.018049 27538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.020s	sys 0.050s
I20260709 13:10:35.797186 22829 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:36.133101 27538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.020s	sys 0.051s
I20260709 13:10:36.133651 23074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2431) took 1692 ms. Trace:
I20260709 13:10:36.135843 22922 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:35.632261 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.657086 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.143699 23006 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:35.909394 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:36.147249 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 237811us
I20260709 13:10:36.149087 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.150390 27490 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:36.151001 27490 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:36.133703 27538 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:36.151546 27490 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.153029 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2346) took 1821 ms. Trace:
I20260709 13:10:36.152851 27538 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.153584 22999 rpcz_store.cc:276] 0709 13:10:34.331631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.598960 (+267329us) service_pool.cc:224] Handling call
0709 13:10:36.152513 (+1553553us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000b9fd4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:36.152782 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020510592}
I20260709 13:10:36.154810 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:35.932399 23655 raft_consensus.cc:2376] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9. Re-sending same reply.
I20260709 13:10:36.157126 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:36.157261 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.158138 27590 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.158624 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.159030 27590 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.073822 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.162745 22923 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:36.076406 22929 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.076833 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2350) took 1502 ms. Trace:
I20260709 13:10:36.164295 23004 rpcz_store.cc:276] 0709 13:10:34.574561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.124983 (+550422us) service_pool.cc:224] Handling call
0709 13:10:35.125282 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.151181 (+ 25899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.151218 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.151635 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.576440 (+424805us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:35.576828 (+   388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.577238 (+   410us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.076141 (+498903us) raft_consensus.cc:1685] finished
0709 13:10:36.076182 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.076504 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25532,"raft.queue_time_us":30591,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7646,"thread_start_us":423236,"threads_started":1,"wal-append.queue_time_us":821714}
I20260709 13:10:36.150352 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.082230 23654 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:35.797765 22997 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 12. Current term is 13. Ops: [9.9-12.11]
W20260709 13:10:36.199251 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 49126.6us
I20260709 13:10:36.199677 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 985) took 3970 ms. Trace:
I20260709 13:10:36.200302 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.200192 22997 rpcz_store.cc:276] 0709 13:10:32.228701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.634091 (+2405390us) service_pool.cc:224] Handling call
0709 13:10:35.715783 (+1081692us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b5800085898. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee5a22 00007f392adfec09 00007f3929f58ee0 00007f392a0220ab 00007f392a022131 00007f3929fe3fc0 00007f3929fce929 00007f3929fce3d2 00007f3923545bd4
0709 13:10:35.797305 (+ 81522us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:36.198918 (+401613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.199389 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8743680}
I20260709 13:10:36.202088 27625 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.633925 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.205749 23073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 869) took 1099 ms. Trace:
I20260709 13:10:36.206172 23073 rpcz_store.cc:276] 0709 13:10:35.106398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.931563 (+825165us) service_pool.cc:224] Handling call
0709 13:10:35.931955 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.078453 (+146498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.078534 (+    81us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.078617 (+    83us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:36.078665 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.205307 (+126642us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400266454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:36.205362 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.205540 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335341952}
I20260709 13:10:35.850090 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2338) took 1541 ms. Trace:
I20260709 13:10:36.158569 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:36.203398 27625 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:35.971778 27396 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.208719 27625 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:35.952436 23650 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:36.021670 27611 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.075377 22925 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:36.020745 27607 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.210753 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1194) took 1153 ms. Trace:
I20260709 13:10:36.096596 23653 raft_consensus.cc:1240] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:10:36.096374 27420 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:36.104141 22998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52154 (request call id 2040) took 4297 ms (client timeout 2527 ms). Trace:
I20260709 13:10:36.120312 27546 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.216820 22998 rpcz_store.cc:269] 0709 13:10:31.806430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.009884 (+203454us) service_pool.cc:224] Handling call
0709 13:10:36.103505 (+4093621us) spinlock_profiling.cc:243] Waited 3.17 s on lock 0x7b5400098154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:36.103818 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7291820800}
I20260709 13:10:36.217224 27546 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.217713 27625 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.095209 27355 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:36.015414 27472 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.167315 22923 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.077742 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49890 (request call id 2650) took 1314 ms. Trace:
I20260709 13:10:36.203297 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.162565 27590 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.176723 27055 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.135368 22829 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 4 to 7, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 7 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.182996 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1189) took 1149 ms. Trace:
I20260709 13:10:36.186334 27583 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.187611 27251 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:36.187749 27656 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:36.189527 27652 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.189900 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.151260 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.192575 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.181159 23078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2430) took 1907 ms. Trace:
I20260709 13:10:36.220472 22927 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:10:36.195945 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 50468.3us
I20260709 13:10:36.208870 23655 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:36.097570 23080 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.221187 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 982) took 1011 ms. Trace:
I20260709 13:10:36.211107 23650 rpcz_store.cc:276] 0709 13:10:35.057364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.069938 (+ 12574us) service_pool.cc:224] Handling call
0709 13:10:35.070198 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.209527 (+1139329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.210366 (+   839us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b5400554454. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:36.210568 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2028379904}
I20260709 13:10:36.222256 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.222400 22930 rpcz_store.cc:276] 0709 13:10:34.763394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.763579 (+   185us) service_pool.cc:224] Handling call
0709 13:10:34.763935 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.764223 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.764262 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.764740 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.066290 (+301550us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:35.066348 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.066442 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.077087 (+1010645us) raft_consensus.cc:1685] finished
0709 13:10:36.077130 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.077460 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":277245,"threads_started":1,"wal-append.queue_time_us":337745}
I20260709 13:10:36.219515 23648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1190) took 1178 ms. Trace:
I20260709 13:10:36.221495 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:36.238914 27229 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.220033 27546 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.240290 23077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34268 (request call id 2487) took 1947 ms. Trace:
I20260709 13:10:36.234045 23656 rpcz_store.cc:276] 0709 13:10:35.033444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.033589 (+   145us) service_pool.cc:224] Handling call
0709 13:10:35.033957 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.908202 (+874245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.182334 (+274132us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54006a22d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:36.182770 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333126400}
I20260709 13:10:36.134218 23074 rpcz_store.cc:276] 0709 13:10:34.441317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.828252 (+386935us) service_pool.cc:224] Handling call
0709 13:10:34.836070 (+  7818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.856457 (+ 20387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.856488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.858585 (+  2097us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.048861 (+190276us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:35.078183 (+ 29322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.132626 (+1054443us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5400034154. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:36.132725 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.132837 (+   112us) raft_consensus.cc:1685] finished
0709 13:10:36.132859 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.133331 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3512,"raft.queue_time_us":4194,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":5771,"spinlock_wait_cycles":38018944,"thread_start_us":189963,"threads_started":1,"wal-append.queue_time_us":269459}
I20260709 13:10:36.250316 23077 rpcz_store.cc:276] 0709 13:10:34.292899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.604668 (+311769us) service_pool.cc:224] Handling call
0709 13:10:36.239801 (+1635133us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400294854. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:36.240079 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630938880}
I20260709 13:10:36.241519 23078 rpcz_store.cc:276] 0709 13:10:34.273636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.670935 (+397299us) service_pool.cc:224] Handling call
0709 13:10:34.671186 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.373167 (+701981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.180493 (+807326us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400277254. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:36.180925 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612539648}
I20260709 13:10:36.221527 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.226114 27413 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:36.207974 23005 rpcz_store.cc:276] 0709 13:10:34.309139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.997415 (+688276us) service_pool.cc:224] Handling call
0709 13:10:34.997673 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.021124 (+ 23451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.021156 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.024616 (+  3460us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.185640 (+161024us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:35.185691 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.185780 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.849876 (+664096us) raft_consensus.cc:1685] finished
0709 13:10:35.849895 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.850032 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23059,"raft.queue_time_us":23165,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10531,"thread_start_us":135239,"threads_started":1,"wal-append.queue_time_us":229318}
I20260709 13:10:36.266988 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:36.268144 27583 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.269279 27250 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:36.269553 27251 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.270334 23655 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.270754 27656 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.272234 27251 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.273315 27656 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.274369 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:36.271327 22926 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:36.224519 27115 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.244783 23648 rpcz_store.cc:276] 0709 13:10:35.040726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.040877 (+   151us) service_pool.cc:224] Handling call
0709 13:10:35.041214 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.041465 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:35.232259 (+190794us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.218257 (+985998us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b18003caf60. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3921f1fa40 00007f3921f1a4e4 00007f3921f1a455 00007f3928a023c7 00007f39250149a7 00007f39250240bf 00007f3925024038
0709 13:10:36.218572 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.218921 (+   349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.219027 (+   106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:36.219140 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.219211 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.219363 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":800086,"prepare.queue_time_us":1127091,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":83,"raft.queue_time_us":28976,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":5032,"spinlock_wait_cycles":7325952,"thread_start_us":367827,"threads_started":2,"wal-append.queue_time_us":254459}
I20260709 13:10:36.283032 27115 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.284050 23072 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:36.276428 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.285195 23650 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:36.285223 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.285840 23073 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:10:36.287189 27193 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:36.287618 27193 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:36.289074 27193 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.290638 27193 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.293486 27378 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.294359 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.295240 23074 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:36.295892 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.244370 23651 rpcz_store.cc:276] 0709 13:10:35.209235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.210092 (+   857us) service_pool.cc:224] Handling call
0709 13:10:35.210447 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.210689 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:35.432317 (+221628us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.220157 (+787840us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.220532 (+   375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.220597 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:36.220683 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.220788 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.220970 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353989,"prepare.queue_time_us":1369734,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":266908,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"thread_start_us":622759,"threads_started":3,"wal-append.queue_time_us":493338}
I20260709 13:10:36.296288 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.262487 27413 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:36.297243 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.297973 27413 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.298872 23651 raft_consensus.cc:1240] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:36.299213 27413 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.295439 23076 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:36.300230 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.300596 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.300853 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.301412 23076 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:36.301812 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.268195 27652 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.280483 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.294137 27378 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.298509 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.302039 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:36.304680 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 101530us
I20260709 13:10:36.313323 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34268 (request call id 2486) took 2020 ms. Trace:
I20260709 13:10:36.313112 23078 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:36.302208 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.300246 23648 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:36.309799 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.302551 23079 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 5.
I20260709 13:10:36.319281 23655 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:36.305879 27310 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:36.320909 23077 raft_consensus.cc:2410] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:36.321102 27310 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.323257 27397 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.317934 23080 rpcz_store.cc:276] 0709 13:10:34.292579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.777180 (+484601us) service_pool.cc:224] Handling call
0709 13:10:34.780536 (+  3356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.262923 (+1482387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.313013 (+ 50090us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000898d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:36.313250 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3000270080}
I20260709 13:10:36.325453 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.334936 27546 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.335192 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:36.307885 27505 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:36.337222 27505 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.340219 27488 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:36.304144 27490 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.341706 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.342612 27652 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.344764 27625 consensus_queue.cc:1048] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:36.348675 27472 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.349432 27472 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.351971 22923 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:36.353605 23653 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:36.354168 27229 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:36.354812 27229 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.356355 27633 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:36.357106 27229 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.357055 27633 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.357758 27229 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:36.358510 27229 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.358844 27472 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.360407 22924 raft_consensus.cc:1240] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.360219 22829 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 10 to 12, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.362413 22829 catalog_manager.cc:5697] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 3 to 4, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:36.351420 27583 consensus_queue.cc:1048] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:10:36.365273 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.366340 22922 raft_consensus.cc:2410] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:36.365944 27490 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.367642 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:36.368356 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 197132us
I20260709 13:10:36.380172 27310 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:36.359419 27633 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.383518 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:36.394402 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 173296us
I20260709 13:10:36.312793 27617 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.402979 23074 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:36.401813 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:36.418043 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.412784 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.428045 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.428586 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.428702 22896 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.429244 23000 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:36.429345 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:36.429639 27538 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:36.430251 23653 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 14: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:36.425706 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.427232 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.434032 23652 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:36.423352 22970 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.426066 22922 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:36.430246 27538 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:36.440114 27538 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.440543 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.441367 22997 raft_consensus.cc:2393] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 16: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:36.443344 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.443913 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.444154 22931 raft_consensus.cc:2393] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:36.444299 22930 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:36.445129 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.446755 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.447184 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.447428 23653 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:36.448043 22924 raft_consensus.cc:2410] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:36.447847 27472 consensus_queue.cc:1059] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:36.448292 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.448979 23653 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:36.449048 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.449694 27472 raft_consensus.cc:3055] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:36.450346 27472 raft_consensus.cc:740] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:36.450379 23653 raft_consensus.cc:1275] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:36.449767 22927 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:36.451738 27229 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.436870 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:36.454279 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 199562us
I20260709 13:10:36.454587 27590 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.430581 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.457149 27487 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:36.458961 27545 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:36.459331 27545 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:36.460218 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:36.460453 27545 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.461061 23656 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:36.461812 27545 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.464290 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.450755 27541 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.469130 27055 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:36.469198 27541 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.470754 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.471705 27310 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:36.472436 27310 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.451434 27472 consensus_queue.cc:260] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.474490 27472 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.474649 27310 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.467326 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.477672 27055 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.480574 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.481501 27358 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:36.483003 27358 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:36.437651 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:36.492357 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 225803us
I20260709 13:10:36.492493 27229 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:36.493042 27229 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.493430 27229 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.495163 27534 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.495843 27534 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.498114 27534 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.497680 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.499116 27055 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:36.502450 22972 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:36.504384 27381 consensus_meta.cc:287] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.020s
I20260709 13:10:36.506572 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.507830 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.508443 23005 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:36.508472 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.509969 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:36.510327 27055 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.511842 22896 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.512656 27251 raft_consensus.cc:2764] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:36.512951 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.513625 23003 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.514292 27251 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:36.514535 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:36.515733 27658 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.277s	user 0.003s	sys 0.002s
I20260709 13:10:36.510337 27541 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.516850 27546 raft_consensus.cc:1064] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: attempting to promote NON_VOTER 01988c2c817947859340a730b7f1247d to VOTER
I20260709 13:10:36.515558 27459 consensus_queue.cc:1059] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:36.517719 27635 raft_consensus.cc:3055] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:36.518075 27635 raft_consensus.cc:740] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:36.519042 27635 consensus_queue.cc:260] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.520417 27635 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.524780 27310 consensus_queue.cc:1059] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:36.525350 27607 consensus_queue.cc:1059] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:36.526140 27115 raft_consensus.cc:3055] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:36.526616 27115 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:36.527936 27290 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:36.527730 27115 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.528384 27290 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:36.528877 27115 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.529475 27290 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.530894 27290 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.531852 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.532671 23005 raft_consensus.cc:2410] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:10:36.533825 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.534337 27505 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.534632 23005 raft_consensus.cc:2393] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 14: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:36.536458 27378 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:36.536751 22972 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:36.501120 22970 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:36.550246 23000 raft_consensus.cc:2468] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 7.
I20260709 13:10:36.557111 23003 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
W20260709 13:10:36.559326 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 58429.6us
W20260709 13:10:36.561856 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 47439.9us
I20260709 13:10:36.558094 27055 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.556139 27487 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 13:10:36.565436 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.558250 27250 consensus_queue.cc:1059] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:10:36.566272 27358 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:36.566533 27250 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:36.566735 27358 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:36.567081 27250 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:36.567281 27358 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.549603 27541 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:36.568305 27541 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.571503 27541 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.578490 27652 consensus_queue.cc:1059] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:36.579578 27652 raft_consensus.cc:3055] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:36.580158 27652 raft_consensus.cc:740] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:36.539424 27546 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.581264 27652 consensus_queue.cc:260] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.582581 23651 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:10:36.582975 23651 pending_rounds.cc:85] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 9
I20260709 13:10:36.582844 27652 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.583371 23651 pending_rounds.cc:107] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:36.583748 23651 raft_consensus.cc:2889] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:36.584081 23651 pending_rounds.cc:107] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:36.584297 23651 raft_consensus.cc:2889] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:36.565318 27055 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.585983 27055 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.589893 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.567385 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:36.598023 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.596837 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.604342 22971 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:36.605476 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.605816 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:36.606983 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.607899 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.608242 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:36.608579 22929 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 8.
I20260709 13:10:36.609436 27229 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.609969 22931 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:36.610339 27472 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.608045 27545 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:36.607280 22971 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:36.591442 27534 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:36.600587 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:36.619573 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.615203 22999 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:10:36.618361 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.632620 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.608237 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:36.638307 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:36.640816 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:36.642565 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.642976 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.646935 27550 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.647043 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 46561.8us
I20260709 13:10:36.611701 27381 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:36.648172 22924 raft_consensus.cc:1240] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:36.611635 27229 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:36.607872 27590 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:36.650332 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:36.654806 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.607853 27617 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.649798 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.620545 27534 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:36.636804 27633 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:36.655077 27520 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:36.659246 23650 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:36.655683 27546 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:36.669332 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.672394 22999 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.665726 27534 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.647493 27550 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.695007 27550 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:36.687769 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.690164 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:36.699750 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.699677 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.699923 27530 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:36.700433 27530 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.700794 27530 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.701601 23071 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.703060 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.704005 23076 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:36.704425 23621 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:36.705442 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 66713.6us
I20260709 13:10:36.706274 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:36.706523 27550 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:36.707582 27618 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.705098 27520 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:36.708003 27597 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:36.710660 23657 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:36.711401 27545 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.711792 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.712649 23006 raft_consensus.cc:2376] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9. Re-sending same reply.
I20260709 13:10:36.713287 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.713518 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.714524 27610 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.715132 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.715037 27610 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.674968 27310 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:10:36.716382 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.716799 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.717721 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.718735 27610 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:36.719177 27386 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:36.718654 27055 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.719192 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.719681 27386 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:36.720175 23657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47800 (request call id 1241) took 2325 ms (client timeout 1918 ms). Trace:
W20260709 13:10:36.720575 23657 rpcz_store.cc:269] 0709 13:10:34.394405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.415947 (+ 21542us) service_pool.cc:224] Handling call
0709 13:10:36.719958 (+2304011us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54004deed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:36.720078 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5134135040}
I20260709 13:10:36.720690 27386 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.722219 27386 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.718770 23077 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:36.725399 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:36.727751 27378 consensus_queue.cc:1175] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "01988c2c817947859340a730b7f1247d" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:36.729386 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.729950 22924 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:36.743350 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.736589 22930 raft_consensus.cc:2410] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:10:36.731776 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 55812us
I20260709 13:10:36.755021 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.718605 27633 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:36.755997 27633 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.756557 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.757658 23006 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:36.758769 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.760053 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:36.764138 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:36.772151 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.788857 22999 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:36.756637 27546 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:36.728964 27055 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.792043 22924 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:36.716418 27310 raft_consensus.cc:3055] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:36.684621 27250 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.806933 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.807695 23077 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:36.808327 27530 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.809664 23075 raft_consensus.cc:2368] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13.
I20260709 13:10:36.810339 27530 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:36.819631 22927 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:36.798062 27310 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:36.773214 27358 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:36.815757 27193 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.822642 27541 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:36.836686 27250 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.836812 27541 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.839980 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:36.845278 23000 raft_consensus.cc:1240] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:36.847124 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 139448us
I20260709 13:10:36.839455 27541 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:36.859329 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.851339 27652 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.916422 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.916632 27633 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.918918 27633 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:36.833902 27546 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:36.941478 23003 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:36.948568 23075 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:36.893287 23006 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:36.920539 27652 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:36.957906 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 99129.3us
I20260709 13:10:36.964231 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:36.966143 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:36.970376 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:36.971094 23075 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.936499 27310 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:36.985112 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 280896us
I20260709 13:10:36.988885 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:37.004534 23077 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.993358 27358 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:37.007489 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.015297 23072 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:37.018795 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:37.019778 23000 raft_consensus.cc:2393] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 9: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:37.021852 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.025653 27550 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:37.003338 27193 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.033074 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.036347 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:37.036994 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 70959.7us
I20260709 13:10:37.037672 23621 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:37.038646 23075 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
W20260709 13:10:37.038323 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 431137us
I20260709 13:10:37.003211 27590 raft_consensus.cc:697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:37.058212 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:37.074198 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 404804us
I20260709 13:10:37.077857 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:37.060369 27530 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:37.061954 27550 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.072541 27310 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:37.067543 23076 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:37.095760 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:37.101455 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.112254 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:37.086629 27550 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.098609 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:37.124850 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:37.125922 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.126533 23075 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:37.128823 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:37.129446 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:37.132246 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.132918 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.134138 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.091867 27381 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:37.138298 23077 raft_consensus.cc:2410] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:37.139815 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.099722 27290 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:10:37.146837 23657 raft_consensus.cc:1240] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:37.147007 23653 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 LEARNER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:37.148299 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:37.148309 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:37.149232 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:37.152472 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.152962 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:37.099349 27652 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:37.123353 27550 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.153730 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:37.156713 23655 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:37.155186 23656 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:37.151108 23001 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:37.155891 23653 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.154592 22971 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:37.157518 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.158145 23004 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:37.158895 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:37.162669 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.164700 23075 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:37.166769 23006 raft_consensus.cc:2393] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 6: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:37.167249 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.168126 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.169466 23004 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:37.168725 23000 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:37.171501 22929 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:37.171769 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:37.175827 27673 log.cc:927] Time spent T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:10:37.176311 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.179883 22930 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
W20260709 13:10:37.173256 27672 log.cc:927] Time spent T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:10:37.160735 27193 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.204975 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.156970 27633 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:37.174710 27545 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.163069 27530 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:37.185456 27541 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:37.231871 27669 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:10:37.235340 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.236552 22928 raft_consensus.cc:2410] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:37.237815 27530 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:37.238315 27530 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:37.262696 27381 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:37.268252 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 177086us
I20260709 13:10:37.273914 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.276273 27193 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.288666 27193 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:37.289321 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:37.289959 23649 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:37.207945 27397 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:10:37.226621 27229 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
W20260709 13:10:37.294610 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 150493us
I20260709 13:10:37.294862 23080 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
W20260709 13:10:37.295187 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.239379 27530 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.314924 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:37.306401 27674 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:10:37.318200 23653 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:37.316673 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:37.318683 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 44944.9us
I20260709 13:10:37.321750 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.323359 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:37.326545 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.311889 27193 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.335739 23006 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:37.336906 27541 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.337116 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:37.337414 23079 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:37.337709 23074 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.338577 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.338999 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:37.339514 22924 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.339876 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:37.340179 27545 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.344696 23621 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:37.345752 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.347014 22929 raft_consensus.cc:1240] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:37.348873 27678 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:37.349028 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.349620 27683 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.349437 27678 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:37.350122 27683 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.353717 23002 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:37.356467 23074 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:37.361507 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.362072 23079 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
W20260709 13:10:37.366916 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 195622us
I20260709 13:10:37.367921 23078 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.368345 23074 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:10:37.373533 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 58708.6us
I20260709 13:10:37.374544 23078 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:37.374317 22971 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:37.375212 27386 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.375563 27487 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.375684 27386 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.377154 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.377938 27487 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:37.379750 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:37.380328 27534 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.000s
I20260709 13:10:37.380637 27487 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.381474 27487 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.381762 27683 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.382073 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.382650 27534 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.381819 27487 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.383379 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:37.373070 22970 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.390910 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.391973 27534 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.392408 22926 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:37.386143 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.358083 27681 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:37.401747 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 57157.1us
W20260709 13:10:37.410553 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.410396 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.411310 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.401604 22924 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
W20260709 13:10:37.412454 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.412814 27541 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:37.411300 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:37.413709 27541 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.416996 27541 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:37.302002 27590 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.372309 27397 raft_consensus.cc:2804] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:37.423334 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 56179us
W20260709 13:10:37.429863 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 125850us
I20260709 13:10:37.379767 27678 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:37.430833 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44779us
I20260709 13:10:37.432791 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.383181 27358 consensus_queue.cc:1048] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:10:37.374315 27505 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:10:37.435464 27691 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:37.435783 27397 raft_consensus.cc:697] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:37.393498 27692 consensus_queue.cc:1059] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:37.383612 27686 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.435848 27358 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:37.426029 27676 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.436867 27686 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:37.436923 27397 consensus_queue.cc:237] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.448029 27358 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:37.449573 22895 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.384068 27679 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:10:37.452891 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 85248.7us
I20260709 13:10:37.429366 27459 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.450892 27686 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:37.463289 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 79988.9us
I20260709 13:10:37.472395 22971 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.462307 27681 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:37.544235 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 73583.2us
W20260709 13:10:37.519805 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 146785us
I20260709 13:10:37.553601 22895 leader_election.cc:400] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13.
I20260709 13:10:37.553968 22895 leader_election.cc:403] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:37.554518 22970 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:37.555788 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 88049.4us
I20260709 13:10:37.470556 27229 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.454324 27358 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } }
W20260709 13:10:37.565037 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 95995.9us
I20260709 13:10:37.567953 27676 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:37.568693 23046 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.568572 27676 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:37.578701 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.544546 27681 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:37.588356 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 124390us
I20260709 13:10:37.587409 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.595948 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.600458 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.602582 23079 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:37.553848 27250 consensus_queue.cc:1059] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:10:37.605598 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.575762 27633 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13.
I20260709 13:10:37.577311 27676 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:37.613575 27645 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:37.615803 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.593215 27681 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:37.635905 27229 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:37.636410 27229 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.639389 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.642020 27676 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.642527 27676 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:37.615798 27396 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:37.615948 27704 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:37.575858 27683 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:10:37.590318 27534 consensus_queue.cc:1059] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:37.606878 27690 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.644934 27676 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:37.648307 27677 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.478s	user 0.007s	sys 0.004s
I20260709 13:10:37.648604 27459 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:37.649245 27459 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:37.649564 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.650040 27459 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:37.651075 22998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 1019) took 1062 ms. Trace:
I20260709 13:10:37.647137 27676 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:37.627225 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:37.620322 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.602101 27656 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:37.640851 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.624884 27358 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:37.626299 23650 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:37.626482 23649 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 13. Current term is 14. Ops: [8.9-13.11]
I20260709 13:10:37.628105 27250 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:37.629801 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:37.617113 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.671130 27676 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.677311 27617 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:37.677698 27617 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:37.678540 27617 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:37.679327 27310 consensus_meta.cc:287] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.005s
I20260709 13:10:37.675854 27250 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:37.684031 27193 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:37.684087 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 48526.6us
I20260709 13:10:37.686033 27681 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.688908 27534 consensus_queue.cc:1243] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:37.688778 27250 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:37.693094 27487 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.694301 27598 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:37.698102 23620 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.702337 27617 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:37.702620 27550 consensus_meta.cc:287] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.536s	user 0.004s	sys 0.002s
I20260709 13:10:37.645509 27704 raft_consensus.cc:697] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:37.713290 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:37.717422 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.617769 27386 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:37.720559 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 151972us
I20260709 13:10:37.651572 22998 rpcz_store.cc:276] 0709 13:10:36.588584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.588685 (+   101us) service_pool.cc:224] Handling call
0709 13:10:36.589040 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:36.589469 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.589496 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:36.590033 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:10:37.011638 (+421605us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:37.011720 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.011779 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.647749 (+635970us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:37.650721 (+  2972us) raft_consensus.cc:1685] finished
0709 13:10:37.650751 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.651009 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11575,"raft.queue_time_us":3487,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":22304,"spinlock_wait_cycles":5239168,"thread_start_us":421248,"threads_started":1,"wal-append.queue_time_us":508985}
W20260709 13:10:37.723577 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 106559us
I20260709 13:10:37.718519 27676 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.732751 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:37.721975 27546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.037s	sys 0.044s
I20260709 13:10:37.733605 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.730430 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.739405 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.736064 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:37.734741 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 114482us
W20260709 13:10:37.741508 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 185070us
I20260709 13:10:37.742378 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.742841 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.744283 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.746843 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.748718 22930 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:37.743428 22927 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:37.734050 27534 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.729653 27656 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:37.730677 27652 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:37.736601 27610 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:37.735163 27633 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:37.753271 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:37.742117 27546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.037s	sys 0.045s
I20260709 13:10:37.739908 27598 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.781183 27598 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.768389 27193 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:37.782821 27193 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.783329 27193 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.769652 27545 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.771050 27487 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.749754 27541 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.772756 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:37.768743 27684 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.788297 27684 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.789765 23079 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:37.791939 27684 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.735869 27472 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:37.755779 27534 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.730875 27229 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.757092 27378 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:10:37.814822 27633 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:37.766928 27610 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:37.730257 27550 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.816421 27610 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.817612 27610 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.818881 27550 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:37.750070 27538 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:37.819881 27538 consensus_queue.cc:1243] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer b655449a388a41e3a606c6ea794825ad log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:37.820544 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:37.821333 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 54419us
I20260709 13:10:37.822198 27686 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.823143 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.824013 23655 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:37.819473 27550 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.802099 27530 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:37.847157 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 108612us
I20260709 13:10:37.824627 27534 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.815320 27656 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:37.840844 27693 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.534s	user 0.000s	sys 0.008s
I20260709 13:10:37.842815 27704 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.844645 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.813493 27652 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.845958 27681 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.849380 22895 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:10:37.850497 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 152469us
I20260709 13:10:37.846311 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2355) took 1235 ms. Trace:
I20260709 13:10:37.834626 27193 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.833067 27538 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.861655 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.886734 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:37.887449 22972 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.859459 27702 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:37.870255 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49831.1us
W20260709 13:10:37.887797 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 49972.2us
I20260709 13:10:37.889681 27683 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:37.890264 27683 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.891098 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.891616 27590 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.891969 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:37.892349 27683 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.893658 27193 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:37.894001 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.870064 27645 raft_consensus.cc:3055] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:37.899972 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:37.853976 27397 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:37.877638 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.877460 23005 rpcz_store.cc:276] 0709 13:10:36.611305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.620363 (+  9058us) service_pool.cc:224] Handling call
0709 13:10:37.846130 (+1225767us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003534d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:37.846257 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686216448}
I20260709 13:10:37.885812 27684 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.897485 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.858109 27692 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.900548 23076 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.900908 22928 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:37.901566 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 56991.8us
I20260709 13:10:37.910293 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:37.909291 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:37.912637 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:37.912938 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:37.910239 23078 pending_rounds.cc:85] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 7
I20260709 13:10:37.914935 23078 pending_rounds.cc:107] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 13.8
W20260709 13:10:37.909368 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 129277us
I20260709 13:10:37.915213 23078 raft_consensus.cc:2889] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:37.918141 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:37.900842 27546 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:37.847515 27550 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:37.894268 27229 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.908322 27381 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:37.900321 27645 raft_consensus.cc:740] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:37.908020 27378 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.941179 22896 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:37.942056 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.909812 27590 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:37.913221 27545 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:37.966866 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:37.978076 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 64234.9us
I20260709 13:10:37.984597 23076 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:37.995808 22895 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:37.940595 27487 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.963028 27710 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.940768 27381 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:37.999684 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 87111.7us
I20260709 13:10:38.005288 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:38.000259 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 59855us
W20260709 13:10:38.003588 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 87945.4us
I20260709 13:10:37.981851 27610 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:37.915127 27397 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:37.998217 27674 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:37.999583 27692 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:37.986701 27652 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:37.939194 27684 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.016214 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.018005 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:38.016827 27712 log.cc:927] Time spent T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:10:37.999737 27229 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:37.984195 27590 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.009137 27381 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:38.068787 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 50848.7us
I20260709 13:10:37.973296 27546 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:38.078868 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 73660.5us
I20260709 13:10:38.011924 27610 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.998701 27676 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:10:38.069849 27378 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.023218 27686 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.019176 23079 raft_consensus.cc:2393] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 13: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:38.096808 27719 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:38.096736 27538 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:38.097811 27684 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.072355 27692 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:38.099303 27692 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:38.073541 27459 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:38.102833 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.097489 27719 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.026690 27656 consensus_queue.cc:1059] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:10:38.109138 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:38.112282 27733 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:38.112802 27733 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.113559 27550 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.068290 27645 consensus_queue.cc:260] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.078419 27229 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:38.114916 27733 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.115764 27684 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:38.116993 27718 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:38.117113 27656 raft_consensus.cc:3055] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:38.117583 27656 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:38.118100 27706 raft_consensus.cc:3055] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:38.118463 27706 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:38.118394 27656 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:38.119372 27706 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.115568 27229 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.085249 27610 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.131422 27550 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:38.132340 27733 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:38.134090 27730 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.136956 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:38.120743 27706 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.141597 22999 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:38.140584 27546 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.138949 27520 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.146044 27520 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.137959 27684 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:38.154726 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 51356.6us
W20260709 13:10:38.158599 27715 log.cc:927] Time spent T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:10:38.138753 27731 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:38.156143 23621 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:38.166759 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 150664us
I20260709 13:10:38.169237 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:38.192894 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:38.214202 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 45079.7us
W20260709 13:10:38.215363 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 293153us
W20260709 13:10:38.217245 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.220475 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 52832.3us
W20260709 13:10:38.224304 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.228559 22928 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:38.230976 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:38.232417 22999 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:38.241940 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:38.242799 23006 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
W20260709 13:10:38.247344 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 54576.3us
I20260709 13:10:38.248607 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.269816 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:38.281205 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:38.284497 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 266285us
I20260709 13:10:38.236002 27710 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.284675 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:38.286448 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:38.287034 23000 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.288771 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:38.289371 23001 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:38.292557 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:38.249722 27690 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:38.268062 27633 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:38.315265 27734 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:38.315784 27734 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:38.316663 27734 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.317871 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:38.318574 27590 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.319135 27590 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:38.319382 27737 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.319888 27737 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.320499 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.321250 23654 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:38.322113 27737 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.300755 27681 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:10:38.322669 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:38.323901 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:38.324092 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:38.324790 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:38.325795 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:38.325961 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.326589 23650 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:38.327298 23655 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:38.327518 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:38.328181 23651 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.328289 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:38.317888 27734 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:38.327318 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 171251us
W20260709 13:10:38.330778 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.327613 27722 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:38.331753 27713 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:38.332011 27722 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:38.332260 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.332419 27722 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.332612 27656 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.334370 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:38.337508 27598 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:38.338009 27598 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.339749 27696 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
W20260709 13:10:38.340372 27724 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:38.341254 23655 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:38.343900 27722 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.352135 27722 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.353101 27719 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.300460 27397 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:38.363843 27726 log.cc:927] Time spent T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:10:38.364639 27617 consensus_meta.cc:287] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.640s	user 0.005s	sys 0.005s
I20260709 13:10:38.324797 22924 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.367848 22926 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
W20260709 13:10:38.370110 27725 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:10:38.323598 22922 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:38.302363 27546 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.376183 27546 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.377643 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:38.378544 27546 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.302263 27720 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.379400 27720 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.379813 27720 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.380358 22923 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:38.268170 27686 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:10:38.384104 27686 consensus_queue.cc:1243] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:38.384640 27686 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:38.293740 27520 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.401536 22924 raft_consensus.cc:2468] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 15.
I20260709 13:10:38.404682 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:38.405946 23622 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:38.401687 22972 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.425186 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:38.387231 27686 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:38.437142 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.441745 23650 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:38.449450 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.450057 23655 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:38.451228 23000 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:38.451735 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:38.452517 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 48208.9us
I20260709 13:10:38.453435 23622 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:38.454295 23651 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:38.458237 23652 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: [9.9-11.10]
W20260709 13:10:38.459703 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 207622us
I20260709 13:10:38.462286 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:38.461417 23653 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:38.466468 23651 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:38.468531 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.472424 23652 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:38.441104 27704 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.458814 27534 consensus_meta.cc:287] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 13:10:38.479851 27747 consensus_queue.cc:1059] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:38.480863 27747 consensus_queue.cc:1243] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:38.481351 27534 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:38.483438 27534 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.485814 27381 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.487103 23006 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:38.489420 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:38.489933 23006 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:38.490658 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:38.491118 23006 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.496997 27381 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.463979 27598 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.464224 27742 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.469071 27737 raft_consensus.cc:2804] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:38.513021 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:38.481390 27747 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:38.505275 23006 raft_consensus.cc:2468] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:10:38.468235 27687 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.507249 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:38.519865 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 221766us
I20260709 13:10:38.526505 23004 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:38.528083 22896 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.529552 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.532779 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.533398 23656 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
W20260709 13:10:38.521761 27530 consensus_meta.cc:287] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.002s
I20260709 13:10:38.535822 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.517612 27747 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:38.521776 27396 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:38.503172 27704 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.522393 27737 raft_consensus.cc:697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 15 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:38.539067 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:38.547343 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:38.551017 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.551533 23652 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 16.
I20260709 13:10:38.542440 23080 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:38.543386 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:38.532533 27534 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:38.553534 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:38.554692 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.543910 22971 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:38.508359 27686 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:38.530936 27381 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:38.561988 27757 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:38.562901 27678 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.542057 27721 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:38.565022 23000 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 16.
I20260709 13:10:38.541600 27652 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:38.534754 27746 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:10:38.554715 27617 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:38.554574 27546 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:38.565044 27598 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:38.569721 27633 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:38.614033 27729 log.cc:927] Time spent T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.516s	user 0.003s	sys 0.002s
W20260709 13:10:38.625255 27723 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.554s	user 0.000s	sys 0.001s
I20260709 13:10:38.626020 22926 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:38.573982 27684 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.633550 27487 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:38.631068 23621 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:38.638392 27679 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:38.644511 23621 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:38.644867 27679 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:38.646306 27719 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.645766 27679 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.646823 27719 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.647269 27719 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.647378 27679 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.647855 27722 raft_consensus.cc:2804] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:38.617825 27530 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.649073 27530 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.651048 27530 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.633040 27546 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:38.613202 27617 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:38.653180 27617 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.648470 27722 raft_consensus.cc:697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:38.642078 27749 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:10:38.661381 27706 consensus_meta.cc:287] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.513s	user 0.019s	sys 0.006s
I20260709 13:10:38.662485 22971 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:38.652788 27737 consensus_queue.cc:237] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.568713 27381 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.611577 27534 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:10:38.618397 27633 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:38.613251 27610 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.663237 27734 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:38.653719 27598 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.691375 27487 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:38.691521 27633 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.725978 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:38.676060 27732 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:10:38.739843 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:38.728171 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.697875 27757 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:38.729614 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:38.730777 27704 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.731370 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:38.745391 27704 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.745882 27704 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.747900 27704 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.731600 23074 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:38.731745 27720 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.749792 22924 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:38.749867 27720 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.688398 27722 consensus_queue.cc:237] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.737231 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:38.751138 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:38.752974 23077 raft_consensus.cc:2393] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:38.751407 27765 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.752794 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:38.754032 23078 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.762502 23003 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
W20260709 13:10:38.764791 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.764660 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:38.770392 23075 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:38.701154 27678 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:38.783107 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 218562us
I20260709 13:10:38.743806 27684 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.786811 27610 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.704124 27734 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.806002 23078 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:38.821601 27757 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.799297 27710 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.831267 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:38.837430 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:38.839376 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 119982us
W20260709 13:10:38.822343 27728 log.cc:927] Time spent T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.745s	user 0.002s	sys 0.000s
I20260709 13:10:38.829926 27703 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.818710 27690 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.752091 27546 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.772971 27765 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:38.796388 27684 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.827275 27229 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:38.824935 27710 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.871038 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:38.877629 27720 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:38.873422 27487 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:38.885116 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:38.905437 27487 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.909279 23071 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:38.910629 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:38.851766 27703 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:38.857829 27690 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.936480 27706 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.938546 27381 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:38.870371 27678 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.972191 23071 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:10:38.963142 27760 log.cc:927] Time spent T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:10:38.963572 27598 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:38.988884 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 128638us
I20260709 13:10:38.989581 22895 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:38.991039 27765 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:38.991485 27530 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.992148 23074 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:38.997310 27645 raft_consensus.cc:3060] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.998977 27710 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.003415 27703 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:39.004339 27684 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.004793 27734 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:39.009460 27617 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.010957 27633 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.966881 27706 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:38.992163 27530 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.042645 27706 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.042740 27530 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.012879 27690 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.013717 27396 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:39.044023 27396 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.047174 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:39.050349 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 60842.9us
I20260709 13:10:39.054880 22896 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.057242 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:39.057528 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:39.054414 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:39.057854 23651 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 16.
I20260709 13:10:39.058821 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.059437 23649 raft_consensus.cc:1240] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:39.059527 23077 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:39.069396 27778 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:39.069955 27778 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:39.035915 27590 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:39.070473 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:39.074839 23654 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:39.073844 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.075603 23077 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:39.072865 22922 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:39.052160 27633 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.073840 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:39.052562 27541 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:39.055663 27652 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.073238 27778 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.091873 27652 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:39.093144 27617 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.092839 27652 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.145032 27719 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.081543 27590 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.097743 27541 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.155812 27719 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:39.155299 27692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.007s	sys 0.000s
W20260709 13:10:39.163703 27692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.007s	sys 0.001s
I20260709 13:10:39.165905 27590 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.170831 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.171008 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.172214 22924 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:39.172852 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.173645 22926 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:39.177239 27541 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.188110 22925 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:39.194766 23074 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:39.196276 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.197161 23074 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:39.198145 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.198427 27396 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.199007 23074 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:39.200680 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.221367 23077 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:39.201504 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.222203 23073 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 16.
I20260709 13:10:39.171553 22929 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:39.202533 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.205921 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.208616 27541 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:39.211428 27744 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:39.210677 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.227588 22895 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.229197 27652 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:39.230540 27652 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:39.230899 27652 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.231287 27652 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.228194 27692 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:39.226470 27719 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.196220 27520 consensus_queue.cc:1059] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:39.233101 27719 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.235163 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.238286 22970 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.233861 27708 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:39.243100 27708 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.243432 27708 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.243840 27590 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:39.244309 27590 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.244668 27590 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.237474 27687 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:39.245885 27687 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:39.246263 27687 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.249138 27719 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.253067 27747 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.254321 27747 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.253991 27708 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.256294 27708 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.259271 27520 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:39.259675 27520 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:39.260507 27520 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.261608 27520 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.264499 27590 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.236347 23046 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.281590 27652 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:39.282083 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45790.6us
I20260709 13:10:39.283246 22922 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:39.284298 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.284937 22929 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:39.285781 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.286605 22927 raft_consensus.cc:2410] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:39.288097 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:39.288684 22929 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:39.271863 23044 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.290343 27686 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.291697 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:39.292531 23080 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 9: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:39.219549 27396 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.298086 22929 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:39.278993 27687 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:39.272161 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.272387 27472 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:39.316030 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:39.316709 23653 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:39.315428 27472 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.318573 27472 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:39.318820 27684 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:39.319270 27684 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.319708 27684 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:39.320030 27771 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.378s	user 0.003s	sys 0.000s
I20260709 13:10:39.305660 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.309567 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:39.310501 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:39.314654 23657 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.328054 23656 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:39.328392 23655 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:39.331323 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.333307 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.334003 22929 raft_consensus.cc:2368] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
I20260709 13:10:39.334632 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.336748 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.339227 22925 raft_consensus.cc:1217] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:10:39.341619 22925 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:39.344985 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:39.353438 23620 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.347862 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:39.357770 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:39.360843 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.368255 23078 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:39.369385 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:39.371502 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:39.374395 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.375005 23004 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:39.377303 23004 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:39.378887 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:39.352268 27744 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.381928 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:39.385113 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.382653 23620 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.352758 27722 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:39.362195 27719 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:39.362139 27541 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:39.374205 27679 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.380491 27692 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:39.401966 23002 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:39.398567 23003 raft_consensus.cc:1275] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:39.375999 27768 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:39.404775 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.361971 27396 consensus_queue.cc:1059] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:39.425657 27687 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.425987 27396 consensus_queue.cc:1243] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:39.406108 27541 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.429548 27541 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:39.405841 27652 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:39.430096 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 94970.1us
I20260709 13:10:39.383617 27769 consensus_queue.cc:1059] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:10:39.431023 23046 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.431855 27769 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:39.432231 27769 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:39.433079 27769 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.433857 27696 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:39.433244 27788 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 4 to 9, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:39.434350 27696 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:39.434933 27692 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:39.435911 27692 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.406478 27679 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.440763 27679 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.405392 23000 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:39.409024 27768 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.443224 27768 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.409549 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:39.413941 27735 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.425277 27590 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.444216 23622 leader_election.cc:400] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
I20260709 13:10:39.444547 23622 leader_election.cc:403] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.445385 23002 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:39.445966 27735 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.447974 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:39.409391 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:39.448154 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1054) took 1126 ms. Trace:
I20260709 13:10:39.449709 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:39.450239 22922 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.450290 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:39.452026 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.434247 27769 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.452759 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.453321 22999 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:39.448698 23001 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.390228 27744 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.457238 27744 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.449057 22930 rpcz_store.cc:276] 0709 13:10:38.322053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.324913 (+  2860us) service_pool.cc:224] Handling call
0709 13:10:38.325281 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.775244 (+449963us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:38.785749 (+ 10505us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.304076 (+518327us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180020ce00. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921effe07 00007f392ad5aab9 00007f3921f1c69b 00007f3921f1a93f 00007f3921f1a455 00007f3928a023c7 00007f39250149a7 00007f39250240bf 00007f3925024038
0709 13:10:39.367271 (+ 63195us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.377242 (+  9971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.377294 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:39.377333 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.447968 (+ 70635us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54003935d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:39.448012 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.448108 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9704,"prepare.queue_time_us":30939,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":73,"raft.queue_time_us":12811,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":13939,"spinlock_wait_cycles":1038467584,"thread_start_us":113897,"threads_started":2,"wal-append.queue_time_us":108037}
I20260709 13:10:39.461395 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.462867 23076 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:39.463933 22997 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:10:39.464267 22997 pending_rounds.cc:85] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 6
I20260709 13:10:39.464469 22997 pending_rounds.cc:107] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:10:39.464677 22997 raft_consensus.cc:2889] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:39.464756 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:39.465276 23073 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.466426 23657 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:39.469861 23005 raft_consensus.cc:1240] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: [9.9-13.10]
I20260709 13:10:39.470017 23621 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:39.470383 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:39.471707 27652 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:39.472038 27397 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:39.472234 22970 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.472487 27397 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.472834 27778 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:39.472887 27768 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:39.473409 27742 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:39.474334 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.476630 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:39.472054 27652 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.434971 27472 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.477465 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:39.472913 27397 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.435309 27696 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.477873 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.489226 22926 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:39.490121 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.479152 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.479780 27546 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:39.477075 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:39.481256 27742 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.482465 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.473330 27487 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:39.483211 27541 consensus_queue.cc:1048] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:39.503044 22970 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.503293 23001 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:39.407898 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.494594 22998 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:39.505146 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.495899 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:39.496889 23002 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:39.497643 22927 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:39.497773 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:39.499933 27520 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.501022 23074 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:39.501246 27472 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:39.501351 27687 raft_consensus.cc:3055] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:39.502485 23072 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:39.480630 27652 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.508173 22922 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
W20260709 13:10:39.510995 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 103191us
I20260709 13:10:39.510573 22972 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.509938 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:39.513752 23620 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.517472 22972 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:39.509171 27520 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.505426 27541 consensus_queue.cc:1243] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:39.524730 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:39.511945 22970 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.520510 23002 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:39.525416 23072 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:39.525949 23045 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:39.510329 27742 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.514979 27746 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:39.519165 27719 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.512852 27785 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:39.512823 27747 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.510119 27687 raft_consensus.cc:740] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:39.507892 27487 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:10:39.525017 27520 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.524501 27722 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.508246 27378 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:39.521162 27774 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:39.535755 27742 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.543815 22826 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 11, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 11 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:39.525164 27472 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:39.551388 22826 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 8, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 8 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:39.531387 27686 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:39.558586 23072 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 17.
I20260709 13:10:39.578687 23002 pending_rounds.cc:85] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 5
I20260709 13:10:39.579006 23002 pending_rounds.cc:107] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:10:39.579236 23002 raft_consensus.cc:2889] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:39.527482 27703 consensus_queue.cc:1059] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:10:39.531669 27710 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:10:39.554252 27714 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.533764 27768 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:39.579790 27774 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:39.601660 22970 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.553777 27645 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:10:39.633968 22826 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:39.620540 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 92298.7us
W20260709 13:10:39.636961 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 110578us
I20260709 13:10:39.581944 27472 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:39.591827 27598 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:39.659917 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.593854 27229 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.688033 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 86445.5us
I20260709 13:10:39.619949 27720 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:39.598341 27714 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:39.620045 27686 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:39.632850 27378 raft_consensus.cc:3055] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:39.690001 22826 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 12, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:39.689841 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 163953us
I20260709 13:10:39.698137 27472 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.710945 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:39.692575 27487 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:39.693990 27735 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
I20260709 13:10:39.691700 27541 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:39.695647 27714 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.642506 27684 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.735302 23073 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:39.707924 27378 raft_consensus.cc:740] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:39.767227 23076 raft_consensus.cc:2393] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:39.707890 27720 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.775774 23073 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:10:39.737329 27487 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:39.709375 27229 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:39.842623 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.775002 27704 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.740123 27541 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.888234 27722 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.941956 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 282096us
I20260709 13:10:39.942929 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:39.900607 27742 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:39.933558 27710 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:39.934716 27807 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.947840 27812 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:39.966554 27769 consensus_meta.cc:287] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.003s
I20260709 13:10:39.979012 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:39.955587 27358 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:39.934000 27704 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.895949 27686 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.896291 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:39.988749 22997 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:39.992293 23003 raft_consensus.cc:606] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:39.992765 23003 raft_consensus.cc:614] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:39.775465 27774 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:39.949678 27722 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:39.975556 27807 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.010905 27807 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:39.993788 27684 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:40.004428 27794 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:10:40.000272 27769 consensus_queue.cc:1059] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:10:39.968202 27378 consensus_queue.cc:260] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:40.017813 27803 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:10:40.018151 27811 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:10:40.018427 27809 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:10:40.020094 27798 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:10:40.043000 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.044193 27633 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.044871 27633 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.047427 27633 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:40.052381 27804 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:10:40.057071 27652 consensus_meta.cc:287] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.002s
I20260709 13:10:40.057490 27652 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:40.066810 27801 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 13:10:40.069977 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.070116 27397 consensus_meta.cc:287] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.000s
I20260709 13:10:40.071368 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.072340 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.072960 27541 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:40.073748 27704 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:40.075070 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 364198us
I20260709 13:10:40.073076 23078 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:40.077111 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.078150 23076 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:10:40.079188 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:40.081722 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:40.083480 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:40.001791 27487 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.084045 23074 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.089200 27722 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.090713 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:40.095676 27378 raft_consensus.cc:3060] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.095978 27541 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.096522 27541 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.096980 27703 raft_consensus.cc:2764] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:40.098006 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.098595 27541 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.070506 27397 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.100710 27720 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.101269 27785 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:40.102121 27397 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:40.104604 27799 log.cc:927] Time spent T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.413s	user 0.008s	sys 0.005s
I20260709 13:10:40.106273 27714 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.106945 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.032694 27758 raft_consensus.cc:3055] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:40.031108 27747 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:40.112586 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.114668 23000 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 8: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:40.114990 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:40.115275 22925 raft_consensus.cc:2393] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:40.117421 23001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:40.117683 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:40.118247 23001 raft_consensus.cc:606] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:40.118573 23001 raft_consensus.cc:614] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:40.119843 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.120615 22927 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:40.120770 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:40.124241 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:40.128376 27720 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.128276 27706 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:40.129591 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:40.140591 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 186263us
I20260709 13:10:40.130568 22928 raft_consensus.cc:1240] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:40.130909 27714 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.131561 27822 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:40.133311 27687 consensus_queue.cc:260] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.125646 27816 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.134353 27747 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.143729 22826 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 2 to 9, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 9 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:40.121799 27758 raft_consensus.cc:740] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:40.155119 23074 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:10:40.158437 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.156908 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.125914 27696 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:40.159065 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.122361 27679 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.181059 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:40.160156 27520 consensus_meta.cc:287] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.001s
I20260709 13:10:40.166311 23650 raft_consensus.cc:2393] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:40.163152 23078 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.163941 23657 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:40.213918 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.221530 23657 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:40.181720 23652 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:40.160799 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.197264 27823 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:40.223066 23651 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:40.225162 23657 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:40.226465 23657 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:40.205427 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 44288.6us
I20260709 13:10:40.059577 27652 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.227195 23651 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:40.197688 23074 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:40.231096 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.264122 23656 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:40.233492 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.233785 23648 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:40.235883 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.265568 23652 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:40.235366 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.242748 23078 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:40.181807 27696 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:40.211026 27687 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.162483 27817 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:40.245195 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 86838.4us
I20260709 13:10:40.271526 23650 raft_consensus.cc:2368] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11.
I20260709 13:10:40.271344 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:40.247545 23619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.003s	sys 0.011s
I20260709 13:10:40.262771 23621 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:40.255173 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:40.272198 23079 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 6.
W20260709 13:10:40.272539 23619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.003s	sys 0.011s
I20260709 13:10:40.228451 27679 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.281270 23004 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:40.281949 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:40.309705 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 173344us
I20260709 13:10:40.271257 27696 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.231758 27520 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.233337 27823 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:40.315793 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 153332us
I20260709 13:10:40.317018 22971 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.319510 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:40.311481 22970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.309747 27812 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:40.335639 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:40.335902 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.336462 23080 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:40.336701 23074 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:40.308256 27829 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.317171 27598 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:40.280510 27808 consensus_queue.cc:1059] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:10:40.358732 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.349412 23074 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:40.333904 27714 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:40.362164 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 90182.8us
I20260709 13:10:40.377328 27541 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.417822 22972 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:40.344255 27815 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:40.344545 27812 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.335067 27817 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:40.423382 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 166518us
I20260709 13:10:40.256441 27758 consensus_queue.cc:260] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:40.429739 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 184136us
I20260709 13:10:40.429960 23045 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.373416 27530 raft_consensus.cc:3055] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:40.438473 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 118987us
I20260709 13:10:40.417444 27814 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:40.416484 27714 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.440277 23080 raft_consensus.cc:2468] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:40.449025 23080 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:10:40.428253 27812 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.441069 27530 raft_consensus.cc:740] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:40.453923 27774 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.352819 27829 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.442515 27758 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:40.464489 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.450562 27714 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.455135 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:40.433959 27541 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.445098 27845 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:40.457608 27487 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:40.459969 27747 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:40.483740 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 43591.9us
I20260709 13:10:40.433360 27815 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.435472 27817 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.513051 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:40.514621 23001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:40.515372 23001 raft_consensus.cc:606] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.516441 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.517166 22999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2389) took 1051 ms. Trace:
I20260709 13:10:40.524219 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.524956 22930 raft_consensus.cc:2393] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 15: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:40.525826 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.526064 27852 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:40.526665 27520 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.526625 27852 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.527204 22929 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:40.528177 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:40.528627 27854 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:40.529230 27854 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:40.530228 27854 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.532019 27839 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:40.532387 27844 raft_consensus.cc:2764] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:10:40.533234 27832 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:10:40.565660 23006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:40.479821 27841 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:40.562513 22971 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:40.566272 23006 raft_consensus.cc:606] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.581748 23006 raft_consensus.cc:614] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:40.517644 22999 rpcz_store.cc:276] 0709 13:10:39.466270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.466921 (+   651us) service_pool.cc:224] Handling call
0709 13:10:39.467238 (+   317us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:39.467592 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.467627 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:39.468222 (+   595us) log.cc:844] Serialized 78 byte log entry
0709 13:10:39.667109 (+198887us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:39.963601 (+296492us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.248786 (+285185us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.468543 (+219757us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.516778 (+ 48235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.516875 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.516926 (+    51us) raft_consensus.cc:1685] finished
0709 13:10:40.516943 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.517102 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64953,"prepare.queue_time_us":349988,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":4753,"raft.queue_time_us":215307,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":54630,"spinlock_wait_cycles":4516608,"thread_start_us":954070,"threads_started":4,"wal-append.queue_time_us":440886}
W20260709 13:10:40.567402 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 51041.7us
I20260709 13:10:40.572108 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.573222 23657 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:40.566768 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 128780us
I20260709 13:10:40.487219 27816 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:40.591285 22971 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.596055 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:40.503348 27686 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:40.596812 23000 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.597047 27686 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.599797 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.585361 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:40.565887 27804 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:40.609211 23648 raft_consensus.cc:1240] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:10:40.611099 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.590126 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:40.595994 23651 raft_consensus.cc:2393] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:40.593276 23045 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.601142 22998 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:40.466812 27774 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.605947 23000 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:40.582675 27742 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:40.594758 27704 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:40.487885 27487 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.594663 27844 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.624197 23652 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 17.
I20260709 13:10:40.600623 27816 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:40.628680 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.613958 27845 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.650077 27783 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:40.649844 27845 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.650765 27838 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.651325 27838 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.586412 27839 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 13:10:40.656162 27830 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:10:40.657341 27863 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:40.633304 23620 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:40.618266 27706 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.617010 23657 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:40.630831 27814 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:40.613816 27679 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.662351 27835 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:10:40.659289 27863 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:40.670742 27863 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.672283 27541 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.673015 27541 raft_consensus.cc:2804] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:40.673488 27541 raft_consensus.cc:697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:40.674360 27541 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.639604 27686 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.669016 27829 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.668917 27530 consensus_queue.cc:260] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.676743 27530 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.676853 27774 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.680974 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.681587 22925 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:40.682693 22972 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:40.683230 27847 log.cc:927] Time spent T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:10:40.683915 27679 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:40.684307 27679 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.684676 27679 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.685462 27487 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.686474 27696 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.687448 23071 raft_consensus.cc:1240] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:40.683171 27839 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:40.688977 22925 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:40.643740 27704 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:40.660257 23000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:40.658501 27816 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:40.691123 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.663709 27814 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:40.704219 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 79743.5us
I20260709 13:10:40.706849 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.645944 27742 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.695253 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.741798 23652 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.742017 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.740763 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:40.746953 27863 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.697641 27704 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.754436 27229 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:40.754890 27378 consensus_meta.cc:287] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.003s
I20260709 13:10:40.690217 27839 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:40.747788 27837 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
W20260709 13:10:40.748519 27833 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:10:40.748886 27848 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:40.707721 27487 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:10:40.755612 27823 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.762418 27598 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.750345 27861 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:40.694236 27714 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.659967 27844 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.763054 27853 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:40.768333 27815 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:40.772953 23652 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:40.773885 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:40.694180 23000 raft_consensus.cc:606] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:40.778304 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.781737 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.761147 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:40.760506 23077 raft_consensus.cc:1275] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:10:40.708431 27814 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:40.786908 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:40.802624 23077 pending_rounds.cc:85] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 9
I20260709 13:10:40.802866 22925 raft_consensus.cc:3060] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.792091 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:40.760995 27862 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:10:40.738379 27774 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.807729 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.802917 23077 pending_rounds.cc:107] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:10:40.804515 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:40.808605 23077 raft_consensus.cc:2889] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.806384 23072 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:40.761627 27838 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.759949 27829 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:40.788190 27378 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:40.807556 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:40.812700 23076 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:40.819610 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.812573 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:40.824411 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:40.825191 23072 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 6.
I20260709 13:10:40.759485 27679 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.812265 27774 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.865520 27816 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:40.866858 27844 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.867316 23080 raft_consensus.cc:1240] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:40.761765 27856 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:10:40.797122 27783 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:40.868832 27863 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.790274 27861 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.867449 27774 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.870271 27774 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.870733 27774 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.871169 27861 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:40.876734 27774 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:40.877286 22969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.879009 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.880084 27817 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:40.882007 22997 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:40.882476 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:40.866062 23004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52166 (request call id 2386) took 1420 ms. Trace:
I20260709 13:10:40.883261 22999 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:40.883179 23004 rpcz_store.cc:276] 0709 13:10:39.445187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.447767 (+  2580us) service_pool.cc:224] Handling call
0709 13:10:40.865900 (+1418133us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54000ef1d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:40.866007 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249750912}
I20260709 13:10:40.884222 27839 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.887198 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:40.888025 23004 raft_consensus.cc:2393] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 7: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:40.888681 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.888742 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.889394 23655 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.891893 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.892449 22929 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:40.785780 27812 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.900559 23649 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:40.902120 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 287361us
I20260709 13:10:40.909271 22971 leader_election.cc:400] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11.
I20260709 13:10:40.911401 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:40.915031 22999 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.916956 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:40.919566 22972 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:40.867449 27816 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:40.920967 23074 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:40.924714 23074 pending_rounds.cc:85] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 9
I20260709 13:10:40.925051 23074 pending_rounds.cc:107] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:40.925235 23656 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:40.925393 23074 raft_consensus.cc:2889] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.916360 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:40.926239 22928 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.933733 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.934692 23657 raft_consensus.cc:2393] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:40.912585 27819 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.101s	user 0.007s	sys 0.000s
I20260709 13:10:40.936921 23080 raft_consensus.cc:1240] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:40.923095 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:40.940335 23000 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:40.926198 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.905956 27710 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:40.955615 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.956331 23656 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:40.806146 27853 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.924897 27839 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.957873 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.826772 27829 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.961519 22999 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 15.
I20260709 13:10:40.915212 27783 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:40.953790 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 149316us
I20260709 13:10:40.970952 23045 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:40.964994 23656 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:40.973002 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.968072 23080 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:40.961284 22928 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:40.918298 27546 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:10:40.976851 27816 raft_consensus.cc:2804] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:40.982482 27816 raft_consensus.cc:697] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 14 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:40.983646 27816 consensus_queue.cc:237] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.987283 27696 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:40.989745 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:40.990325 23651 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.990397 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:40.991214 23656 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:40.997128 27861 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:40.997774 27861 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.999388 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.000300 27861 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:41.003216 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:41.004357 27817 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:40.947536 23655 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 15.
W20260709 13:10:40.965184 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45712.6us
I20260709 13:10:41.010424 27774 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:41.010633 27744 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.010949 27774 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.011220 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:41.011166 27744 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.011878 23080 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.013511 27742 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:41.014037 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:41.014647 27714 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:41.016976 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.017036 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.017838 22922 raft_consensus.cc:2393] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:41.017761 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.018458 22926 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:41.019403 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.000590 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.025151 23650 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:40.975342 27783 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.028746 27812 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.029953 27783 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.030316 27853 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:41.032998 23080 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 7.
I20260709 13:10:41.033296 27679 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.034487 27845 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.036054 27774 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.038166 27814 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:40.971444 27358 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:41.041968 27829 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.046301 23650 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:40.958844 27710 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.969179 27704 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.048556 23651 raft_consensus.cc:2468] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:10:41.049702 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 140811us
W20260709 13:10:41.051477 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.053090 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:41.060449 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.076973 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:41.078320 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:41.079608 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:41.066987 22925 raft_consensus.cc:2468] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
W20260709 13:10:41.067526 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 55941.8us
I20260709 13:10:41.081574 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:41.073194 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:41.084144 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.085018 22925 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:41.086907 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.087612 23652 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:41.087260 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:41.088325 23075 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.086916 23653 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:41.058162 27853 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.076016 27358 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.098167 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:41.095611 22896 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:41.092618 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:41.112411 23650 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:41.102986 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.118086 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.081370 27590 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.084630 27766 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.112229 27845 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:41.117391 27774 raft_consensus.cc:3060] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.126655 23045 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:41.089270 27758 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:41.204159 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.089213 27880 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.120488 27358 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:41.142510 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 49991us
W20260709 13:10:41.202670 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 76109.1us
I20260709 13:10:41.095613 27812 consensus_queue.cc:1048] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:10:41.142825 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44740.9us
I20260709 13:10:41.126251 27534 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:41.156472 27679 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.206607 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:41.202900 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.221540 27885 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:41.221952 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:41.110738 27546 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:10:41.207820 27863 raft_consensus.cc:2804] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:41.213575 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 87958.1us
I20260709 13:10:41.215317 22925 raft_consensus.cc:2393] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:41.214282 22970 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:41.237955 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.238300 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.163295 27472 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.207115 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:41.240844 27714 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:41.241204 27714 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.241542 27714 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.205303 27880 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.242686 27880 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.120929 27853 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.246251 27853 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:41.206339 27378 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.248040 27378 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.228564 27868 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:10:41.229370 27856 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:41.227159 27534 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:41.230294 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.258126 27678 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.230999 22895 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:41.258791 27678 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.201290 23075 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 15.
I20260709 13:10:41.260524 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:41.260869 27678 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.224726 27839 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:41.261832 27839 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.258078 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:41.261273 27744 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.254655 22896 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:41.268322 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.269244 23078 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 15: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:41.274158 27751 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:10:41.202163 27590 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.234737 27769 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.213070 27845 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:10:41.289986 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.276839 27546 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:41.382586 23075 raft_consensus.cc:2393] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:41.255700 27746 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:41.262382 27839 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.224979 27840 consensus_queue.cc:1059] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:10:41.250896 27835 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:41.255535 27472 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.264317 27678 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.263446 27863 raft_consensus.cc:697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:41.463378 27828 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:41.277590 27610 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:41.255967 27770 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.148s
I20260709 13:10:41.505021 27610 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 15 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:41.488196 27704 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.485170 27814 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.505967 27610 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.480062 27840 raft_consensus.cc:3055] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:41.506937 27840 raft_consensus.cc:740] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:41.507860 27840 consensus_queue.cc:260] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.509203 27840 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.481073 27678 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.513770 27678 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.390980 27766 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 13:10:41.258155 27534 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.484092 27590 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.517905 27894 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.518311 27894 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:41.519264 27894 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.498204 27378 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.521714 27710 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.484061 27863 consensus_queue.cc:237] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.396865 27720 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:10:41.476763 27746 raft_consensus.cc:697] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:41.476011 27850 consensus_queue.cc:1059] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:41.543761 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.566640 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:41.567154 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.566948 27746 consensus_queue.cc:237] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.567764 23650 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:41.573988 27850 consensus_queue.cc:1243] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:41.564483 27814 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.583254 27814 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.585224 27814 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:41.586452 27774 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.586781 27895 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:41.587234 27681 raft_consensus.cc:2764] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:41.587641 27835 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.587786 27880 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.545111 27472 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.588088 27358 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.396675 27692 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.181s
W20260709 13:10:41.610096 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 355443us
I20260709 13:10:41.632097 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:41.632690 22826 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:41.588954 27714 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.626744 27814 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.662057 27873 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:41.635069 27895 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:41.680575 27880 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.686765 27714 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.656003 27814 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:41.712802 27656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.012s	sys 0.030s
I20260709 13:10:41.691774 27873 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:41.727893 23656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.015s	sys 0.034s
W20260709 13:10:41.729350 23656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.015s	sys 0.034s
W20260709 13:10:41.728405 27656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.013s	sys 0.030s
I20260709 13:10:41.734328 27895 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.742658 27839 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.760073 27839 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.762292 23006 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:41.762672 27487 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:41.746327 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.726929 27843 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.747769 27814 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.749296 27873 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:41.749816 27892 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.368s	user 0.009s	sys 0.005s
I20260709 13:10:41.799824 27783 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:41.800746 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:41.744174 27835 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.801414 23074 raft_consensus.cc:2368] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15.
I20260709 13:10:41.730664 27897 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:41.765509 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.802947 23000 raft_consensus.cc:2410] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:41.802569 27897 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.773396 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:41.804059 27855 log.cc:927] Time spent T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 1.161s	user 0.006s	sys 0.004s
I20260709 13:10:41.804817 27897 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.775566 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.785058 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:41.807588 23648 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.808907 22826 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 12, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 12 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.810504 22826 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:41.812520 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:41.786809 23652 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:41.813808 27744 raft_consensus.cc:3055] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:41.813644 22826 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:41.814172 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:41.814754 23652 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.815316 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.815905 22923 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:41.816809 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:41.818112 27656 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:41.818235 22930 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:41.818670 27656 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.819782 27530 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:41.820788 27656 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.814949 22826 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:41.821973 22826 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 15, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 15 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:41.823514 22826 catalog_manager.cc:5697] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 11, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.825340 22826 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.828490 27839 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:41.794004 27852 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.794850 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2106) took 1277 ms. Trace:
I20260709 13:10:41.829562 23001 rpcz_store.cc:276] 0709 13:10:40.517167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.517404 (+   237us) service_pool.cc:224] Handling call
0709 13:10:40.517774 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.687829 (+170055us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:40.688050 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.796738 (+108688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.796785 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:40.799025 (+  2240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.794633 (+995608us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002e36d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:41.794682 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.794797 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":399,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":6707,"raft.queue_time_us":75,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":390671744,"thread_start_us":108389,"threads_started":1,"wal-append.queue_time_us":186443}
I20260709 13:10:41.833421 27778 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:41.833788 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.833928 27778 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.834781 27835 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:41.835358 27768 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:41.835325 27835 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.836005 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.835974 27768 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.837066 27778 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:41.837364 22929 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:41.837518 27835 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.838122 27768 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.829039 27839 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.840891 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:41.841907 27696 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.841981 23046 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:41.846055 27358 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:41.796381 27378 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.774338 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.827574 22826 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 7, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 7 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:41.848996 27894 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.867928 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:41.869608 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:41.870124 23657 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.871937 27696 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.872634 27696 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:41.874874 27696 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:41.875787 23073 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:41.875861 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.878509 27710 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:41.875873 27887 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.640s	user 0.003s	sys 0.015s
I20260709 13:10:41.849506 27530 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.852041 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.851351 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.851576 23648 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:41.792742 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.889489 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.893024 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.893767 23004 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 11: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:41.894865 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.895454 23001 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
W20260709 13:10:41.854877 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.026s	sys 0.066s
W20260709 13:10:41.897075 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.026s	sys 0.066s
W20260709 13:10:41.897353 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 666372us
I20260709 13:10:41.855620 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.857026 23074 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:41.857877 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:41.898938 23079 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.858649 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.893028 22826 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 11, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 11 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:41.892760 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 254945us
I20260709 13:10:41.902246 23076 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:41.903059 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.904278 23649 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:41.847584 23652 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:41.864401 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.861244 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:41.909989 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.911180 22971 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:41.892282 23621 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:41.912352 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:41.916286 23657 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:41.918568 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:41.919257 23654 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.919581 22971 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:41.926551 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:41.927304 23004 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.920518 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.939755 22923 raft_consensus.cc:2410] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:10:41.941066 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 48852.7us
I20260709 13:10:41.945015 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.945595 22896 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:41.949940 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:41.960731 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.961697 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:41.814198 27744 raft_consensus.cc:740] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:41.966693 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:41.967058 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.967891 22999 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:41.968660 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:41.969029 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:41.970969 22999 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 14. (term mismatch)
I20260709 13:10:41.859772 27808 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.961776 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:41.971402 22999 pending_rounds.cc:85] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 13
I20260709 13:10:41.978411 22999 pending_rounds.cc:107] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:10:41.978776 22999 raft_consensus.cc:2889] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.980502 27900 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:41.980569 27768 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:41.981513 27768 consensus_queue.cc:1243] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:41.981613 22826 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 4 to 7, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 7 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:41.983275 22826 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 13, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 13 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.985581 23073 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:41.940773 27850 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:42.006809 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.940299 27530 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:41.997759 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:42.000485 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.002213 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.002446 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.947074 27825 raft_consensus.cc:2804] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:42.011065 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.024179 22997 raft_consensus.cc:1275] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:41.885607 27378 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.974565 27885 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.025384 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:41.769793 27843 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:41.943483 27719 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:10:42.032155 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:42.029609 22926 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:10:41.975172 27679 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.025749 27859 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:41.984540 27766 consensus_queue.cc:1059] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:10:42.010020 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 48325.6us
I20260709 13:10:41.974983 27397 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.984702 27720 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:42.043139 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:41.939754 27610 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:10:41.960566 27541 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.965163 27656 consensus_queue.cc:1059] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:10:42.011188 27778 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:42.070351 27835 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:41.989734 27472 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.088792 23003 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:42.117273 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.037819 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:41.997759 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:42.118937 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.053798 27850 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:42.130699 23075 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:42.148880 22970 leader_election.cc:400] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15.
I20260709 13:10:42.149214 22970 leader_election.cc:403] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.149592 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:42.056471 27840 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:41.995311 27808 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:42.073449 27825 raft_consensus.cc:697] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:42.134220 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:42.120904 27859 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:42.146874 23651 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:42.157392 22930 raft_consensus.cc:3060] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.135738 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:42.046022 27530 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.158154 22970 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.130630 27720 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:42.075932 27679 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:42.167276 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 198680us
I20260709 13:10:42.196964 27710 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:42.197701 27710 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:42.198164 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.199126 27684 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:42.200268 27710 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:42.203998 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:42.204697 22924 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:42.205498 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 47419.7us
I20260709 13:10:42.212302 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:42.215591 23648 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15. Ops: [8.9-14.12]
I20260709 13:10:42.218284 23004 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 15.
I20260709 13:10:42.215288 23652 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:42.260591 27378 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.261407 27885 raft_consensus.cc:3055] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:42.261858 27885 raft_consensus.cc:740] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:42.262516 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.264667 27472 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.266088 23657 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:42.255414 27839 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.269337 27679 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.269987 27679 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.262580 27885 consensus_queue.cc:260] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:42.270555 27679 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.271154 27885 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:42.217428 27863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.029s	sys 0.057s
W20260709 13:10:42.271946 27863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.029s	sys 0.057s
I20260709 13:10:42.272579 23074 raft_consensus.cc:1240] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:42.274776 27808 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:42.277421 27530 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.278071 27846 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.278738 27846 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.274869 27534 raft_consensus.cc:3055] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:42.279976 27534 raft_consensus.cc:740] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:42.280828 27534 consensus_queue.cc:260] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:42.156342 27835 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.282032 27534 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.283488 27835 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.125662 27744 consensus_queue.cc:260] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.283833 22826 catalog_manager.cc:5697] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.285466 27850 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.281167 27846 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.148535 27778 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.289654 27778 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.290128 27778 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:42.290596 27778 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:42.295111 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.294996 22826 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.296891 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.296620 22826 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 10, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 10 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.297986 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.299079 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.300048 27720 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.300948 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.161515 27840 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.305049 27840 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:42.305387 22829 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 373) took 26410 ms (client timeout 15000 ms). Trace:
W20260709 13:10:42.305981 22829 rpcz_store.cc:269] 0709 13:10:15.895483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.895800 (+   317us) service_pool.cc:224] Handling call
0709 13:10:42.305293 (+26409493us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:37.282173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:37.282833 (+   660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:37.282881 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:10:37.282913 (+    32us) tablet.cc:662] Decoding operations
0709 13:10:37.284464 (+  1551us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:37.284556 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:37.284595 (+    39us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:10:37.285759 (+  1164us) tablet.cc:701] Row locks acquired
0709 13:10:37.285806 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:10:37.285973 (+   167us) write_op.cc:270] Start()
0709 13:10:37.286112 (+   139us) write_op.cc:276] Timestamp: P: 1783602637285911 usec, L: 0
0709 13:10:37.286149 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:10:37.332846 (+ 46697us) log.cc:844] Serialized 6181 byte log entry
0709 13:10:37.840803 (+507957us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b5400404f54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f3925005e28 00007f3928a40581 00007f3928a3fd58 00007f3928a449f1 00007f3928a449a9 00007f3928a44939 00007f3928a44901 00007f3928a43b2d 000000000038f354 000000000038f199
0709 13:10:38.130007 (+289204us) op_driver.cc:464] REPLICATION: finished
0709 13:10:38.315472 (+185465us) write_op.cc:301] APPLY: starting
0709 13:10:38.315593 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:38.563433 (+247840us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:38.563467 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:38.647174 (+ 83707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:38.647531 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:10:38.647595 (+    64us) write_op.cc:312] APPLY: finished
0709 13:10:38.648106 (+   511us) log.cc:844] Serialized 139 byte log entry
0709 13:10:38.648295 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.648454 (+   159us) write_op.cc:454] Released schema lock
0709 13:10:38.648527 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:38.651768 (+  3241us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.651794 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2374910,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":160912,"apply.run_cpu_time_us":20911,"apply.run_wall_time_us":336292,"cfile_cache_hit":62,"cfile_cache_hit_bytes":67007,"num_ops":15,"prepare.queue_time_us":667380,"prepare.run_cpu_time_us":26391,"prepare.run_wall_time_us":558863,"raft.queue_time_us":346946,"raft.run_cpu_time_us":20128,"raft.run_wall_time_us":208197,"replication_time_us":806405,"spinlock_wait_cycles":17356544,"thread_start_us":845195,"threads_started":4,"wal-append.queue_time_us":252856,"wal-append.run_cpu_time_us":25175,"wal-append.run_wall_time_us":2040221}]]}
W20260709 13:10:42.311300 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 88736.9us
W20260709 13:10:42.336796 23078 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.041s
I20260709 13:10:42.232570 27358 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15.
I20260709 13:10:42.298321 22826 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 11, leader changed from <none> to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 11 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:42.315753 27859 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.317508 27843 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.206984 27768 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:10:42.279047 22924 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:42.349807 22826 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 10, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:42.284989 27744 raft_consensus.cc:3060] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.322947 23651 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:42.356084 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:42.328853 23654 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
W20260709 13:10:42.357658 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.331521 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 347615us
W20260709 13:10:42.332293 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 130107us
I20260709 13:10:42.359205 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.338280 23079 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
W20260709 13:10:42.338297 23078 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.011s	sys 0.041s
I20260709 13:10:42.360463 23076 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:42.342898 23657 raft_consensus.cc:1240] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:42.344588 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:42.335165 27895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.025s	sys 0.038s
I20260709 13:10:42.357537 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.361864 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.362466 23657 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:42.362607 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.363451 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.363768 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.364387 23654 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:42.358644 22826 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.312151 27825 consensus_queue.cc:237] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.370764 22971 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:42.332376 22929 raft_consensus.cc:1275] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:42.369385 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:42.364509 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 63660.3us
I20260709 13:10:42.369890 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:42.319587 27838 consensus_queue.cc:1175] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b655449a388a41e3a606c6ea794825ad" responder_term: 11 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:42.377586 22971 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:42.376400 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.379132 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.383172 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:42.370887 27895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.025s	sys 0.038s
I20260709 13:10:42.384264 22826 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.387123 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.336879 27684 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:42.369025 27610 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:42.345222 27910 consensus_queue.cc:1059] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:10:42.368762 27846 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:42.368886 27541 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.400249 23006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.015s
W20260709 13:10:42.424554 23006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.011s	sys 0.015s
W20260709 13:10:42.401346 23655 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.027s	sys 0.043s
W20260709 13:10:42.425072 23655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.028s	sys 0.043s
I20260709 13:10:42.384744 27808 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:42.384728 27681 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.398403 27696 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:42.386318 27843 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.397543 27840 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.405143 22930 raft_consensus.cc:2468] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:42.387998 27652 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:10:42.397786 27857 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:10:42.415814 22826 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 4 to 7, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 7 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:42.422297 23654 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:42.423194 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.348205 27534 consensus_queue.cc:1059] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:10:42.402667 27863 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:10:42.426918 23655 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:42.425804 27679 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.430246 27681 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.431496 27808 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:42.438995 22826 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.441548 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:42.430493 27895 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:42.449630 27895 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.427007 27541 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.452880 27895 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.453691 27541 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:42.430650 27843 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.432633 27840 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.456035 22826 catalog_manager.cc:5697] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:42.459699 22826 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:42.443698 27778 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:42.445293 27910 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:42.461709 22826 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 7, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 7 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.463737 27808 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.448266 27229 raft_consensus.cc:3055] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:42.475968 23080 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.024s	sys 0.049s
I20260709 13:10:42.458099 27843 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:42.477447 23000 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.037s
W20260709 13:10:42.478229 23000 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.010s	sys 0.037s
I20260709 13:10:42.457966 27840 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:42.470170 27807 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.014s	sys 0.028s
W20260709 13:10:42.480759 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 294439us
W20260709 13:10:42.485757 27807 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.015s	sys 0.029s
I20260709 13:10:42.457872 27534 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:10:42.457293 27652 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:10:42.492553 27912 log.cc:927] Time spent T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:42.493178 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:42.494055 22931 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:42.494277 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.494973 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:42.496315 22826 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index -1 to 4, term changed from 6 to 7, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196) added, no longer has a pending config: VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193), VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194), VOTER b655449a388a41e3a606c6ea794825ad (127.21.67.195), NON_VOTER 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 7 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: NON_VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: true } } }
I20260709 13:10:42.497424 27774 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:42.500669 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.469892 27910 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:42.499951 23080 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.024s	sys 0.050s
I20260709 13:10:42.475284 27229 raft_consensus.cc:740] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:42.594940 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.606978 27744 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:42.607545 27744 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:42.609670 27744 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:42.597424 27703 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.599853 27895 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:42.592587 27774 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:42.634078 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 253554us
I20260709 13:10:42.645701 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.646386 27922 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:42.634040 27719 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:42.674253 23071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.010s
W20260709 13:10:42.674691 23071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.000s	sys 0.010s
W20260709 13:10:42.675691 23621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.003s	sys 0.007s
W20260709 13:10:42.676076 23621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.003s	sys 0.007s
W20260709 13:10:42.676455 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 702807us
I20260709 13:10:42.677232 23621 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:42.678237 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.679081 27936 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.631451 27703 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:42.726004 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 45228.6us
I20260709 13:10:42.747875 23622 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.752004 22999 pending_rounds.cc:85] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 6
I20260709 13:10:42.764391 22999 pending_rounds.cc:107] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:42.764847 22999 raft_consensus.cc:2889] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:42.761852 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 382826us
I20260709 13:10:42.751021 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:42.766562 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:42.767220 23004 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
W20260709 13:10:42.758193 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 56177.6us
I20260709 13:10:42.751318 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:42.750051 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:42.749714 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 249111us
I20260709 13:10:42.635710 27895 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.681713 27746 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.779898 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:42.785404 22997 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:42.781111 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.787498 22972 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.775250 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:42.794966 22970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.010s	sys 0.008s
I20260709 13:10:42.797561 27927 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.798105 27927 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:42.798576 27927 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:42.797784 22970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.008s
W20260709 13:10:42.800235 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 593859us
I20260709 13:10:42.630947 27910 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.633833 27229 consensus_queue.cc:260] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.762133 27846 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:42.808998 23622 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.804774 22970 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.768093 27487 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:42.814917 22970 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:42.810595 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.819034 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:42.812480 23653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.012s
W20260709 13:10:42.821138 23653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.008s	sys 0.012s
I20260709 13:10:42.683571 27840 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.779218 27541 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:42.779913 27857 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:42.779372 27681 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.833408 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.834604 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.844925 23622 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:42.837550 23001 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:42.840629 23652 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:42.813109 27358 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:42.812582 27852 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:42.850932 27926 log.cc:927] Time spent T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:10:42.851761 27920 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:10:42.806195 27806 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:10:42.853111 27917 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260709 13:10:42.853775 22922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.031s	sys 0.063s
W20260709 13:10:42.865890 22922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.031s	sys 0.063s
I20260709 13:10:42.851845 27768 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:42.843806 27910 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.815063 27610 consensus_queue.cc:1048] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:10:42.834478 27846 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.832350 27487 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:42.924903 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.864501 27939 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:42.874677 27850 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:42.888761 27923 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.868522 27897 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.872169 27768 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:42.935962 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:42.932601 27913 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.305s	user 0.001s	sys 0.001s
W20260709 13:10:42.938251 27947 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:42.941565 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47784 (request call id 1265) took 1099 ms. Trace:
I20260709 13:10:42.921334 27679 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.899291 27823 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:10:42.976109 23621 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:42.876936 27922 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:42.875921 27943 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:10:42.936417 27923 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:42.970026 23656 rpcz_store.cc:276] 0709 13:10:41.842536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.878421 (+ 35885us) service_pool.cc:224] Handling call
0709 13:10:41.878727 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:41.879059 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.879087 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:41.891709 (+ 12622us) log.cc:844] Serialized 52 byte log entry
0709 13:10:42.418260 (+526551us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:42.418303 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.418366 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.941232 (+522866us) raft_consensus.cc:1685] finished
0709 13:10:42.941270 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.941469 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":837,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"thread_start_us":475899,"threads_started":1,"wal-append.queue_time_us":690528}
I20260709 13:10:43.033113 27923 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.953393 27774 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.005676 23006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52154 (request call id 2123) took 1198 ms. Trace:
I20260709 13:10:43.035880 23006 rpcz_store.cc:276] 0709 13:10:41.806839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.847900 (+ 41061us) service_pool.cc:224] Handling call
0709 13:10:41.848248 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:41.848573 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.848600 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:41.849137 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:10:42.425135 (+575998us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:42.425182 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.426313 (+  1131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.005389 (+579076us) raft_consensus.cc:1685] finished
0709 13:10:43.005418 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.005605 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":575605,"threads_started":1,"wal-append.queue_time_us":776536}
I20260709 13:10:43.040877 27768 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.042249 27768 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.956517 27895 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:42.957018 27703 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:42.958380 27846 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.062978 22998 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:43.084985 22998 pending_rounds.cc:85] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 9
I20260709 13:10:43.085242 22998 pending_rounds.cc:107] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:43.085501 22998 raft_consensus.cc:2889] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:43.028599 27747 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.004611 27812 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.120226 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.003973 27720 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:42.955849 27843 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:42.964135 27927 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.062964 27901 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:43.124903 27931 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:10:43.151634 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 336757us
I20260709 13:10:43.122067 27812 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.157058 23005 raft_consensus.cc:2393] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 12: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:43.124776 27397 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:43.133419 27923 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:43.172437 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 384971us
I20260709 13:10:43.181574 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.124032 27852 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:43.149255 27936 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.149084 27935 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.190152 27358 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.190732 27935 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.193112 27935 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.194067 27487 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.151511 27901 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.185870 23004 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:43.176362 27840 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.144068 27720 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:43.190091 27957 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:43.151530 27747 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:10:43.183689 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 405229us
I20260709 13:10:43.330349 27812 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:43.283716 27934 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:10:43.295364 27720 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.340646 27964 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.278360 27358 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.294242 27901 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:43.314018 27949 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:10:43.282650 27843 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:43.313406 27955 log.cc:927] Time spent T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:10:43.280936 27927 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.340176 27958 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:43.256939 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 57433.6us
W20260709 13:10:43.350787 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 149496us
W20260709 13:10:43.257091 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 56114us
I20260709 13:10:43.377921 22972 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.357239 23004 raft_consensus.cc:1240] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:43.358732 23003 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:43.362782 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.341163 27768 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.366160 27656 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.365804 27838 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:43.370951 27840 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.384084 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.388252 23006 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:43.376672 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.386706 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.391467 23650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 1041) took 1177 ms. Trace:
I20260709 13:10:43.394107 22972 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.394378 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:43.397640 22972 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.399818 27843 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.391762 27938 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.400478 27843 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.400866 27938 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.399431 22972 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.402046 27358 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:43.403170 27938 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.403355 27835 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:43.392268 27656 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.405422 22972 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.393651 23650 rpcz_store.cc:276] 0709 13:10:42.213675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.213777 (+   102us) service_pool.cc:224] Handling call
0709 13:10:42.214057 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.214368 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.214395 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.214819 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.632750 (+417931us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:42.632788 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.632858 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.391272 (+758414us) raft_consensus.cc:1685] finished
0709 13:10:43.391296 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.391411 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":19763,"thread_start_us":417646,"threads_started":1,"wal-append.queue_time_us":933807}
I20260709 13:10:43.406818 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.408592 22896 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.377671 27923 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.395390 27838 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.371980 27964 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.411693 27961 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.416326 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:43.416258 27961 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.417927 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.418226 22896 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.413401 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.419088 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.418272 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.415261 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.421368 22928 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:43.422093 22993 tablet_service.cc:1558] Processing DeleteTablet for tablet adf5adaae5184191bdaff064d051da2a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:45790
I20260709 13:10:43.422401 27961 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.423607 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.413569 27895 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.425127 27229 raft_consensus.cc:3060] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.387861 27958 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.427641 22972 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.429783 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:43.430819 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:43.405164 27758 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.434141 22931 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:10:43.390780 27768 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.436502 22896 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:43.438181 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.415607 27964 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.440244 22997 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:43.443465 27910 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.443984 27910 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.444397 27910 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.444553 27746 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:43.444972 27746 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:43.445825 27746 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.448968 27397 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:43.449436 27397 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.452765 27679 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.454687 27656 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.457232 27958 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.395094 27840 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.459633 27840 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.412307 27959 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:43.435451 27927 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.437225 27943 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:10:43.469524 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.435633 27895 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:43.435850 27961 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.474236 27943 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:43.479727 27943 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.481889 27943 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.474979 27768 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.487146 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.491137 27838 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:43.492959 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 724935us
I20260709 13:10:43.475961 27895 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:43.496230 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 719198us
I20260709 13:10:43.509248 23080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43468 (request call id 930) took 1653 ms. Trace:
I20260709 13:10:43.509728 23080 rpcz_store.cc:276] 0709 13:10:41.855880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.856007 (+   127us) service_pool.cc:224] Handling call
0709 13:10:41.856363 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.859875 (+  3512us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:42.538627 (+678752us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.840185 (+301558us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.840614 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.840743 (+   129us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:42.843749 (+  3006us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.508875 (+665126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.508970 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.509023 (+    53us) raft_consensus.cc:1685] finished
0709 13:10:43.509043 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.509183 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":676540,"prepare.queue_time_us":633973,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":3380,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":5489,"thread_start_us":895264,"threads_started":2,"wal-append.queue_time_us":491029}
I20260709 13:10:43.517208 27766 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.517764 27766 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.520053 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:43.520458 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.524541 23072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2510) took 1273 ms. Trace:
I20260709 13:10:43.507942 27895 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.535234 27684 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:43.557677 27684 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.559600 27684 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.537307 27807 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.560556 27807 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.562880 27807 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:43.552405 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.531745 27778 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:10:43.563838 27766 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.540473 23080 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:43.565112 27696 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.550799 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.514420 27879 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.568706 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.571799 23077 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:43.565758 27696 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.515471 27397 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.539631 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.550393 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.588037 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:43.565922 23079 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:43.584793 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:43.534830 27692 consensus_queue.cc:1059] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:10:43.587585 23078 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:43.588292 23076 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:43.584559 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.591549 23080 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:43.537366 27958 consensus_queue.cc:1059] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:10:43.584173 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.610778 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.613850 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.614204 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.613145 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.615408 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.574546 27808 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:10:43.617871 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 120891us
I20260709 13:10:43.625375 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.633520 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:10:43.617305 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 123271us
I20260709 13:10:43.634824 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.639179 23046 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.611163 27859 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:43.647442 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:43.648290 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.650686 23046 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.652890 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:43.670643 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:43.672111 22970 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:43.652240 27885 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:43.652540 27846 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.680055 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.650213 27843 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.655934 27838 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.647516 27927 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:43.655021 27710 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.652436 27894 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.632301 27808 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.686594 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.682219 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:43.688899 23046 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:43.690665 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.661684 27812 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.676913 27943 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:43.692731 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.679260 27807 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:43.676785 27840 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.652999 27859 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.685237 27897 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:43.675081 27989 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.697523 23080 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:43.698173 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.684165 27850 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.682571 27885 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:43.687178 27843 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:43.685451 27816 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.701766 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.707074 27696 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:43.699856 27943 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:43.699131 27840 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:43.699668 27807 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.696818 27812 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.708634 27863 consensus_queue.cc:1048] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:43.709707 27710 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.709861 27778 raft_consensus.cc:3055] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:43.711230 27808 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:43.714188 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.719501 27843 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.691864 27961 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.686009 27910 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.720257 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.724761 27943 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.687774 27846 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.726035 22815 catalog_manager.cc:5028] TS 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): tablet adf5adaae5184191bdaff064d051da2a (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:10:43.726081 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.727626 27859 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.694216 27894 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.715360 27850 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:43.712634 23622 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:43.732355 23080 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:43.732335 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.736552 23076 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:43.701004 27877 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.736922 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.744335 23078 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:43.737237 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.724664 27807 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.728389 27840 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.741120 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.732254 27778 raft_consensus.cc:740] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:43.748162 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:43.748257 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.749150 23080 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
W20260709 13:10:43.757355 27978 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:43.765683 27894 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.769436 27846 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.746973 27747 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:43.774742 27747 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:43.737668 27397 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:43.745414 27850 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.737251 27961 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.737887 27885 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.775651 27747 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.776829 27910 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.789031 27910 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.789505 27910 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.791563 27877 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.792106 27877 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.794111 27877 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:43.795205 27910 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.524993 23072 rpcz_store.cc:276] 0709 13:10:42.251110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.251338 (+   228us) service_pool.cc:224] Handling call
0709 13:10:42.251635 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.251838 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:42.683393 (+431555us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.524144 (+840751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.524209 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:43.524264 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.524350 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.524480 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":348211,"prepare.queue_time_us":234448,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":349260,"thread_start_us":923428,"threads_started":2,"wal-append.queue_time_us":630084}
I20260709 13:10:43.803624 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:43.809341 27679 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.785898 27778 consensus_queue.cc:260] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.785462 27885 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.813287 23072 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:43.808766 27766 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.814309 27766 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.814567 27843 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.815634 23006 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:43.816423 27766 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.808612 27894 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.817217 27894 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.818646 27812 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.819090 27894 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.783562 27961 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.820135 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:43.820868 22929 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:43.822854 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:43.823139 27937 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.679s	user 0.000s	sys 0.013s
I20260709 13:10:43.825542 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:43.825753 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.826071 23072 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.826972 23622 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:43.830111 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.830883 23004 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 15.
I20260709 13:10:43.832031 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.834650 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:43.852854 23003 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:43.862816 27943 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:43.855300 22896 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:43.873350 22999 raft_consensus.cc:1240] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:43.843884 27766 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.839840 27812 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.886380 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.886070 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:43.887425 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 205266us
I20260709 13:10:43.889014 23079 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:43.846590 27843 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:43.889171 23072 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:43.889858 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:43.876128 27656 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:43.890641 22970 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:43.885040 27766 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.886118 27610 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:43.896349 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.899186 27994 consensus_queue.cc:1059] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:10:43.899817 23005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 1082) took 1081 ms. Trace:
I20260709 13:10:43.953063 23005 rpcz_store.cc:276] 0709 13:10:42.818617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.818742 (+   125us) service_pool.cc:224] Handling call
0709 13:10:43.899623 (+1080881us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54003e7e54. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:43.899768 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775101312}
I20260709 13:10:43.888448 27812 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:43.893100 27877 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.945326 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:43.950872 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.951923 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.951519 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:43.895826 27766 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:43.944293 28000 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:43.895299 27835 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:43.895241 27656 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:43.974309 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:43.973495 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:43.960703 23072 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:43.960760 23000 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 15.
I20260709 13:10:43.964529 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:43.961675 27931 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:10:43.967407 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.967535 23654 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:43.965368 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:43.973896 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:43.980647 23655 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.965924 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:43.960011 27812 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.961334 27816 raft_consensus.cc:3055] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:43.959856 27541 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:44.043931 27541 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.044849 27895 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:44.046057 27541 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:43.962325 27852 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:44.046957 27895 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.993578 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:43.943529 27610 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.049582 27610 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:43.985080 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.050602 23649 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:10:44.036873 27923 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:44.052116 27923 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:44.053598 27917 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.005s
I20260709 13:10:44.054121 27923 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.054311 27943 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.054929 27766 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:44.056218 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.056833 23079 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 15.
I20260709 13:10:44.035282 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.060959 27885 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.036755 27962 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.061458 27885 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:44.061715 27962 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:43.979067 27835 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
W20260709 13:10:43.976959 27995 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:10:44.043063 27850 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:44.046702 27852 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:44.001201 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.072918 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:44.073319 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:44.073729 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a934a76e20344681bde221224fb9da0d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:44.074146 22924 raft_consensus.cc:1275] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:44.074388 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:44.074678 22925 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:44.075021 22925 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:44.075045 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:44.060614 27807 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.037458 22931 raft_consensus.cc:1275] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:44.077775 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:44.078176 22928 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:44.076349 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:44.078778 22924 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:44.064559 22895 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.064746 23653 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 17.
I20260709 13:10:43.985338 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:44.066059 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:44.080178 23649 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:44.080199 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 101678us
I20260709 13:10:44.070724 23655 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:44.075937 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:44.079499 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.082566 23648 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 8.
I20260709 13:10:44.089972 27840 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.096568 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:44.097854 22930 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 16: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:44.063525 27885 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.102953 23000 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:44.103998 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:44.104609 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.097358 23079 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.037451 27816 raft_consensus.cc:740] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:44.130793 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:44.106634 23002 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:44.105502 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:44.111488 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:44.063943 27895 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:10:44.140745 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.093396 27692 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:44.127548 22925 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:44.143711 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.153348 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 49680.3us
I20260709 13:10:44.149085 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:44.128360 27397 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:44.099529 27863 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:44.157864 22925 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.129374 27378 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:44.136611 27989 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:44.174121 22895 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:44.139904 27807 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:44.106017 27910 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:44.178205 27910 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:44.182996 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:44.191843 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.129662 27835 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.170341 27863 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.204236 23621 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.216189 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:44.153637 27963 consensus_queue.cc:1059] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:10:44.204336 23079 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:44.227872 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.129320 27656 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:44.233858 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 66537.4us
I20260709 13:10:44.182519 27962 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.186208 27692 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:44.133512 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:44.234747 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.250419 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.206899 27863 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.200778 27840 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:44.248214 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 112880us
I20260709 13:10:44.248257 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:44.260074 23002 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.170626 27397 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.237469 22925 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:44.176981 27378 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.265552 22970 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:44.243398 27857 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:44.183488 27989 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.246171 27520 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.222540 27910 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.273203 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.273681 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:44.249763 27692 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:44.258229 27943 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:44.289762 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.232995 27894 consensus_queue.cc:1059] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:44.268235 27986 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.303591 23079 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:10:44.311584 22896 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.313221 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.314083 23648 raft_consensus.cc:2468] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 7.
I20260709 13:10:44.315189 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.289258 22997 raft_consensus.cc:2368] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:44.243633 27768 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:10:44.318477 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.324236 23074 raft_consensus.cc:2410] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:44.308828 22971 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.280984 27758 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:44.335855 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 118392us
I20260709 13:10:44.288276 27703 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:44.301429 28002 log.cc:927] Time spent T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:10:44.262822 27938 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:10:44.294790 27746 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.297387 27692 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.375834 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:44.373126 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.383536 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.319976 27852 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.282369 27812 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.328505 27766 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.285621 27520 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.404723 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:44.393532 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 84808.6us
I20260709 13:10:44.304759 28008 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:44.293957 27679 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:10:44.348510 28014 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.406353 23648 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
W20260709 13:10:44.409417 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 97948.5us
I20260709 13:10:44.371902 27850 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.348665 28015 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:44.381417 27758 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:44.397954 27839 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:44.428704 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.418754 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:44.419023 23650 raft_consensus.cc:1240] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:44.333772 27986 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.449937 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.414943 28008 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.481904 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:44.423974 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.425117 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.426033 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.428117 23080 raft_consensus.cc:1240] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:44.433539 27534 raft_consensus.cc:3055] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:44.412665 27993 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.414011 22971 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:44.431094 23649 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
W20260709 13:10:44.421216 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.497689 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.435865 23046 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:44.442996 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.456830 23074 raft_consensus.cc:2393] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:44.449465 22926 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:44.492677 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.493234 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:44.494432 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:44.420044 27807 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.528280 27807 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:44.530424 27397 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:44.534929 27520 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:44.536286 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 122346us
I20260709 13:10:44.537190 22971 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.538754 22971 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:44.380630 27703 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.413574 28014 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:44.416224 27679 consensus_queue.cc:1243] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:44.510677 22896 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.519356 28008 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:44.512482 28005 log.cc:927] Time spent T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:10:44.544499 23072 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:44.452003 27766 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:44.555351 23648 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:44.429600 28019 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.507833 23649 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:44.429171 27839 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:44.493655 27534 raft_consensus.cc:740] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:44.625418 28003 log.cc:927] Time spent T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
W20260709 13:10:44.634589 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 123980us
I20260709 13:10:44.638960 23652 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:44.485602 27846 consensus_queue.cc:1048] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:10:44.631145 27843 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:44.652256 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:44.654147 23079 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:44.634075 28012 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.689556 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:44.452361 28015 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.652411 27839 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.652630 28022 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:44.697640 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 261821us
W20260709 13:10:44.650490 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 277379us
W20260709 13:10:44.703075 22895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.003s
W20260709 13:10:44.707376 22895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.003s	sys 0.003s
W20260709 13:10:44.708277 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 534188us
I20260709 13:10:44.635428 27825 consensus_queue.cc:1048] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:10:44.685566 27766 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:44.687170 27894 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:44.711819 22929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.002s
W20260709 13:10:44.719901 22929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.005s	sys 0.003s
I20260709 13:10:44.715327 22895 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.716259 23045 leader_election.cc:400] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:44.548949 27993 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.720923 23045 leader_election.cc:403] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:44.722523 22895 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.726480 23046 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.701789 27843 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:44.700773 28020 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:44.707206 27378 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:44.740243 23076 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 12: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:44.729703 23071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 2511) took 1035 ms. Trace:
I20260709 13:10:44.709393 28022 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:44.756665 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.757212 23046 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
W20260709 13:10:44.757884 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.758697 23046 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.730806 27656 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:44.653198 28019 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.739941 27807 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.737524 27989 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:44.762485 22972 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.689428 27758 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:44.793114 23002 consensus_meta.cc:287] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:10:44.837570 23002 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 16.
I20260709 13:10:44.750303 23071 rpcz_store.cc:276] 0709 13:10:43.693945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.694423 (+   478us) service_pool.cc:224] Handling call
0709 13:10:43.694672 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.714370 (+ 19698us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:43.730597 (+ 16227us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.872224 (+141627us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.872580 (+   356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.872622 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:43.872662 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.425143 (+552481us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b18003be840. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921f1d3f3 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd 000000000038f354 000000000038f199 00007f3921f0083a
0709 13:10:44.729401 (+304258us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5400268254. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500ae01 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6
0709 13:10:44.729472 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.729634 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15634,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":1481,"raft.queue_time_us":8598,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":5586,"spinlock_wait_cycles":57605248,"thread_start_us":122916,"threads_started":1,"wal-append.queue_time_us":115811}
W20260709 13:10:44.803728 28010 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:10:44.804251 27999 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.760s	user 0.008s	sys 0.004s
I20260709 13:10:44.804813 28015 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.713505 27534 consensus_queue.cc:260] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:44.805478 27843 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.699879 28012 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.807379 27530 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:44.874881 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 133669us
I20260709 13:10:44.807474 27993 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:44.728969 27894 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.811347 27879 raft_consensus.cc:2749] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:44.756013 27520 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:44.817695 28017 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:44.818198 27812 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:44.820362 28019 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:44.713680 28014 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.908092 28014 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.908806 28040 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.909480 28040 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.821542 23655 raft_consensus.cc:1217] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[8.9-14.12]   Dedup: 14.12->[]
I20260709 13:10:44.913637 23655 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15. Ops: [8.9-14.12]
I20260709 13:10:44.821758 27986 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:44.763183 27656 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:44.822747 28021 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.914605 27656 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.915805 28021 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.916319 28021 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:44.823203 28028 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:44.826192 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 63777.3us
I20260709 13:10:44.753257 28022 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:44.806244 28006 log.cc:927] Time spent T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
W20260709 13:10:44.873921 27997 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.826s	user 0.007s	sys 0.001s
W20260709 13:10:44.876030 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 337343us
I20260709 13:10:44.889209 22895 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.886554 22896 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:44.836625 28020 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.784946 27378 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
W20260709 13:10:44.918740 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 219226us
W20260709 13:10:44.958365 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.955303 28010 log.cc:927] Time spent T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:10:44.976059 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 217463us
I20260709 13:10:44.976828 23046 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:44.953799 28028 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.977967 23046 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:44.979389 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 90292.3us
I20260709 13:10:44.973311 28040 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:44.982585 22895 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:44.918344 27530 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:44.978849 27879 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.004621 27768 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.027140 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.044860 22927 raft_consensus.cc:2410] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:45.045516 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:45.046020 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.046254 23002 raft_consensus.cc:606] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:45.046768 23002 raft_consensus.cc:614] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:45.027848 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:45.025812 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 139366us
I20260709 13:10:44.984272 28028 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:45.021135 27746 consensus_meta.cc:287] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.000s
I20260709 13:10:45.023710 28025 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:45.021731 28042 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.037230 27692 consensus_meta.cc:287] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:10:45.012231 28021 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.004388 27703 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.011740 27993 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.038180 22922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1096) took 2151 ms. Trace:
I20260709 13:10:45.047909 22999 raft_consensus.cc:1240] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.056370 23000 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:45.056406 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:45.057026 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 74476.9us
I20260709 13:10:45.059058 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.039239 27910 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.044252 27768 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:45.072727 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.073621 28030 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:45.074525 27530 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:45.074928 27863 consensus_meta.cc:287] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.003s
I20260709 13:10:45.067695 28042 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.077664 27894 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.014173 27986 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 13:10:45.070230 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.078896 23001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52166 (request call id 2430) took 1463 ms. Trace:
I20260709 13:10:45.097733 23001 rpcz_store.cc:276] 0709 13:10:43.615293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.615438 (+   145us) service_pool.cc:224] Handling call
0709 13:10:43.615768 (+   330us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:43.633668 (+ 17900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.633712 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:43.642195 (+  8483us) log.cc:844] Serialized 78 byte log entry
0709 13:10:43.889712 (+247517us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:43.889747 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.889804 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.873079 (+983275us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:45.078602 (+205523us) raft_consensus.cc:1685] finished
0709 13:10:45.078630 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.078845 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1115,"raft.queue_time_us":17051,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":4573,"spinlock_wait_cycles":118576000,"thread_start_us":211370,"threads_started":1,"wal-append.queue_time_us":314389}
I20260709 13:10:45.079962 22922 rpcz_store.cc:276] 0709 13:10:42.886401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.886610 (+   209us) service_pool.cc:224] Handling call
0709 13:10:42.924730 (+ 38120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.934920 (+ 10190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.934950 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.979093 (+1044143us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b2c000014c8. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3923903a11 00007f3923913372 00007f3925045a01 00007f392500a43a 00007f392500983e 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2
0709 13:10:43.983931 (+  4838us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.299258 (+315327us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:44.299294 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.299368 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.805696 (+506328us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:45.037958 (+232262us) raft_consensus.cc:1685] finished
0709 13:10:45.037976 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.038097 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9837,"raft.queue_time_us":28352,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4757,"spinlock_wait_cycles":100584960,"thread_start_us":214544,"threads_started":1,"wal-append.queue_time_us":524282}
W20260709 13:10:45.085038 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.063547 27746 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:45.078858 27838 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:45.108906 28037 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.088419 27768 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.120980 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.121147 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.127985 28012 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.118403 27746 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.132746 28039 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:45.133319 28039 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.105566 28030 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:45.100634 27863 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.135878 28030 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.143918 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.146508 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.147135 22922 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:45.082579 27692 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.155395 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.156100 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:45.166285 23072 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 16: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:45.159762 27850 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.160354 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.156402 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.169593 23075 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:45.168884 22922 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:45.147977 27863 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:45.146019 28037 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.138305 27838 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.197824 23006 raft_consensus.cc:2410] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:10:45.198622 28033 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:10:45.200793 27692 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.174000 27850 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:45.206147 28018 log.cc:927] Time spent T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 13:10:45.207249 23657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 1057) took 1015 ms. Trace:
I20260709 13:10:45.207695 23657 rpcz_store.cc:276] 0709 13:10:44.192332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.192855 (+   523us) service_pool.cc:224] Handling call
0709 13:10:44.193138 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.237777 (+ 44639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.237807 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.238246 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.448574 (+210328us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:44.448624 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.448714 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.185794 (+737080us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b4800210b58. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3929f33aa1 00007f3929f2ab37 00007f3929f2a9ca 00007f392a02226f 00007f392a021f37 00007f392a03655c 00007f392a036508 00007f392a036488 00007f392a036443 00007f392a0356ec 00007f3928f5fa96
0709 13:10:45.205651 (+ 19857us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:45.206989 (+  1338us) raft_consensus.cc:1685] finished
0709 13:10:45.207020 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.207179 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14735,"raft.run_cpu_time_us":10967,"raft.run_wall_time_us":973603,"spinlock_wait_cycles":71068288,"thread_start_us":253954,"threads_started":2,"wal-append.queue_time_us":498810}
W20260709 13:10:45.210186 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.242494 28023 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:10:45.244294 23651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 1056) took 1052 ms. Trace:
I20260709 13:10:45.244805 23651 rpcz_store.cc:276] 0709 13:10:44.191903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.192023 (+   120us) service_pool.cc:224] Handling call
0709 13:10:44.192479 (+   456us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:44.251349 (+ 58870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.251381 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:44.284448 (+ 33067us) log.cc:844] Serialized 78 byte log entry
0709 13:10:44.660576 (+376128us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:44.660613 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.660670 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.241883 (+581213us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:45.243913 (+  2030us) raft_consensus.cc:1685] finished
0709 13:10:45.243940 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.244211 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17783,"raft.queue_time_us":11564,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":7894,"spinlock_wait_cycles":40896768,"thread_start_us":347633,"threads_started":2,"wal-append.queue_time_us":469729}
I20260709 13:10:45.241947 27816 consensus_queue.cc:260] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.253192 27816 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:45.263197 22971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.67.196:35811 timed out after 1.704s (SENT) [suppressed 6 similar messages]
I20260709 13:10:45.275326 22930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 2299) took 1183 ms. Trace:
I20260709 13:10:45.275866 22930 rpcz_store.cc:276] 0709 13:10:44.075448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.077563 (+  2115us) service_pool.cc:224] Handling call
0709 13:10:45.258448 (+1180885us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b54002396d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:45.258612 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44594048}
I20260709 13:10:45.279762 27857 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:45.280474 27857 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.284305 27963 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.284794 27963 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:45.285568 27963 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.286863 27963 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.139636 22895 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:45.308882 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 169310us
I20260709 13:10:45.309125 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.309947 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.329840 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:45.339867 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 231712us
I20260709 13:10:45.329802 28019 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.341629 27746 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.315541 27852 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:45.342528 27852 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.343312 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.343928 23078 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:45.345199 27852 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:45.347754 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.352409 23045 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.353188 27879 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:45.353713 27879 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.355175 27857 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:45.356145 27879 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:45.365265 27838 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.366290 28042 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:45.369212 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 50808.4us
W20260709 13:10:45.369565 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 827267us
I20260709 13:10:45.369854 23046 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:45.371477 23621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.371646 27684 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:45.372277 27684 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.372607 27684 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:45.373437 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:45.377506 27839 consensus_meta.cc:287] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.007s
I20260709 13:10:45.377724 23006 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:45.377919 27839 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.378976 23002 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:45.379844 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:45.380538 23006 raft_consensus.cc:2393] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 16: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:45.382799 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.382959 27656 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.384297 27850 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.384737 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.384855 27857 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:45.385313 23080 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:45.385389 27857 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.385722 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.386148 22930 pending_rounds.cc:85] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 7
I20260709 13:10:45.386456 22930 pending_rounds.cc:107] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:45.386719 22930 raft_consensus.cc:2889] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:45.367515 23653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47784 (request call id 1283) took 1403 ms (client timeout 1603 ms). Trace:
I20260709 13:10:45.389534 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.390246 23001 raft_consensus.cc:2393] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:45.390740 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.392098 22931 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:45.392194 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.393352 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:45.394548 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:45.395192 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 132033us
I20260709 13:10:45.396569 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47786 (request call id 1058) took 1204 ms. Trace:
W20260709 13:10:45.388459 23653 rpcz_store.cc:269] 0709 13:10:43.963950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.965761 (+  1811us) service_pool.cc:224] Handling call
0709 13:10:45.367330 (+1401569us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54004c18d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:45.367434 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191594240}
I20260709 13:10:45.398311 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:45.398846 22997 raft_consensus.cc:606] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:45.399178 22997 raft_consensus.cc:614] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:45.399737 23074 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:45.399358 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.401033 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:45.396920 23655 rpcz_store.cc:276] 0709 13:10:44.192670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.192773 (+   103us) service_pool.cc:224] Handling call
0709 13:10:44.821399 (+628626us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:10:44.913989 (+ 92590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.376607 (+462618us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540046e6d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:45.396517 (+ 19910us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1444927360}
I20260709 13:10:45.402007 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.384496 23622 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.397667 27961 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:45.397329 28040 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.412919 23079 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:45.406358 27852 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.402051 28009 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:45.415469 23622 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:45.384756 27962 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:45.411901 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:45.415392 23654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1340) took 1435 ms. Trace:
I20260709 13:10:45.402128 27993 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.436295 23654 rpcz_store.cc:276] 0709 13:10:43.980269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.981661 (+  1392us) service_pool.cc:224] Handling call
0709 13:10:45.371861 (+1390200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.379595 (+  7734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.379617 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.387726 (+  8109us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:45.387769 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.387819 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.415233 (+ 27414us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54004c18d0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f39250098ad 00007f3929fce419 00007f3923545bd4 00007f3923545b62 00007f3923545a91 00007f3923545a0c 00007f3923544cc2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:45.415332 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3196470144}
I20260709 13:10:45.415058 28024 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.422274 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.367405 28022 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:45.497946 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 60636.1us
I20260709 13:10:45.423962 28042 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:45.403132 27710 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:10:45.447989 22931 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.416920 27961 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:45.511754 23002 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:45.495065 27986 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
W20260709 13:10:45.520365 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 231510us
I20260709 13:10:45.511354 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.534474 23003 raft_consensus.cc:2393] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:45.489498 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.503077 27747 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.536684 27747 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.537102 27747 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.538511 28037 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:45.539924 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.541883 27778 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.545289 27747 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.440289 28039 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.502638 28014 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:45.548050 28014 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.550071 28014 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:45.518826 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 100866us
I20260709 13:10:45.551766 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.553102 28041 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:45.553483 28041 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:45.554565 23000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 1105) took 1406 ms. Trace:
I20260709 13:10:45.554955 23000 rpcz_store.cc:276] 0709 13:10:44.148442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.148853 (+   411us) service_pool.cc:224] Handling call
0709 13:10:45.554428 (+1405575us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000bb3d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:45.554516 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073779968}
I20260709 13:10:45.556725 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:45.560441 28013 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:45.560817 28013 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:45.561187 28013 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.565707 22929 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:45.567263 27758 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:45.568377 28014 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:45.569090 28014 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:45.572508 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.573151 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.575016 28014 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:45.435913 27852 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.627923 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.632800 28047 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:45.633375 28047 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:45.635550 28060 log.cc:927] Time spent T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:45.636040 28047 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.629845 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.508882 28009 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.636998 27923 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.638705 28009 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:45.640630 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.641659 27923 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.643730 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.645191 27923 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:45.645313 27747 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:45.646793 27807 consensus_meta.cc:287] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.807s	user 0.011s	sys 0.018s
I20260709 13:10:45.647181 27807 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:45.505234 28042 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.579101 27859 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:10:45.648206 27656 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:45.648885 27857 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:45.649211 28042 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.495806 27962 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.650233 27857 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:45.650703 27684 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.650856 27857 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:45.652280 28058 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:45.652522 27962 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:45.655336 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:45.660607 22931 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:45.661006 22931 pending_rounds.cc:85] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting all ops after (but not including) 9
I20260709 13:10:45.661235 22931 pending_rounds.cc:107] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:45.661456 22931 raft_consensus.cc:2889] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:45.654839 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.666152 23076 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:45.667443 23655 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.580919 27877 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:45.670984 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:45.671720 23655 raft_consensus.cc:2368] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:45.670051 27812 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:45.675058 27768 consensus_meta.cc:287] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.552s	user 0.014s	sys 0.011s
I20260709 13:10:45.674938 27812 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:45.675906 27812 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:45.675683 27768 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.677806 27768 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:45.581095 27986 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.665022 27962 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:10:45.674213 28028 consensus_meta.cc:287] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.614s	user 0.003s	sys 0.020s
I20260709 13:10:45.680848 27852 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:45.680655 28028 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.682300 27684 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:45.682672 28028 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.674247 27857 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:45.683621 27877 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.684099 28022 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.685735 27877 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.652964 27961 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.687754 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.688577 27812 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.660699 27758 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:45.690183 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.690564 27812 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:45.680306 27986 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.692727 22928 raft_consensus.cc:1240] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.688375 28029 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.694392 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.693037 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.694736 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.696893 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.697225 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.688261 27961 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.698598 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:45.700256 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 191556us
I20260709 13:10:45.700335 23622 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.692691 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.701867 23652 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:45.703344 28043 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.704396 28043 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.703474 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:45.703562 23622 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.703815 28026 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.710062 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.709355 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.712322 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.713102 23655 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:45.717113 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.718456 22926 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:45.620019 28013 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.720232 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.722527 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:45.723016 22925 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.720466 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.724596 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.709335 27852 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.728931 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.731062 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.733163 22925 raft_consensus.cc:2468] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 15.
I20260709 13:10:45.710939 28014 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.736819 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:45.738447 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.742187 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.744838 27696 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:45.745234 27696 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:45.745955 27696 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.746906 27696 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.747991 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:45.748536 22923 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:45.739609 23656 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
W20260709 13:10:45.750275 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.753386 27807 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:45.753930 27807 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:45.754457 28057 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 13:10:45.756019 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:45.756057 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 91917.1us
I20260709 13:10:45.756999 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.757550 22895 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:45.756990 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.759260 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:45.708248 27857 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:10:45.761922 22895 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.756923 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.767031 23652 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:45.757684 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:45.770588 23653 raft_consensus.cc:2376] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12. Re-sending same reply.
I20260709 13:10:45.763521 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.765386 27778 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:45.765468 27943 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:45.762229 27927 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:45.762306 28020 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:10:45.803511 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
W20260709 13:10:45.771529 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.771950 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:45.776645 23648 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:45.787135 22997 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:45.792258 23622 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.806501 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.804563 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:45.808036 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:45.808907 23001 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:45.798516 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.812242 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:45.816464 23003 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:45.807144 22896 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.699527 28029 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.766611 27895 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:45.766726 27746 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:45.716707 28026 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.786909 27843 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:45.837529 27229 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.837958 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.843385 27229 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:45.843794 27229 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:45.844156 27229 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.801775 27927 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:45.843883 22896 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.820978 27692 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:45.848994 22922 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:45.848939 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:45.852020 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.852401 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.852833 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.854031 22923 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:45.855796 27229 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.858482 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.826105 23622 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.861016 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:45.864620 22896 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:45.825413 27807 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:45.839360 27923 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.874403 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.874909 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.874965 23652 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
W20260709 13:10:45.872907 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 46898.9us
I20260709 13:10:45.875990 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.876039 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.873710 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.837241 28042 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:45.875077 27229 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:45.877890 23650 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:45.877139 23622 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.883677 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.883858 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.878386 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:45.884935 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.885444 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:45.886196 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:45.839744 27895 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.884219 23650 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:45.888119 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.860730 28019 raft_consensus.cc:2764] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:45.895895 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:45.896389 27229 consensus_queue.cc:1059] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:45.896987 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.900374 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:45.913290 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.845597 27747 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:45.882540 28024 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.864962 28054 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.857824 27843 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.845700 27746 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.881568 28040 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.916544 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.893733 27895 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.889547 28044 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.925721 22931 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:10:45.924515 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:45.927148 23079 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
W20260709 13:10:45.929672 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.886551 27806 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.913200 27812 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.950256 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:45.950323 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 96770.7us
I20260709 13:10:45.952495 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:45.926105 27719 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.953685 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:45.922904 27656 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:45.953102 23078 raft_consensus.cc:2376] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11. Re-sending same reply.
I20260709 13:10:45.912988 27850 consensus_queue.cc:1059] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:45.890069 28042 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:45.967013 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 70429.4us
I20260709 13:10:45.977026 23078 raft_consensus.cc:1240] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.913427 27927 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:45.923729 28024 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:45.988633 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:45.989614 23077 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 12: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:10:45.992942 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.003849 27852 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.005380 23657 raft_consensus.cc:2410] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:45.975006 27656 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:46.016799 23076 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:46.018546 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:46.023548 28073 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:10:46.030167 27746 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:46.031672 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.032490 27843 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:46.034402 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:46.016993 27850 raft_consensus.cc:3055] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:10:46.039448 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 56662.5us
I20260709 13:10:46.019912 27927 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.042506 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.044272 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:46.049108 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 242675us
W20260709 13:10:46.037240 28071 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:10:46.048480 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.045115 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:46.040606 27850 raft_consensus.cc:740] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:46.050947 28056 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:46.052459 23620 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.052886 22971 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.054839 22971 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
W20260709 13:10:46.055781 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 123496us
I20260709 13:10:46.058295 23620 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.061131 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.062244 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.064685 23620 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.053655 27962 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.068063 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.071187 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.072000 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.066192 28040 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:46.064759 28054 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.064424 27852 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:46.059901 27746 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.084594 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.083276 22896 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.086846 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.069774 28016 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.069986 28011 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:46.092080 27768 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:46.092919 27768 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.090373 23620 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.073191 27719 consensus_queue.cc:1059] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:10:46.097209 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.097657 27895 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.098559 28078 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:46.099102 28078 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.083019 27850 consensus_queue.cc:260] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.100366 27857 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:46.082401 28040 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:46.100819 27857 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.101186 28078 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:46.101831 28085 log.cc:927] Time spent T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:10:46.102062 27719 raft_consensus.cc:3055] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:46.102480 27719 raft_consensus.cc:740] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:46.103297 27719 consensus_queue.cc:260] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.104516 27719 raft_consensus.cc:3060] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.106357 27895 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:46.084136 27962 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:46.083765 28082 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:46.108484 27923 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.109014 27923 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:46.109841 27923 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.082911 28092 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:46.114378 28042 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.098093 28081 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.115056 28081 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.117187 28081 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.117529 28013 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.119024 27835 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.100517 27850 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.119525 27835 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.101140 28040 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.125258 22925 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.125851 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:46.126724 23074 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:10:46.127547 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.101241 27857 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.112527 28092 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:46.131407 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.131745 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.133127 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:46.142730 23006 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 16: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:46.142858 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:46.148002 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:46.148594 23003 raft_consensus.cc:3060] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.091729 28048 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:10:46.153168 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.153223 23006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:46.156073 23076 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:46.130081 28016 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.159413 22970 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.145584 28078 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:46.162748 28044 raft_consensus.cc:2749] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.167904 28092 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.180553 27812 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.183436 28098 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.192034 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.193739 23072 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:46.158535 27746 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:10:46.173138 28078 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.203603 28078 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.205214 28016 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:46.197813 28098 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.210003 23003 raft_consensus.cc:2468] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:46.173760 27835 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:46.208268 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 117983us
I20260709 13:10:46.211266 23620 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:46.214500 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.218403 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.218665 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.219264 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.216311 27806 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:46.224859 23649 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:10:46.220355 27936 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.207161 28041 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.244626 27943 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:46.245117 27943 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.234582 27806 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:46.247984 27961 consensus_meta.cc:287] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.004s
I20260709 13:10:46.238188 27936 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.250500 28041 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.260702 28098 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.261868 28024 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.265075 28026 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:46.265729 28040 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.268091 28040 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:46.271589 28029 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:46.277995 28087 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 13:10:46.279132 28078 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.280036 28043 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:46.281121 28078 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:46.312139 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 225102us
I20260709 13:10:46.314590 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:46.328007 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.333082 22929 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 16.
I20260709 13:10:46.333348 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.337301 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40876
I20260709 13:10:46.339017 22931 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:46.340783 23006 raft_consensus.cc:606] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.341481 23006 raft_consensus.cc:614] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:46.348342 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.349639 23002 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 14: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:46.352545 22999 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:46.369839 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.371033 22925 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:46.373202 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:46.374264 23072 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:46.377128 22894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.377055 22970 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.377079 22928 raft_consensus.cc:606] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Received request to transfer leadership
W20260709 13:10:46.379213 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.381672 22970 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.387706 23004 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:46.389295 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.389335 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.390390 22924 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:46.391906 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.392791 23045 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.376983 22972 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.396591 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40876
I20260709 13:10:46.397285 22924 raft_consensus.cc:606] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Received request to transfer leadership
I20260709 13:10:46.398080 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:46.398764 23080 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.399222 23046 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.401196 22971 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.404208 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.405071 23076 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:46.406710 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:46.415109 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.416330 23003 raft_consensus.cc:2410] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:46.419186 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.420719 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.422075 27696 consensus_queue.cc:1059] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:46.424188 27378 raft_consensus.cc:2804] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:46.424310 27679 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.424602 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.424853 27378 raft_consensus.cc:697] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:46.425109 27679 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.426445 27378 consensus_queue.cc:237] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.428402 27534 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.428722 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.428562 27684 raft_consensus.cc:2804] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:46.429899 23652 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:46.424806 27696 consensus_queue.cc:1059] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:10:46.440325 28015 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.441154 28015 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.445550 27936 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:46.452991 22816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 44226.6us
W20260709 13:10:46.458746 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.462659 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:46.463431 23657 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.464573 27679 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.466406 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.468197 27994 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:46.468695 27994 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:46.470016 27994 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.470901 27839 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:46.471246 28079 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.471788 28079 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.472252 28079 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.476475 27961 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.478094 27696 raft_consensus.cc:3055] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.478564 27696 raft_consensus.cc:740] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:46.479883 27684 raft_consensus.cc:697] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:46.480031 27696 consensus_queue.cc:260] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.480955 27835 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:46.481662 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 45481.4us
I20260709 13:10:46.481437 27684 consensus_queue.cc:237] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.485163 23652 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:46.485504 27807 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:46.487079 27816 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:46.487528 27816 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:46.489349 22929 raft_consensus.cc:1240] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:46.488839 27816 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.490253 27816 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.493637 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.465919 27806 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:46.497608 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.498615 23045 leader_election.cc:400] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:46.500142 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:46.501431 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.502332 23078 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:46.502511 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.505071 27656 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.506804 27656 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.507119 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:46.458431 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.508581 23652 raft_consensus.cc:1240] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:46.520088 22896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.522984 23080 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:46.531499 23072 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
W20260709 13:10:46.524228 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 120542us
I20260709 13:10:46.471582 27994 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.527803 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.470955 28020 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.548031 23656 raft_consensus.cc:1240] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:46.551774 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.553557 22896 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.555205 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.555990 27778 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.542615 28015 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:46.563177 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.565459 28053 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:46.566679 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 190050us
I20260709 13:10:46.568120 22927 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:46.568415 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.568569 22925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40876
I20260709 13:10:46.569159 22925 raft_consensus.cc:606] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Received request to transfer leadership
I20260709 13:10:46.569429 27835 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:46.570537 27835 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.573593 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.574306 23003 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:46.533296 27839 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:46.575775 22970 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.576753 22970 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.578428 28078 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:46.578791 28078 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.579099 28078 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.580029 27758 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:46.580613 27758 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:46.580575 27857 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.581777 27758 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.583186 23657 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:46.583433 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:46.583962 28047 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:46.584558 27679 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:46.585209 27679 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.585708 28047 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.586319 28047 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.587284 27679 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.588811 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.589949 27895 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.590497 27895 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.589763 28048 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:46.582882 27857 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.597859 23045 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:46.599212 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 58645.6us
I20260709 13:10:46.600838 28112 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.601480 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:46.602252 23650 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 9.
I20260709 13:10:46.602550 27541 raft_consensus.cc:2764] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:10:46.605293 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:46.605819 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 50749.7us
I20260709 13:10:46.606549 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.606702 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:46.607378 23652 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.607973 28019 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.608733 28019 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:46.610857 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:46.599550 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.617146 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 2320) took 1198 ms. Trace:
I20260709 13:10:46.617668 22927 rpcz_store.cc:276] 0709 13:10:45.418498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.422005 (+  3507us) service_pool.cc:224] Handling call
0709 13:10:46.616925 (+1194920us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002a7954. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:46.617074 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445575552}
I20260709 13:10:46.544116 27923 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.621039 27696 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.612085 23621 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.631713 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.633549 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:46.635449 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.644276 28036 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:46.650138 27895 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.645092 28036 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:46.652833 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.656096 28109 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.657459 28109 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:46.667105 27857 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.667766 27857 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.669780 27857 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:46.670034 28036 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.676334 28047 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.683373 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:46.694661 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 80880us
I20260709 13:10:46.697799 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:46.698086 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 98673.6us
I20260709 13:10:46.699098 28041 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:46.700083 22927 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 14: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:46.699983 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.701804 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.702517 23072 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:46.706331 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.707526 27807 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:46.709095 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.710036 28036 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:46.710501 28036 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:46.710567 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.711032 28036 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.717418 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.709053 27994 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.725289 27778 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:46.695782 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:46.728814 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 116816us
I20260709 13:10:46.726073 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:46.752074 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.757385 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.759243 27816 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:46.759702 27816 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.760071 27816 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.759970 28041 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:46.761018 28041 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.764326 27963 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.765857 28041 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:46.774015 22827 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.774659 28036 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:46.776361 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 50426us
I20260709 13:10:46.776521 22827 catalog_manager.cc:5697] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 6 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 8 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:46.778209 22897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.788826 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:46.779466 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.784047 27807 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:46.798326 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 87917.7us
I20260709 13:10:46.800496 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:46.832166 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 114837us
I20260709 13:10:46.833181 23621 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.838979 23650 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:46.805064 27895 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:46.835856 27806 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.850935 27692 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:46.851179 27943 consensus_meta.cc:287] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.008s
W20260709 13:10:46.859860 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.859850 23653 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.860669 27807 consensus_queue.cc:1059] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:46.861725 28026 raft_consensus.cc:3055] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:46.862212 28026 raft_consensus.cc:740] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:46.861948 27943 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.863200 28026 consensus_queue.cc:260] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.864457 27943 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:46.865288 22999 raft_consensus.cc:1240] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:46.864553 28026 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.866349 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:46.861826 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 82445.7us
I20260709 13:10:46.847929 28011 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:46.870432 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:46.857120 27692 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.878042 22896 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.882606 23003 raft_consensus.cc:606] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.882200 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:46.884965 28008 raft_consensus.cc:2764] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:46.856323 28020 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:10:46.880048 27692 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:46.892632 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 52653.2us
I20260709 13:10:46.895934 28043 consensus_queue.cc:1059] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:46.899978 28008 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:46.890897 27807 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.913094 23652 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:46.882200 28036 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.916682 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.886612 27895 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:46.918399 23046 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.912602 27807 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.927723 28008 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.929993 28008 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:46.930932 28078 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.934917 27378 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:46.936046 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:46.924185 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 46212.6us
I20260709 13:10:46.924813 27807 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:46.942674 28121 log.cc:927] Time spent T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:10:46.943842 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.946669 27879 raft_consensus.cc:3055] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:46.947158 27879 raft_consensus.cc:740] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:46.948165 27879 consensus_queue.cc:260] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.950176 27684 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:46.952431 27816 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.954421 28079 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:46.955556 23006 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 15: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:46.956569 28079 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:46.956753 27816 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:46.944613 27378 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.957577 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:46.958189 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45832.8us
I20260709 13:10:46.962196 27378 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:46.964619 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45253.5us
I20260709 13:10:46.965310 23003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:46.959771 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.949442 27879 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.961238 23002 raft_consensus.cc:2393] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 12: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:46.968483 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.970871 22923 raft_consensus.cc:2393] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:46.965977 23003 raft_consensus.cc:606] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:46.975749 28007 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.970007 27895 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:46.976356 28007 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:46.976660 27684 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.978544 28043 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:46.981822 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.981751 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:46.983939 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:46.991616 22923 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:46.980105 27895 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:46.996088 22972 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.997203 22972 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:46.992796 22925 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:46.998509 22895 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:46.998872 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
W20260709 13:10:47.001634 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 44200.6us
I20260709 13:10:46.999776 23078 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:47.016129 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:46.999357 27895 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.005934 28079 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:47.021248 22925 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 14: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:47.004671 27835 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:47.021876 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:47.022137 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:47.022707 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:47.030200 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 50208.5us
I20260709 13:10:47.024674 22896 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.026166 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.017643 27778 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:47.021934 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:47.038220 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.041376 22925 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.005285 28043 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.040177 27778 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.044160 28029 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:47.038470 28078 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.052753 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:47.047591 27778 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.055521 22827 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 10 to 11, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 11 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.036226 27692 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:47.061055 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 52121.6us
I20260709 13:10:47.062028 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:47.063961 22895 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:47.063560 27684 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:47.050228 27807 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.067869 27684 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:47.071786 27684 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.071874 27656 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:47.070418 22896 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.079294 23074 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 15: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:47.075166 27656 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:47.081521 27534 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:47.087332 28043 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:47.084028 27656 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.088584 28007 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.099684 22928 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 16.
I20260709 13:10:47.109946 23071 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:47.116042 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:47.122753 22877 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:10:47.123180 22877 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5adc1058fd2948e382bcd0ee2213ab3a already in progress
W20260709 13:10:47.123435 22877 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5adc1058fd2948e382bcd0ee2213ab3a already in progress
I20260709 13:10:47.129452 28007 raft_consensus.cc:2764] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:10:47.129885 28126 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:10:47.129452 28127 log.cc:927] Time spent T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:10:47.140044 28030 consensus_queue.cc:1059] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:10:47.140079 27692 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.148039 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:47.143510 28030 raft_consensus.cc:3055] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:47.146983 27807 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:47.160028 22896 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.160753 28029 consensus_queue.cc:1059] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:47.161844 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 245208us
W20260709 13:10:47.165983 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.164523 27963 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.151235 28030 raft_consensus.cc:740] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:47.153414 28043 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:47.166558 28129 log.cc:927] Time spent T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:10:47.173700 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 103281us
I20260709 13:10:47.173476 28030 consensus_queue.cc:260] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.183842 28030 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.184603 28048 raft_consensus.cc:993] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:47.185108 28048 raft_consensus.cc:1081] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:47.188889 27923 consensus_queue.cc:1059] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:47.190006 23652 raft_consensus.cc:1240] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:47.192032 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:47.192651 23656 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:47.187017 22929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:10:47.194119 22929 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.194346 23073 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:47.194463 22929 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.192044 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:47.197589 23657 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:47.199419 27812 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.200024 27812 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.192670 23074 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:47.176220 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:47.204541 27378 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.207147 28021 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:47.207747 28021 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:47.208832 27812 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.208664 28021 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.191499 27923 raft_consensus.cc:3055] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:47.217025 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:47.221596 23072 raft_consensus.cc:2410] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:47.222142 27679 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.159557 27778 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.211970 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:47.224296 23071 raft_consensus.cc:3060] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.234464 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:47.237804 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 77848.8us
I20260709 13:10:47.240227 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:47.243485 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.243774 27679 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.245124 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.245858 23005 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 15: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:47.236871 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:47.246902 22925 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:47.247164 22928 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:47.247964 22972 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:47.223940 27923 raft_consensus.cc:740] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:47.249517 22923 raft_consensus.cc:3060] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.241420 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:47.239943 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:47.251621 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 75452.4us
I20260709 13:10:47.252599 23003 raft_consensus.cc:2393] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 16: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:47.252470 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:47.256246 27684 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.256516 27923 consensus_queue.cc:260] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.261577 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:47.229621 27812 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.244303 27850 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:10:47.258261 23002 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:47.266629 22923 raft_consensus.cc:2468] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:47.268178 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.251063 28026 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.241528 28011 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.274996 27692 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.274861 28011 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.272137 23001 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.275529 27692 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.276985 28011 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.277667 27692 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.278538 27778 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.257819 27943 raft_consensus.cc:2804] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:47.260336 28029 raft_consensus.cc:993] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:10:47.279747 27943 raft_consensus.cc:697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:47.280134 28029 raft_consensus.cc:1081] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:10:47.280938 27943 consensus_queue.cc:237] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.281352 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:47.282179 22997 raft_consensus.cc:2393] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 9: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:47.283108 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:47.283735 23653 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.268570 28053 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:47.285295 28053 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:47.286128 28053 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.290794 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:47.291280 22931 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 16.
I20260709 13:10:47.272786 23071 raft_consensus.cc:2468] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:47.274266 27679 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.293358 22972 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:47.295277 23653 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:47.266477 28047 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:47.297160 28026 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.299240 23001 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:47.269448 27378 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:47.310443 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:47.288626 27812 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.304033 27656 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.318951 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:47.303326 27758 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:47.320287 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:47.320672 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.321730 23074 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 16.
I20260709 13:10:47.315979 27923 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.300211 28078 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:47.324234 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:47.318441 28043 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:47.323354 27758 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.328714 27758 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.333400 27378 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:47.333806 27378 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:47.334177 27378 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.325989 27879 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.336627 28043 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:47.337098 28043 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.303045 27835 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:10:47.342895 27684 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.346416 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:47.347049 23072 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:47.347271 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:47.348102 23077 raft_consensus.cc:2393] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 12: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:47.349174 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:47.350101 23078 raft_consensus.cc:2368] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15.
W20260709 13:10:47.350988 23619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.352258 22972 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.354415 27812 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.309378 27895 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.354926 27378 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.356431 27895 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.357262 22927 raft_consensus.cc:1240] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:47.324079 27656 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.360443 28079 raft_consensus.cc:2804] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:47.360971 28079 raft_consensus.cc:697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:47.361845 28079 consensus_queue.cc:237] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.366384 27534 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:47.366752 27534 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:47.368532 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:47.369297 27778 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.369812 27778 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.373353 27778 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.373713 22827 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 9 to 10, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:47.374894 27656 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.375610 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:47.375866 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:47.377739 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.378480 22925 raft_consensus.cc:2393] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 15: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:47.367543 27534 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.379443 27534 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.379431 22827 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:47.381510 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.397153 22923 raft_consensus.cc:2368] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:47.382277 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.387055 23657 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.396622 22929 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.402281 22997 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:47.403514 27758 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.407940 22929 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.418913 27816 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:47.420773 22826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 260) took 16052 ms (client timeout 15000 ms). Trace:
I20260709 13:10:47.416558 23657 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:47.429790 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.431224 27806 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:47.432061 23620 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.432906 27806 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:47.438319 27378 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:47.439858 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:47.441363 27963 consensus_queue.cc:1059] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:47.442065 27963 consensus_queue.cc:1243] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 0db2f61e34a24096a5baf0de9a32d4f7 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:47.442536 27963 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:47.442857 27963 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:47.444003 23078 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:47.443599 27963 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.444721 27963 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.450941 28007 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:47.453675 23046 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:47.459689 23046 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:47.465812 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.498611 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.499430 22928 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:47.508281 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 76326.5us
I20260709 13:10:47.511974 23046 leader_election.cc:400] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:47.512378 23046 leader_election.cc:403] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:10:47.513553 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 186949us
I20260709 13:10:47.515964 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:47.516656 23657 raft_consensus.cc:2393] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:47.516216 22896 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:47.497045 27378 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:47.497491 27879 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:47.549789 23074 raft_consensus.cc:1240] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:47.510049 28008 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.552363 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:47.552467 22895 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:47.554564 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.551321 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:47.563804 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:47.565379 23075 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:47.568620 23076 raft_consensus.cc:2393] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 12: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:47.569677 22929 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:47.571964 22895 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.573378 23657 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:47.576220 23651 raft_consensus.cc:1275] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 13:10:47.576649 23651 pending_rounds.cc:85] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 13
I20260709 13:10:47.580382 28043 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.581816 22827 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 5 to 6, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 6 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.583882 23653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:10:47.584379 23653 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:10:47.421173 22826 rpcz_store.cc:269] 0709 13:10:31.368749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.368964 (+   215us) service_pool.cc:224] Handling call
0709 13:10:47.420550 (+16051586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:43.314259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:43.315016 (+   757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:43.315068 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:10:43.315099 (+    31us) tablet.cc:662] Decoding operations
0709 13:10:43.337841 (+ 22742us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:43.337905 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:43.337933 (+    28us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:10:43.340266 (+  2333us) tablet.cc:701] Row locks acquired
0709 13:10:43.340282 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:10:43.340426 (+   144us) write_op.cc:270] Start()
0709 13:10:43.340532 (+   106us) write_op.cc:276] Timestamp: P: 1783602643340381 usec, L: 0
0709 13:10:43.340546 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:10:43.344475 (+  3929us) log.cc:844] Serialized 11825 byte log entry
0709 13:10:43.759146 (+414671us) op_driver.cc:464] REPLICATION: finished
0709 13:10:43.953214 (+194068us) write_op.cc:301] APPLY: starting
0709 13:10:43.959802 (+  6588us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:45.075431 (+1115629us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:45.075520 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:45.642972 (+567452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:45.643424 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:10:45.643478 (+    54us) write_op.cc:312] APPLY: finished
0709 13:10:45.691115 (+ 47637us) log.cc:844] Serialized 260 byte log entry
0709 13:10:45.864525 (+173410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:45.894092 (+ 29567us) write_op.cc:454] Released schema lock
0709 13:10:45.912947 (+ 18855us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:45.965423 (+ 52476us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:45.967408 (+  1985us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3061322,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":136646,"apply.run_cpu_time_us":84739,"apply.run_wall_time_us":1989498,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129887,"num_ops":30,"prepare.queue_time_us":436572,"prepare.run_cpu_time_us":41298,"prepare.run_wall_time_us":86294,"raft.queue_time_us":262201,"raft.run_cpu_time_us":20759,"raft.run_wall_time_us":114933,"replication_time_us":405204,"thread_start_us":726120,"threads_started":5,"wal-append.queue_time_us":344241,"wal-append.run_cpu_time_us":22403,"wal-append.run_wall_time_us":2329107}]]}
I20260709 13:10:47.584725 23653 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.575239 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aadad04f3914b6998492885aaba04f6" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.586958 22928 raft_consensus.cc:2468] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 17.
I20260709 13:10:47.588765 22972 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:47.589643 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:47.590274 22895 leader_election.cc:400] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15.
I20260709 13:10:47.590572 22895 leader_election.cc:403] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.591709 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:47.595609 23620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.597611 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:47.601780 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:47.598387 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.598804 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.603075 22928 raft_consensus.cc:2393] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 10: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:47.600502 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:47.576890 23651 pending_rounds.cc:107] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 13:10:47.570180 28029 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:47.604956 23651 raft_consensus.cc:2889] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:47.605978 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:47.608712 23652 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.571496 27378 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:47.557411 28044 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:10:47.585711 27692 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:47.592139 27807 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:47.625332 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.632782 23000 raft_consensus.cc:3055] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:47.633167 23000 raft_consensus.cc:740] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:47.604573 28021 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219) with higher term. Message: Invalid argument: T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15.
I20260709 13:10:47.629137 23653 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.606555 28048 raft_consensus.cc:2804] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:47.604816 27758 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.640667 23650 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:47.642663 23653 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.631583 27692 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.629923 28029 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:47.673841 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:47.675535 28078 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.676111 28078 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.680356 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:47.669641 23000 consensus_queue.cc:260] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.681638 22924 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
W20260709 13:10:47.670980 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 74301.5us
I20260709 13:10:47.653205 27692 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.692476 22999 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.705894 22972 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:47.698654 27679 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:47.718502 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
W20260709 13:10:47.719494 28138 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:10:47.720301 28139 log.cc:927] Time spent T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:10:47.720865 27923 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.723985 28029 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.727696 28134 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:47.651933 28148 consensus_queue.cc:1059] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:10:47.728906 28078 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:47.732302 27378 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.737511 28053 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:47.716631 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:47.717111 28125 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.736s	user 0.005s	sys 0.003s
I20260709 13:10:47.759613 27778 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.797480 22997 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:47.819521 23652 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 16.
I20260709 13:10:47.785997 27807 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:47.791967 28053 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.823814 22925 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:47.787775 27923 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.807943 28148 raft_consensus.cc:3055] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:47.813076 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 130529us
I20260709 13:10:47.833658 28148 raft_consensus.cc:740] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:47.844044 28148 consensus_queue.cc:260] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.844995 22924 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:47.845620 28148 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.828027 28053 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.856650 23655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47800 (request call id 1381) took 1176 ms. Trace:
I20260709 13:10:47.835408 27807 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:47.862140 28078 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:47.800946 27778 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.889369 22924 raft_consensus.cc:1240] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:47.857126 23655 rpcz_store.cc:276] 0709 13:10:46.680015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.694001 (+ 13986us) service_pool.cc:224] Handling call
0709 13:10:46.694353 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.771759 (+ 77406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.771790 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.772307 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.882649 (+110342us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:46.907390 (+ 24741us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.907688 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.907789 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.964242 (+ 56453us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18004a64a0. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f392ade5de1 00007f392adf25b1 00007f3921e97c0a 00007f392b5d7219 00007f3928ede58f 00007f3921f1d571 00007f3921f1f7c1 00007f3921f1f779 00007f3921f1f709 00007f3921f1f6d1 00007f3921f1e9cd
0709 13:10:47.589609 (+625367us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921e43c85 00007f3921e446a2 00007f3924bb61db 00007f3924bb1aaf 00007f3924ba586e 00007f3924ba4bb6 00007f3924ba47d8 00007f3924bae221 00007f3924bae1d9 00007f3924bae169
0709 13:10:47.856355 (+266746us) raft_consensus.cc:1685] finished
0709 13:10:47.856383 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.856563 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50986,"prepare.queue_time_us":24492,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":53043,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":38091,"spinlock_wait_cycles":12324480,"thread_start_us":110001,"threads_started":1,"wal-append.queue_time_us":189171}
I20260709 13:10:47.878446 27895 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.894742 22972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.899111 27778 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.902101 28043 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:47.900303 27895 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.948483 22895 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:47.964716 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:47.965416 22924 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:47.965719 22924 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:47.966451 22924 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.970055 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:47.970667 23071 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.972107 22924 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.983538 23071 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:47.986768 28109 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.987569 28109 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:47.968694 27923 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.000695 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.001530 23072 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
W20260709 13:10:47.996366 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 315055us
I20260709 13:10:48.004154 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.004870 23072 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:47.994194 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:48.008009 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:47.985474 28048 raft_consensus.cc:697] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:48.016561 23657 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:47.995247 27857 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.019076 23071 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:48.020413 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:48.022426 23080 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:48.022686 23657 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:48.023789 28037 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:47.996891 27541 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:47.974372 27378 consensus_queue.cc:1048] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:10:48.027789 22971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.025803 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:48.026661 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:48.029273 23657 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 14: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:48.024365 28037 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.033353 28159 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:48.034639 23076 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:48.034911 28159 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.035264 28037 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:48.044764 28109 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:48.046025 28048 consensus_queue.cc:237] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:48.001138 27895 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:48.015117 28043 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:48.054982 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:48.056747 22999 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
W20260709 13:10:48.056704 22895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.061177 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:48.063553 23006 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:48.066807 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.070186 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:48.071091 23002 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:48.084407 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:48.059070 27806 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:48.070120 28011 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:48.079006 27812 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.028600 27857 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.076330 28043 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:10:48.170707 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 176598us
I20260709 13:10:48.051306 27541 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:48.173568 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 95600.9us
I20260709 13:10:48.102922 27806 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:10:48.186576 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 103703us
I20260709 13:10:48.186569 27806 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:48.196080 22896 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:48.198772 28136 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:48.210016 22895 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:48.211803 28171 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:48.212222 28171 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:48.212586 28171 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.212529 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.213744 22923 raft_consensus.cc:2393] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 14: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:48.215183 22929 raft_consensus.cc:1275] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:10:48.220355 28165 log.cc:927] Time spent T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:48.220445 27378 consensus_queue.cc:1048] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:48.221405 28030 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:48.222904 28030 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:48.199364 28136 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.225826 28136 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:48.226338 27857 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.201454 28044 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.227313 28044 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.229228 28044 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:48.229916 28043 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:48.231079 27541 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.238442 22924 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
W20260709 13:10:48.240139 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 44499.9us
I20260709 13:10:48.240705 22896 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:48.242599 23651 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:48.262068 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.262833 23076 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:48.268162 22895 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:48.244036 28134 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:48.263033 27895 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:48.197947 28053 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:48.235502 27692 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:48.317811 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 49761.6us
I20260709 13:10:48.302731 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
W20260709 13:10:48.281127 28166 log.cc:927] Time spent T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:48.342090 22927 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:48.376843 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 306000us
I20260709 13:10:48.300601 28169 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.314945 28053 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.332028 28146 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.286166 27807 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:48.384780 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 191626us
I20260709 13:10:48.394711 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:48.283944 27895 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:48.274721 28136 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:10:48.343832 27656 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:48.281481 27806 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.331926 27378 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.284296 27778 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:10:48.401616 28136 consensus_queue.cc:1243] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer 01988c2c817947859340a730b7f1247d log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:48.405802 27656 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.413569 27656 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.420605 22925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49902 (request call id 2355) took 1038 ms. Trace:
I20260709 13:10:48.429226 23000 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.430109 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.431048 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.431862 28185 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.432577 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.432512 28185 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.433322 23074 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:48.424276 22925 rpcz_store.cc:276] 0709 13:10:47.381991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.382093 (+   102us) service_pool.cc:224] Handling call
0709 13:10:48.420416 (+1038323us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54002a30d4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:48.420533 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793538816}
I20260709 13:10:48.435298 28185 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.435896 23005 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:48.437294 27541 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.432246 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.438907 23622 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:48.453218 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:48.486603 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 47775us
I20260709 13:10:48.453317 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.458194 23000 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 16.
I20260709 13:10:48.462934 28173 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.464308 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:48.465621 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 53708.3us
I20260709 13:10:48.499212 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:48.419612 28148 consensus_meta.cc:287] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 13:10:48.469450 23046 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:10:48.488029 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.486068 22997 raft_consensus.cc:2368] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 14. Current term is 15.
I20260709 13:10:48.489413 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.489331 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.502166 22923 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:48.485193 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.476584 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:48.503568 23071 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.492605 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.493634 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:48.510195 23652 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:48.494349 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.495365 23649 pending_rounds.cc:85] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 9
I20260709 13:10:48.511749 23649 pending_rounds.cc:107] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:48.512080 23649 raft_consensus.cc:2889] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:48.510556 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50676.7us
I20260709 13:10:48.522557 23071 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:48.395732 28169 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:48.532274 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 46743.8us
I20260709 13:10:48.464079 28149 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.527807 22970 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:48.537561 23077 raft_consensus.cc:1275] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:48.523049 27541 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.541141 27541 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.543458 28169 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:48.544442 23078 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:48.484953 28160 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:48.545686 28160 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:48.546128 28160 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:48.548146 28182 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:10:48.497318 28026 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:10:48.425575 28036 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:10:48.401007 28146 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.566638 22970 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:48.529647 28167 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:48.448778 27378 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.563582 27684 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:48.586035 22926 raft_consensus.cc:1275] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:48.570878 28145 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:48.574723 28037 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:48.529899 28173 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.556941 28149 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:48.583598 28167 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:48.591485 27895 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.617506 22931 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:48.598348 28037 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.597198 27684 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:48.629289 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:48.599529 27692 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.642184 23651 raft_consensus.cc:2393] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 10: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
W20260709 13:10:48.645820 28183 log.cc:927] Time spent T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:48.610771 28145 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:48.697095 27923 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:48.697786 27923 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.712950 27806 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.631238 28037 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.765863 27684 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.769626 28145 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.720366 28167 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.786329 27806 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:48.787076 27806 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:48.792693 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 226109us
W20260709 13:10:48.794514 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 322704us
I20260709 13:10:48.796077 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:48.793673 23622 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:48.803436 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:48.811057 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 112935us
W20260709 13:10:48.809787 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 340595us
W20260709 13:10:48.802678 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 273583us
W20260709 13:10:48.824468 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 325331us
I20260709 13:10:48.827083 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:48.828043 23652 raft_consensus.cc:2393] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:48.794816 28048 raft_consensus.cc:2804] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:48.845508 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:48.834420 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:48.841768 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.800490 27812 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.844146 22924 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:48.848343 22923 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:48.846074 23078 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.843748 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:48.850957 27923 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.808066 27857 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.857371 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:48.861809 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:48.862159 22929 raft_consensus.cc:3060] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.862591 23650 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:48.824694 27541 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:48.866742 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.870080 23006 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:48.808259 27943 consensus_queue.cc:1048] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:48.807744 27679 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:48.873196 28048 raft_consensus.cc:697] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:48.860744 28158 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:48.874897 27541 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:48.926079 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 74512.1us
W20260709 13:10:48.929582 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 117031us
I20260709 13:10:48.930020 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.884168 27378 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:48.942126 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:48.942893 23005 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:48.938225 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:48.945062 22928 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:48.874207 27857 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:48.963079 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:48.922222 27541 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.954921 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:48.980679 22928 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:48.992494 22972 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:48.940378 27806 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:48.936524 28173 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.946532 28149 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:48.926535 28158 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.036266 28158 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.007977 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:49.037484 23076 raft_consensus.cc:2410] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:49.012367 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:49.038393 23071 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:49.012895 28148 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:49.014470 28196 log.cc:927] Time spent T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:10:48.983922 28146 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.023905 28048 consensus_queue.cc:237] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.044369 23045 leader_election.cc:400] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 14. Current term is 15.
I20260709 13:10:49.044646 23045 leader_election.cc:403] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:48.974615 27378 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:48.985013 28007 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:10:49.047403 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 49295.6us
I20260709 13:10:49.054641 23073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
W20260709 13:10:49.056840 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 57340.5us
I20260709 13:10:48.913532 27656 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.052062 22928 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:49.062264 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.063752 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.072019 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.057626 22929 raft_consensus.cc:2468] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
W20260709 13:10:49.056252 28171 consensus_meta.cc:287] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.839s	user 0.021s	sys 0.000s
I20260709 13:10:49.087366 23652 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:49.090781 22927 raft_consensus.cc:2368] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12.
I20260709 13:10:49.095928 23078 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 15.
I20260709 13:10:49.124392 28171 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.126202 22931 raft_consensus.cc:2410] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:49.128793 23620 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:49.064103 28197 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 14. Current term is 15.
I20260709 13:10:49.131945 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:49.132445 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 44807.8us
I20260709 13:10:49.132598 23075 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:49.133801 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.050550 27378 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.139127 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:49.134575 23649 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:49.072783 22928 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:49.059069 28158 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 13:10:49.154104 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 95552us
I20260709 13:10:49.155515 28197 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.156240 28197 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.166354 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:49.183871 23620 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:49.080232 28148 consensus_queue.cc:1048] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:10:49.160971 28158 consensus_queue.cc:1243] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:49.148795 28204 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:49.183763 28173 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:49.199985 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 50182us
I20260709 13:10:49.189364 28147 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.200914 28158 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:49.172135 28202 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.206894 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.195508 28185 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:49.213599 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 58575.8us
I20260709 13:10:49.218434 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.220064 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:49.210476 27684 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:49.210516 28185 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:49.216913 27923 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:49.203605 28178 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:49.219424 28036 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.205281 28147 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.210024 28158 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.249598 27895 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:49.255383 28160 consensus_meta.cc:287] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.012s
I20260709 13:10:49.226497 28195 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:49.254433 28185 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.254563 27684 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.269294 27684 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.260913 28036 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.255995 27923 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.271853 27923 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.272014 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.273042 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:49.273586 22998 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:10:49.276185 28205 log.cc:927] Time spent T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:49.276111 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.264400 27656 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.282083 28160 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.284204 28160 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.287341 22925 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:49.264901 27895 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.287938 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:49.288575 23648 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.293325 28147 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.210799 28204 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.295612 28204 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.296177 28148 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:49.302598 23046 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:49.304455 23046 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:49.305613 28214 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:49.305528 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:49.288049 27895 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.311015 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.312727 23078 raft_consensus.cc:3055] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:49.320339 23078 raft_consensus.cc:740] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:49.321564 23073 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 9.
I20260709 13:10:49.250479 28037 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.331898 23005 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 16: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:49.328711 28154 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:49.348294 23075 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:10:49.332454 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.322216 28043 consensus_queue.cc:1059] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:10:49.341662 27857 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:49.342227 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.353860 23649 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 16.
I20260709 13:10:49.343173 28197 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:49.306136 28214 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.365875 28214 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.360208 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.349822 23006 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:49.355710 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.356969 22998 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:49.369602 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:49.370143 23077 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:49.344386 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.271620 28036 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.332988 28204 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:49.331051 28185 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.361277 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:49.362608 28173 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.364190 28037 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.364719 22997 raft_consensus.cc:2368] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
I20260709 13:10:49.282086 27923 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.365311 23000 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:49.365376 27378 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:49.370875 22926 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
I20260709 13:10:49.360039 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:49.287417 27541 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.368268 27679 consensus_queue.cc:1059] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:10:49.389281 22877 auto_rebalancer.cc:629] Failed to schedule move for tablet d86fa0480a7543048d2dc4f8046cd314: Illegal state: Replica b655449a388a41e3a606c6ea794825ad is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
W20260709 13:10:49.389894 28207 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.095s	user 0.001s	sys 0.001s
I20260709 13:10:49.382320 23075 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 15.
I20260709 13:10:49.421741 23077 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:49.403019 28173 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.488996 23648 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:49.384110 28204 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:49.514093 23657 raft_consensus.cc:2368] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11.
W20260709 13:10:49.502290 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 248863us
I20260709 13:10:49.505501 23652 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
W20260709 13:10:49.506023 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 146045us
I20260709 13:10:49.500370 28043 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:49.405380 28154 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.529150 28154 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.507064 27541 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:49.507484 23656 raft_consensus.cc:2368] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:49.531734 28204 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.535239 28026 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:49.507730 22970 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:49.537189 27879 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:49.537724 27879 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.538966 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.539244 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.524235 28173 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:49.525061 28158 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:49.526924 27923 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:49.556406 28185 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:49.556615 28226 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.557262 27879 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.557331 28226 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:49.558962 28219 log.cc:927] Time spent T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:49.559937 28225 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:49.560442 28225 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:49.561312 28225 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.568539 28226 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.578838 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9d7188ba094ea3b277000bf9f3a73e" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.592969 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:49.593756 23076 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:49.596387 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:49.577231 27679 raft_consensus.cc:493] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:49.601554 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.602520 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.601104 28216 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:49.614562 23046 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:49.621254 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:49.630813 28227 log.cc:927] Time spent T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
W20260709 13:10:49.632660 28228 log.cc:927] Time spent T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:49.633503 28214 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.634356 28171 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.619877 28216 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.635931 28216 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.603921 27679 raft_consensus.cc:515] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.642030 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.650725 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:49.652305 27943 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.652755 27943 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.653160 27943 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.658059 23046 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:49.658725 22924 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:49.663067 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:49.663676 22924 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.663697 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:49.666409 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.666985 22926 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:49.663007 28146 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:49.667059 28214 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.667843 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:49.668632 22926 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.668757 28217 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:49.670262 27679 leader_election.cc:290] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:49.671193 28148 raft_consensus.cc:3055] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:49.671573 28148 raft_consensus.cc:740] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:49.671752 27895 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.672358 28148 consensus_queue.cc:260] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.673447 28148 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.673787 27895 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.675323 22926 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:49.676194 22895 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:49.676353 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:49.677074 22926 raft_consensus.cc:2393] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:49.682006 27895 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:49.682507 27895 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:49.683347 27895 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.684504 22927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49890 (request call id 2825) took 1197 ms. Trace:
I20260709 13:10:49.684857 22927 rpcz_store.cc:276] 0709 13:10:48.487299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.487806 (+   507us) service_pool.cc:224] Handling call
0709 13:10:49.684329 (+1196523us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400346554. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:49.684454 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351748992}
I20260709 13:10:49.697340 28208 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:49.697829 28208 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.699822 28202 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:49.700312 28202 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.700887 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:49.702296 28202 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:49.703781 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 47868.8us
I20260709 13:10:49.704380 28177 raft_consensus.cc:493] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:49.704910 28177 raft_consensus.cc:515] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.707019 28177 leader_election.cc:290] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.708496 28208 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:49.710834 22896 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:49.711109 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.711360 22924 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:49.711748 22929 raft_consensus.cc:1240] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:49.713402 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.715010 22999 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:49.716140 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.717401 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:49.719664 22931 raft_consensus.cc:2393] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 13: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:49.711131 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:49.720525 23622 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:49.727741 23622 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:49.727989 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.699330 23078 consensus_queue.cc:260] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.736843 22972 leader_election.cc:400] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12.
I20260709 13:10:49.737138 22972 leader_election.cc:403] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.739044 23622 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
W20260709 13:10:49.744473 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 77854.2us
I20260709 13:10:49.675329 28204 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.747968 28203 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.748466 28193 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.757516 27812 raft_consensus.cc:2804] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:49.746224 27692 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:49.764447 27923 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.746748 28029 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:10:49.736469 27806 raft_consensus.cc:2804] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:49.727514 28134 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:49.737599 28169 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:49.727452 28173 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:49.722936 28208 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:49.773370 22931 raft_consensus.cc:1217] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 15.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:10:49.791885 28043 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:49.813416 22931 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:49.802034 27812 raft_consensus.cc:697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:49.777866 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:49.782209 27943 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.814834 27812 consensus_queue.cc:237] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.815333 28204 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.763471 28216 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.816583 27943 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.814759 22927 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.817461 28216 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.817945 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:49.818207 23001 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 17: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:49.818504 22930 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.768776 28036 raft_consensus.cc:2749] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 for earlier term 11. Current term is 12.
I20260709 13:10:49.797856 22997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 1156) took 1175 ms. Trace:
I20260709 13:10:49.819696 22997 rpcz_store.cc:276] 0709 13:10:48.616648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.629004 (+ 12356us) service_pool.cc:224] Handling call
0709 13:10:49.792030 (+1163026us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54000baed4. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3924f73571 00007f392500e2fa 00007f3929fcfb17 00007f392354a6d4 00007f392354a662 00007f392354a591 00007f392354a50c 00007f39235497c2 00007f392334548c 00007f39233448c6 00007f392334426f
0709 13:10:49.792181 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689343360}
I20260709 13:10:49.810818 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.803135 28169 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:49.821273 28169 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.821408 23000 raft_consensus.cc:2368] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 13. Current term is 14.
I20260709 13:10:49.812150 28173 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.813635 28043 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.802115 27692 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
W20260709 13:10:49.787498 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 91718.7us
I20260709 13:10:49.827759 28173 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.829048 23620 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:49.823845 28185 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:49.832554 27692 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.823844 27806 raft_consensus.cc:697] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:49.837709 28043 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:49.837826 27806 consensus_queue.cc:237] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.842160 28202 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:49.842726 28202 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:49.843019 23078 raft_consensus.cc:3060] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.843502 28202 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.844166 23002 raft_consensus.cc:1217] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Deduplicated request from leader. Original: 15.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:10:49.844717 23002 raft_consensus.cc:1240] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:49.852799 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:49.856029 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:49.797200 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:49.863087 23078 raft_consensus.cc:1275] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:10:49.863691 23078 pending_rounds.cc:85] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 11
I20260709 13:10:49.864100 23078 pending_rounds.cc:107] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:10:49.864439 23078 raft_consensus.cc:2889] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.865633 22927 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:49.885322 23621 leader_election.cc:400] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 9 election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10.
I20260709 13:10:49.886514 23621 leader_election.cc:400] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 13. Current term is 14.
I20260709 13:10:49.886834 23621 leader_election.cc:403] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.888938 22930 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:49.893453 23652 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:49.895442 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:49.890321 27807 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:10:49.902053 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:49.902812 23653 raft_consensus.cc:3060] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.893643 28208 raft_consensus.cc:3060] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.892678 27923 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:49.917512 27923 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.918090 27923 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.927965 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:49.890528 27850 consensus_queue.cc:1048] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:10:49.935829 28169 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:49.936905 22926 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:49.938205 28208 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749) with higher term. Message: Invalid argument: T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d for earlier term 13. Current term is 14.
I20260709 13:10:49.970001 23077 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:49.938933 22972 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:49.944559 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09dae9312b04b4c8d390ab7d430e7cb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:49.945518 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:49.946161 23071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:49.971912 23071 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.977198 23653 raft_consensus.cc:2468] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:49.977986 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:49.979112 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.979254 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:49.981127 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.981994 23078 raft_consensus.cc:1240] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:10:49.981552 22926 raft_consensus.cc:2368] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:49.986143 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.989603 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:49.992295 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:49.895895 28173 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:49.997105 23657 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:49.998163 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:49.974505 28185 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.975165 28192 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:50.010272 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:50.010756 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:49.982618 28175 raft_consensus.cc:2804] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:50.011174 23071 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 17.
I20260709 13:10:50.014184 23652 raft_consensus.cc:1240] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Rejecting Update request from peer b655449a388a41e3a606c6ea794825ad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:50.022641 27923 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.013803 28192 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.013583 28169 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:50.026381 28192 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:50.000000 28007 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:50.029361 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:50.027016 28007 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.023159 28173 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:50.033839 23043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.036293 23075 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 14.
I20260709 13:10:50.050037 23651 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 17: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:50.015146 28185 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.033007 28175 raft_consensus.cc:697] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:50.068778 27923 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:50.070477 28007 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:50.072631 27923 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:50.072988 28191 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.073339 27923 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.073444 28191 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.074148 27679 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:50.084564 23080 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 10.
I20260709 13:10:50.087566 28175 consensus_queue.cc:237] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.094206 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:50.094933 23653 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 in current term 14: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:50.094867 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:50.097388 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:50.098704 28185 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:50.098948 23648 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:50.103909 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:50.104677 23000 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 17: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:50.088042 27923 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:50.072696 22970 leader_election.cc:304] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.108780 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:50.109102 22970 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:50.109565 28036 raft_consensus.cc:2749] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:50.110493 28148 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:50.111078 28148 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:50.112178 28148 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.114465 22896 leader_election.cc:400] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11.
I20260709 13:10:50.114754 22896 leader_election.cc:403] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:50.099364 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:50.126497 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec39fe8fb84cf39e1a859ea7b735d1" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:50.128226 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:50.130307 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:50.132074 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:50.136689 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:50.143435 23046 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:50.143844 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:50.144237 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:50.144886 23648 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:50.150163 23046 leader_election.cc:400] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:50.150477 23046 leader_election.cc:403] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:50.130467 27692 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 10. Current term is 11.
I20260709 13:10:50.154753 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:50.155963 23045 leader_election.cc:400] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:50.158376 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:50.162038 23652 raft_consensus.cc:2468] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
I20260709 13:10:50.139590 28185 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:50.172688 23648 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 11.
I20260709 13:10:50.158785 27807 raft_consensus.cc:2804] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:50.165416 28192 raft_consensus.cc:2764] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:50.165246 28217 raft_consensus.cc:3060] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.164189 27806 raft_consensus.cc:2749] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:50.164875 28026 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:50.163208 27879 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:10:50.158911 28007 consensus_queue.cc:1059] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:10:50.255007 22895 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:50.257670 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:50.257938 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:50.260341 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:50.260504 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:50.260984 23075 raft_consensus.cc:3060] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:50.262624 23079 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:50.261997 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:50.264060 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:50.267318 22971 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:50.267571 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:50.268777 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:50.261497 27692 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:50.271134 23075 raft_consensus.cc:2468] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:50.278303 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:50.279105 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:50.270612 28175 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:50.269131 27943 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:50.277348 27692 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:50.292670 22929 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:50.297106 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:50.299862 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:50.300020 22971 leader_election.cc:304] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:50.300177 23077 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 17: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:50.301494 28175 raft_consensus.cc:2749] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:50.303565 28191 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:50.306980 28217 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171) with higher term. Message: Invalid argument: T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad for earlier term 11. Current term is 12.
I20260709 13:10:50.314685 23076 raft_consensus.cc:2468] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:10:50.316316 27692 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.323307 23075 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:50.325342 27963 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:50.328761 22895 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.333427 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:50.332692 28169 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.340986 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.340265 28167 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:10:50.344691 28208 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.348451 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.348861 22997 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:50.352054 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.353468 22929 raft_consensus.cc:1275] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:50.355036 28240 consensus_queue.cc:1059] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:50.355989 28240 consensus_queue.cc:1243] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:50.353606 27923 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:50.356451 27963 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:50.353421 27806 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:50.356989 27963 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:50.357832 27963 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.359047 27963 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:50.360445 28148 consensus_queue.cc:1048] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:50.364557 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 188795us
I20260709 13:10:50.365072 23652 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:50.366263 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:50.367830 28214 raft_consensus.cc:2749] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.368311 28171 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:50.369275 27807 raft_consensus.cc:697] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:50.369850 27879 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:50.370278 27879 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:50.370162 27807 consensus_queue.cc:237] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.371126 27879 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:50.372107 28026 raft_consensus.cc:3055] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:50.372413 27879 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.372521 28026 raft_consensus.cc:740] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:50.373621 28026 consensus_queue.cc:260] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.374833 28026 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:50.379794 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 50160.3us
W20260709 13:10:50.380517 28158 consensus_queue.cc:1175] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "01988c2c817947859340a730b7f1247d" responder_term: 10 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:50.371869 22896 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.391476 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:50.395038 23075 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:50.419806 23077 raft_consensus.cc:1240] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:50.440948 22997 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:10:50.441445 22997 pending_rounds.cc:85] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 9
I20260709 13:10:50.441699 22997 pending_rounds.cc:107] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:10:50.441960 22997 raft_consensus.cc:2889] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:50.450605 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 54017.8us
W20260709 13:10:50.455044 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 61986us
I20260709 13:10:50.456261 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:50.392769 28169 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:50.435745 28256 log.cc:927] Time spent T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:10:50.416332 28204 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.416652 28167 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:50.467067 22826 catalog_manager.cc:5697] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:50.476106 22826 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 11 to 12, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:50.504806 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:50.511514 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 59072.2us
I20260709 13:10:50.512601 28169 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:50.513957 28169 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.454515 28208 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:10:50.462459 27534 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:50.454313 28145 consensus_queue.cc:1059] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:10:50.523813 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 68105.8us
I20260709 13:10:50.499867 27879 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.457321 27895 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:10:50.542670 28168 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:10:50.492633 28167 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.598914 28167 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:50.599511 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:50.610215 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 102326us
I20260709 13:10:50.522975 28204 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:50.630851 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 182186us
I20260709 13:10:50.633124 23077 raft_consensus.cc:1275] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:50.650662 23001 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:50.651643 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:50.652248 23652 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:50.657653 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:50.653800 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:50.678519 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 166106us
I20260709 13:10:50.670498 27879 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:50.697199 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.671702 28177 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:50.709893 28185 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.688710 27879 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:50.766436 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 57160.4us
W20260709 13:10:50.765887 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 58334.1us
W20260709 13:10:50.768486 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 101691us
I20260709 13:10:50.724900 27879 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.711618 28208 consensus_queue.cc:1048] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:10:50.785816 23075 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:50.712424 28263 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:10:50.712554 28177 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.812117 28158 raft_consensus.cc:3055] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:50.812610 28158 raft_consensus.cc:740] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:50.813449 28158 consensus_queue.cc:260] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:50.814781 28158 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:50.821668 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 52474.5us
I20260709 13:10:50.834987 22931 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:50.845034 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:50.854367 22926 raft_consensus.cc:1275] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:10:50.886893 28269 log.cc:927] Time spent T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:10:50.873183 28267 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:50.903431 23648 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:50.920296 23656 raft_consensus.cc:1275] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:50.922401 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 89942us
I20260709 13:10:50.933627 23654 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:50.939810 28211 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:50.942737 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 103986us
I20260709 13:10:50.952585 27895 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:10:50.982028 28283 consensus_queue.cc:1048] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:10:50.985530 28026 consensus_meta.cc:287] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.003s
I20260709 13:10:50.989811 27879 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:50.994813 28281 log.cc:927] Time spent T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.158s	user 0.003s	sys 0.000s
I20260709 13:10:50.999814 23620 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:50.837427 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:51.006369 22826 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:51.011925 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 55337.8us
I20260709 13:10:51.014276 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:51.027935 22826 catalog_manager.cc:5697] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.029196 22826 catalog_manager.cc:5697] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.044605 22826 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.046191 22826 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 15 to 17, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 17 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.049065 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:51.048993 22826 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 15, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 15 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:51.051100 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 51401us
I20260709 13:10:51.058676 22826 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.059827 23076 raft_consensus.cc:1240] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Rejecting Update request from peer 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:51.063896 23651 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:10:51.064255 23651 pending_rounds.cc:85] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Aborting all ops after (but not including) 10
I20260709 13:10:51.064461 23651 pending_rounds.cc:107] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:10:51.064702 23651 raft_consensus.cc:2889] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.060016 22826 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 12, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.021370 28223 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:51.074587 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:51.074972 22827 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35510 (request call id 352) took 33154 ms (client timeout 15000 ms). Trace:
W20260709 13:10:51.082221 28282 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:10:51.058956 28208 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.071507 22826 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.108099 22826 catalog_manager.cc:5697] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 12, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 12 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:51.145326 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 75179.5us
W20260709 13:10:51.075481 22827 rpcz_store.cc:269] 0709 13:10:17.927894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.928134 (+   240us) service_pool.cc:224] Handling call
0709 13:10:51.065071 (+33136937us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:47.860155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:47.860997 (+   842us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:47.861057 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:10:47.861083 (+    26us) tablet.cc:662] Decoding operations
0709 13:10:47.862101 (+  1018us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:47.862208 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:47.862245 (+    37us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:47.862974 (+   729us) tablet.cc:701] Row locks acquired
0709 13:10:47.863029 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:10:47.863227 (+   198us) write_op.cc:270] Start()
0709 13:10:47.863409 (+   182us) write_op.cc:276] Timestamp: P: 1783602647863157 usec, L: 0
0709 13:10:47.863452 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:10:47.916167 (+ 52715us) log.cc:844] Serialized 2477 byte log entry
0709 13:10:48.649354 (+733187us) op_driver.cc:464] REPLICATION: finished
0709 13:10:49.027866 (+378512us) write_op.cc:301] APPLY: starting
0709 13:10:49.027987 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:49.198690 (+170703us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:49.205624 (+  6934us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:49.306103 (+100479us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:49.513619 (+207516us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:10:49.539831 (+ 26212us) write_op.cc:312] APPLY: finished
0709 13:10:49.540142 (+   311us) log.cc:844] Serialized 65 byte log entry
0709 13:10:49.540313 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:49.540414 (+   101us) write_op.cc:454] Released schema lock
0709 13:10:49.540473 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:49.540878 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:49.540903 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":556215,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":289108,"apply.run_cpu_time_us":11386,"apply.run_wall_time_us":558127,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29279,"num_ops":6,"prepare.queue_time_us":141105,"prepare.run_cpu_time_us":86034,"prepare.run_wall_time_us":192422,"raft.queue_time_us":220093,"raft.run_cpu_time_us":17700,"raft.run_wall_time_us":194095,"replication_time_us":785734,"thread_start_us":542809,"threads_started":4,"wal-append.queue_time_us":153526,"wal-append.run_cpu_time_us":34254,"wal-append.run_wall_time_us":2470239}]]}
I20260709 13:10:51.146473 22826 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 8 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.083307 28272 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:10:51.073349 28223 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:51.157559 22826 catalog_manager.cc:5697] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.105931 28267 consensus_queue.cc:1048] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:10:51.167981 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 127612us
I20260709 13:10:51.164664 22826 catalog_manager.cc:5697] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.172756 23652 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:51.174211 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:51.181818 22923 raft_consensus.cc:1275] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:51.182897 28026 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:51.191092 22826 catalog_manager.cc:5697] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 11 to 14, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 14 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.201771 22826 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 13, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 13 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.173259 28287 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:10:51.207635 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:51.204756 22826 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 12, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.201205 27879 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:51.212616 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 54596.3us
I20260709 13:10:51.211407 22826 catalog_manager.cc:5697] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 7, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 7 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.214452 22971 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:51.267012 22826 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 11, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:51.284868 23046 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.298177 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 83842.6us
W20260709 13:10:51.233690 28295 log.cc:927] Time spent T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:51.343535 22826 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 15, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 15 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.347110 22826 catalog_manager.cc:5697] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 11, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 11 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.339860 28303 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:51.351128 28289 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:10:51.353056 22826 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.386761 23046 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:51.388718 28204 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.373947 22826 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 9, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 9 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.405790 22826 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.410692 22826 catalog_manager.cc:5697] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 5 to 11, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 11 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:51.414191 22826 catalog_manager.cc:5697] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 3 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 8 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.415964 22826 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 4 to 9, term changed from 7 to 10, 01988c2c817947859340a730b7f1247d (127.21.67.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:51.411868 28300 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:10:51.418882 28007 consensus_queue.cc:1048] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:51.450138 28273 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:51.450685 28273 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:51.504675 28308 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:51.505276 28308 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:51.498392 27895 consensus_queue.cc:1059] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:10:51.519539 27378 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:51.520187 27378 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:51.520938 28177 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:51.522285 27378 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:51.522874 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:51.536978 28273 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:51.537263 27895 raft_consensus.cc:3055] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:51.537904 27895 raft_consensus.cc:740] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:51.538437 28308 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:51.542514 28223 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:51.551622 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:51.551930 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:51.556619 22925 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
W20260709 13:10:51.559322 28297 log.cc:927] Time spent T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.353s	user 0.000s	sys 0.003s
I20260709 13:10:51.539017 27895 consensus_queue.cc:260] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:51.565244 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:51.565640 27895 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:51.565902 28318 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:10:51.574867 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 82535.8us
I20260709 13:10:51.577344 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:51.596339 23657 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:51.598508 27923 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:51.599116 27923 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:51.601608 27923 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:51.607247 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:51.607985 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:51.616919 23075 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:10:51.617295 23075 pending_rounds.cc:85] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Aborting all ops after (but not including) 10
I20260709 13:10:51.617519 23075 pending_rounds.cc:107] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:10:51.617756 23075 raft_consensus.cc:2889] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.628435 23621 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:51.634568 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:51.637943 28021 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:51.653825 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:51.668543 23078 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:51.681242 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:51.684906 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:51.685451 23002 raft_consensus.cc:606] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:10:51.681860 23075 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:51.692353 28265 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:51.695765 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c57d9be04024fee96aa769711f72d7c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:51.648929 28285 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:51.649288 28273 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:51.725184 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 52648us
I20260709 13:10:51.735985 28026 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.806715 28026 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:51.807838 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 62327.1us
I20260709 13:10:51.808837 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:51.882651 28036 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
W20260709 13:10:51.893285 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 82883.3us
W20260709 13:10:51.892920 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 140427us
W20260709 13:10:51.889560 28318 log.cc:927] Time spent T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:10:51.880976 28223 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:51.940006 22895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 260447us
I20260709 13:10:51.941258 23045 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:51.948333 27879 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.977083 28026 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:51.967941 28279 raft_consensus.cc:493] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:51.978057 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:51.978256 28279 raft_consensus.cc:515] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:51.987545 28279 leader_election.cc:290] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:51.987754 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:51.996374 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 184703us
I20260709 13:10:51.996879 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:52.002985 23000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:52.003932 23000 raft_consensus.cc:606] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:52.010725 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 257728us
I20260709 13:10:52.015518 28339 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:52.021386 28339 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.049894 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
W20260709 13:10:52.057883 28337 log.cc:927] Time spent T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: Append to log took a long time: real 0.162s	user 0.005s	sys 0.000s
I20260709 13:10:52.062077 23078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:10:52.062678 23078 raft_consensus.cc:606] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:52.063019 23078 raft_consensus.cc:614] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:52.051882 28339 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.066429 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:52.101547 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71491ce9117b44a08c83b84589d0ba9d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:52.131403 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:52.132454 28259 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:52.134127 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:52.136248 28211 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:52.136680 28211 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:52.137063 28211 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.139981 23078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:42586
I20260709 13:10:52.140580 23078 raft_consensus.cc:606] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:52.142940 22877 auto_rebalancer.cc:629] Failed to schedule move for tablet 1a642095ff8a4146b8e977c3af22c826: Illegal state: Replica b655449a388a41e3a606c6ea794825ad is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:52.157577 28169 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:52.158179 28169 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.160303 28169 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:52.161616 28211 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.173436 22896 leader_election.cc:304] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:52.174412 28169 raft_consensus.cc:2749] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:52.163585 28211 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.187532 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:52.200801 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:52.202229 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:52.204145 22931 raft_consensus.cc:2393] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 12: Already voted for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in this term.
I20260709 13:10:52.204645 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:52.211416 22896 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:52.211886 28287 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.212110 28336 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:52.214684 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:52.222079 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:52.226511 23002 raft_consensus.cc:606] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Received request to transfer leadership to TS 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:52.233276 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:52.235038 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:52.237006 28168 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.238011 28168 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:52.241854 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 48317.1us
I20260709 13:10:52.249091 28168 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.250463 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:52.256417 28292 raft_consensus.cc:993] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:10:52.257084 28292 raft_consensus.cc:1081] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:10:52.252975 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:52.259636 23002 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:52.265619 22896 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:52.266619 28169 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:52.267009 28169 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.267355 28169 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.264766 27943 raft_consensus.cc:993] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:52.269795 27943 raft_consensus.cc:1081] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:52.276085 23079 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:10:52.288375 28169 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.290616 28169 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.293262 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:52.294708 23079 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.296833 27807 raft_consensus.cc:993] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:52.297304 27807 raft_consensus.cc:1081] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:52.297645 22922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:10:52.298187 22922 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.298533 22922 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.300802 22929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49902
I20260709 13:10:52.301307 22929 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.301621 22929 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.302240 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:52.302956 27943 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:52.303397 27943 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:52.304236 27943 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.298470 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:52.320304 22922 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.331456 22929 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.332894 23657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47800
I20260709 13:10:52.354552 23657 raft_consensus.cc:493] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.354921 23657 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.353829 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:52.334481 28339 raft_consensus.cc:993] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:52.357291 23079 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:52.356032 23002 raft_consensus.cc:3055] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:52.357620 27850 raft_consensus.cc:1081] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Signalling peer 0db2f61e34a24096a5baf0de9a32d4f7 to start an election
I20260709 13:10:52.358748 22895 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:52.359418 22931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
 from {username='slave'} at 127.0.0.1:49890
I20260709 13:10:52.359934 22931 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.360256 22931 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.364085 22922 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.364189 27895 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:52.364001 23657 raft_consensus.cc:515] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.365108 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:52.365696 23079 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.365008 23002 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:52.367688 22929 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:52.368223 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:52.368741 23080 raft_consensus.cc:3055] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:52.369148 23080 raft_consensus.cc:740] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:52.370559 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:52.368778 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:52.371104 23006 raft_consensus.cc:3055] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:52.371194 23655 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.371435 23006 raft_consensus.cc:740] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:52.372212 23006 consensus_queue.cc:260] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.366161 27807 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.373306 23006 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.373641 27807 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.374184 23079 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:52.376416 22895 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:52.377257 28168 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:52.377689 23655 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:52.377734 28168 raft_consensus.cc:697] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:52.378835 28168 consensus_queue.cc:237] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.367025 27895 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:52.380592 27895 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.384395 27807 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:52.370205 23080 consensus_queue.cc:260] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.385932 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:52.386246 23080 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.386521 23648 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:52.369127 23002 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.388810 23006 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:52.389894 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:52.389910 23621 leader_election.cc:304] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:52.369849 22931 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.394202 28273 raft_consensus.cc:2804] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:52.394732 28273 raft_consensus.cc:697] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:52.395474 23657 leader_election.cc:290] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.396788 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c7979afa3c4fcb83838f29edec3b67" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:52.396373 22896 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:52.396029 23080 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 12.
I20260709 13:10:52.398303 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:52.405103 23002 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.405186 23079 raft_consensus.cc:3060] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.409262 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:52.409731 23006 raft_consensus.cc:3055] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:52.409963 23006 raft_consensus.cc:740] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:52.410851 22931 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:52.415642 23006 consensus_queue.cc:260] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.408043 28169 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:52.423341 28169 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:52.424198 28169 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.410924 28007 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:52.427496 28007 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.427904 28007 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.421124 28273 consensus_queue.cc:237] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.437538 23006 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.440945 23079 raft_consensus.cc:2468] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:52.441052 28007 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.444036 28007 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:52.444347 22931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:52.445724 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:52.446353 23655 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.455494 23655 raft_consensus.cc:2468] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:52.463018 23045 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:52.463965 28007 raft_consensus.cc:2804] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:52.464581 28007 raft_consensus.cc:697] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:52.465358 28007 consensus_queue.cc:237] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.463892 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:52.469259 23657 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.475822 23657 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:52.477253 22896 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:52.478055 28322 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:52.478675 28322 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Becoming Leader. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:52.479727 28322 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.488409 23006 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 13.
I20260709 13:10:52.494645 23002 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0db2f61e34a24096a5baf0de9a32d4f7 in term 8.
I20260709 13:10:52.500741 28273 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:52.501281 28273 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.504252 28273 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.504679 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" is_pre_election: true
I20260709 13:10:52.505358 22929 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 15.
I20260709 13:10:52.509022 23622 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 
I20260709 13:10:52.510540 28286 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.510917 28286 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:52.511092 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:52.512125 23079 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 15: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:52.511287 28286 raft_consensus.cc:3060] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.535275 28286 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.544616 27895 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:52.553216 27895 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.564611 22826 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 261) took 4147 ms. Trace:
I20260709 13:10:52.565049 22826 rpcz_store.cc:276] 0709 13:10:48.417308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.417485 (+   177us) service_pool.cc:224] Handling call
0709 13:10:52.564524 (+4147039us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:51.674793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:51.675401 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:51.675433 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:10:51.675453 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:51.677535 (+  2082us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:51.703705 (+ 26170us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:51.703743 (+    38us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:10:51.706016 (+  2273us) tablet.cc:701] Row locks acquired
0709 13:10:51.706032 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:10:51.706166 (+   134us) write_op.cc:270] Start()
0709 13:10:51.706253 (+    87us) write_op.cc:276] Timestamp: P: 1783602651706126 usec, L: 0
0709 13:10:51.706272 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:51.706984 (+   712us) log.cc:844] Serialized 11067 byte log entry
0709 13:10:52.286482 (+579498us) op_driver.cc:464] REPLICATION: finished
0709 13:10:52.340444 (+ 53962us) write_op.cc:301] APPLY: starting
0709 13:10:52.340533 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:52.428066 (+ 87533us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:52.428165 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:52.467462 (+ 39297us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:52.467818 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:10:52.467865 (+    47us) write_op.cc:312] APPLY: finished
0709 13:10:52.468323 (+   458us) log.cc:844] Serialized 244 byte log entry
0709 13:10:52.468495 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.468700 (+   205us) write_op.cc:454] Released schema lock
0709 13:10:52.468758 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:52.483498 (+ 14740us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.483533 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":522059,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":53740,"apply.run_cpu_time_us":33564,"apply.run_wall_time_us":143016,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121503,"num_ops":28,"prepare.queue_time_us":165859,"prepare.run_cpu_time_us":54823,"prepare.run_wall_time_us":336214,"raft.queue_time_us":212288,"raft.run_cpu_time_us":2160,"raft.run_wall_time_us":26871,"replication_time_us":580074,"thread_start_us":577619,"threads_started":4,"wal-append.queue_time_us":343857}]]}
I20260709 13:10:52.572541 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:52.572691 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:52.578426 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:52.579078 23655 raft_consensus.cc:2368] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 11. Current term is 12.
I20260709 13:10:52.579943 22896 leader_election.cc:400] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 11. Current term is 12.
I20260709 13:10:52.580210 22896 leader_election.cc:403] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.585032 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:52.585776 23080 raft_consensus.cc:2393] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 15: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:52.577710 27895 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:52.593787 22929 raft_consensus.cc:2468] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 15.
I20260709 13:10:52.595034 23622 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:10:52.585227 28169 raft_consensus.cc:3060] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.585068 28286 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:52.598191 28273 raft_consensus.cc:2804] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:52.607507 28273 raft_consensus.cc:697] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 15 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:52.608392 28273 consensus_queue.cc:237] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:52.617800 22824 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 11 to 13, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 13 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:52.703145 22824 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 10 to 14, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 14 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:52.722313 22824 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 9 to 12, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 12 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:52.734869 28169 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 01988c2c817947859340a730b7f1247d (127.21.67.196:35811) with higher term. Message: Invalid argument: T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0db2f61e34a24096a5baf0de9a32d4f7 for earlier term 11. Current term is 12.
I20260709 13:10:52.738543 23080 raft_consensus.cc:1240] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:52.743608 28288 consensus_queue.cc:1059] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:52.744673 27943 raft_consensus.cc:3055] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:52.745044 27943 raft_consensus.cc:740] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:52.745891 27943 consensus_queue.cc:260] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:52.746994 27943 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.723969 22824 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 6 to 9, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 9 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:52.773708 22824 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.775643 22824 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:52.778213 22824 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 10 to 13, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.793774 22824 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 10 to 11, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 11 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.799844 22824 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:52.801205 22824 catalog_manager.cc:5697] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 11, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 11 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:52.802878 22824 catalog_manager.cc:5697] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 8, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 8 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.825282 22824 catalog_manager.cc:5697] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 4 to 5, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 5 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:52.887192 23080 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:52.888221 23002 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:10:52.888643 23002 pending_rounds.cc:85] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Aborting all ops after (but not including) 8
I20260709 13:10:52.888993 23002 pending_rounds.cc:107] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:10:52.889297 23002 raft_consensus.cc:2889] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:52.890782 28273 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:52.894821 28168 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:52.898406 23075 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:52.909219 28322 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:52.919026 23648 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:52.920954 28278 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:52.979532 23079 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:52.986539 28278 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:52.989857 23079 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:52.995868 28168 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:53.001812 23655 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:53.003110 28259 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:53.005808 23002 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:53.008244 28169 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:53.008852 23006 raft_consensus.cc:1275] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:53.010375 28306 consensus_queue.cc:1048] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:53.047881 23652 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:53.050732 28336 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:53.055065 22922 raft_consensus.cc:1275] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:53.061498 27807 consensus_queue.cc:1048] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:53.073791 28363 log.cc:927] Time spent T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:10:53.077178 28366 log.cc:927] Time spent T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:53.084932 23006 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer 0db2f61e34a24096a5baf0de9a32d4f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:53.085230 28370 log.cc:927] Time spent T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:10:53.087599 28168 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:53.092954 22825 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 10 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 13 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
W20260709 13:10:53.153863 28371 log.cc:927] Time spent T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:53.153141 22825 catalog_manager.cc:5697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 5 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 8 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:53.221203 22929 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:53.224283 28273 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:53.249281 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 96502.7us
I20260709 13:10:53.262246 23078 raft_consensus.cc:1275] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:53.236174 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:53.332899 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 64927.1us
I20260709 13:10:53.344035 28306 consensus_queue.cc:1048] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:53.347308 22824 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35510 (request call id 353) took 13867 ms (client timeout 15000 ms). Trace:
W20260709 13:10:53.351773 22824 rpcz_store.cc:269] 0709 13:10:39.480162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.480406 (+   244us) service_pool.cc:224] Handling call
0709 13:10:39.686556 (+206150us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5400002490. stack: 00007f3921eeb343 00007f3921eeb240 00007f392187a1d4 00007f392b5b8304 00007f392b5b8299 00007f3921da5db1 00007f3921ee5b71 00007f3921ee60b2 00007f392ae5fa89 00007f392adf7da6 00007f392adc9088 00007f392aec737e 00007f39293882a4 00007f3929388232 00007f3929388161 00007f39293880dc
0709 13:10:53.347241 (+13660685us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:52.886005 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:52.886528 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:52.886562 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:10:52.886579 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:52.887597 (+  1018us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:52.893702 (+  6105us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:52.893744 (+    42us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:10:52.894734 (+   990us) tablet.cc:701] Row locks acquired
0709 13:10:52.894753 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:10:52.894891 (+   138us) write_op.cc:270] Start()
0709 13:10:52.895001 (+   110us) write_op.cc:276] Timestamp: P: 1783602652894835 usec, L: 0
0709 13:10:52.895019 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:10:52.895594 (+   575us) log.cc:844] Serialized 4790 byte log entry
0709 13:10:52.940039 (+ 44445us) op_driver.cc:464] REPLICATION: finished
0709 13:10:52.940329 (+   290us) write_op.cc:301] APPLY: starting
0709 13:10:52.940434 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:52.957940 (+ 17506us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:52.958025 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:53.032092 (+ 74067us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:53.032325 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:10:53.032368 (+    43us) write_op.cc:312] APPLY: finished
0709 13:10:53.032677 (+   309us) log.cc:844] Serialized 113 byte log entry
0709 13:10:53.032826 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.032959 (+   133us) write_op.cc:454] Released schema lock
0709 13:10:53.033008 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:53.033326 (+   318us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.033353 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116891,"reported_tablets":45,"spinlock_wait_cycles":7510272,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":15544,"apply.run_wall_time_us":92945,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50304,"num_ops":12,"prepare.queue_time_us":9974,"prepare.run_cpu_time_us":3899,"prepare.run_wall_time_us":9896,"replication_time_us":44868,"thread_start_us":11728,"threads_started":1}]]}
W20260709 13:10:53.400530 22825 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 374) took 15965 ms (client timeout 15000 ms). Trace:
W20260709 13:10:53.400977 22825 rpcz_store.cc:269] 0709 13:10:37.435566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.447869 (+ 12303us) service_pool.cc:224] Handling call
0709 13:10:53.400459 (+15952590us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:53.315982 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:53.316533 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:53.316571 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:10:53.316591 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:53.317071 (+   480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:53.317134 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:53.317164 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:53.317524 (+   360us) tablet.cc:701] Row locks acquired
0709 13:10:53.317545 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:53.317687 (+   142us) write_op.cc:270] Start()
0709 13:10:53.317805 (+   118us) write_op.cc:276] Timestamp: P: 1783602653317640 usec, L: 0
0709 13:10:53.317828 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:53.318531 (+   703us) log.cc:844] Serialized 924 byte log entry
0709 13:10:53.320560 (+  2029us) op_driver.cc:464] REPLICATION: finished
0709 13:10:53.321060 (+   500us) write_op.cc:301] APPLY: starting
0709 13:10:53.321133 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:53.322523 (+  1390us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:53.322627 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:53.324031 (+  1404us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:53.324207 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:10:53.324263 (+    56us) write_op.cc:312] APPLY: finished
0709 13:10:53.324491 (+   228us) log.cc:844] Serialized 33 byte log entry
0709 13:10:53.324664 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.324754 (+    90us) write_op.cc:454] Released schema lock
0709 13:10:53.324797 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:53.329164 (+  4367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.329195 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201868,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":292,"apply.run_cpu_time_us":4062,"apply.run_wall_time_us":4070,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8384,"num_ops":2,"prepare.queue_time_us":2933,"prepare.run_cpu_time_us":2783,"prepare.run_wall_time_us":2804,"replication_time_us":2602}]]}
I20260709 13:10:53.425887 22828 catalog_manager.cc:5697] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 8 to 10, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:53.450098 23080 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: NON_VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: true } }
W20260709 13:10:53.515698 23045 consensus_peers.cc:597] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.516870 22929 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:53.518347 28145 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:53.520289 23652 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:53.526289 28145 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:53.541013 22827 catalog_manager.cc:5697] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 11, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.542683 22827 catalog_manager.cc:5697] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.544162 22827 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 12, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 12 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.571552 28145 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 4 to 11, NON_VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: NON_VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: true } } }
I20260709 13:10:53.573252 22922 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 4 to 11, NON_VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: NON_VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: true } } }
I20260709 13:10:53.584851 22827 catalog_manager.cc:5697] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.586313 22827 catalog_manager.cc:5697] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 8 to 11, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.588399 22827 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 13, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 13 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.588454 23652 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 4 to 11, NON_VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: NON_VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: true } } }
I20260709 13:10:53.635977 22827 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 15 to 16, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 16 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.637748 22827 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 13 to 17, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 17 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.639220 22827 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 11, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 11 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.642957 22827 catalog_manager.cc:5697] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 13 to 15, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 15 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.658993 22827 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 11 to 12, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.660465 22827 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 11 to 12, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 12 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.661782 22827 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 7 to 10, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.663084 22827 catalog_manager.cc:5697] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 6 to 12, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 12 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.666467 22827 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 11, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:53.706542 22828 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35496 (request call id 376) took 26658 ms (client timeout 15000 ms). Trace:
W20260709 13:10:53.707027 22828 rpcz_store.cc:269] 0709 13:10:27.047832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.048007 (+   175us) service_pool.cc:224] Handling call
0709 13:10:53.510211 (+26462204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.510236 (+    25us) write_op.cc:454] Released schema lock
0709 13:10:53.706480 (+196244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:53.498626 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:53.499222 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:53.499263 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:10:53.499278 (+    15us) tablet.cc:662] Decoding operations
0709 13:10:53.499607 (+   329us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:53.499685 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:53.499719 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:53.499921 (+   202us) tablet.cc:701] Row locks acquired
0709 13:10:53.499939 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:53.500103 (+   164us) write_op.cc:270] Start()
0709 13:10:53.500212 (+   109us) write_op.cc:276] Timestamp: P: 1783602653500055 usec, L: 0
0709 13:10:53.500231 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:53.500840 (+   609us) log.cc:844] Serialized 541 byte log entry
0709 13:10:53.503788 (+  2948us) op_driver.cc:464] REPLICATION: finished
0709 13:10:53.504733 (+   945us) write_op.cc:301] APPLY: starting
0709 13:10:53.504820 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:53.505883 (+  1063us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:53.506038 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:53.506741 (+   703us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:53.506904 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:53.506948 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:53.507119 (+   171us) log.cc:844] Serialized 25 byte log entry
0709 13:10:53.507334 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.507437 (+   103us) write_op.cc:454] Released schema lock
0709 13:10:53.507495 (+    58us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":46,"reported_tablets":46,"spinlock_wait_cycles":4864,"child_traces":[["op",{"apply.queue_time_us":700,"apply.run_cpu_time_us":3089,"apply.run_wall_time_us":5360,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4192,"num_ops":1,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":2480,"prepare.run_wall_time_us":2480,"replication_time_us":3437}]]}
I20260709 13:10:53.840884 22829 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 12 to 13, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.843170 23652 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:53.846127 22829 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 7 to 9, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 9 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.840915 22827 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60284 (request call id 262) took 1205 ms. Trace:
I20260709 13:10:53.847929 22827 rpcz_store.cc:276] 0709 13:10:52.635296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.635467 (+   171us) service_pool.cc:224] Handling call
0709 13:10:53.840830 (+1205363us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:53.701404 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:53.701971 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:53.702009 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:10:53.702031 (+    22us) tablet.cc:662] Decoding operations
0709 13:10:53.703477 (+  1446us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:53.703554 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:53.703587 (+    33us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:10:53.705359 (+  1772us) tablet.cc:701] Row locks acquired
0709 13:10:53.705384 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:10:53.705510 (+   126us) write_op.cc:270] Start()
0709 13:10:53.705627 (+   117us) write_op.cc:276] Timestamp: P: 1783602653705467 usec, L: 0
0709 13:10:53.705648 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:10:53.706259 (+   611us) log.cc:844] Serialized 5958 byte log entry
0709 13:10:53.727185 (+ 20926us) op_driver.cc:464] REPLICATION: finished
0709 13:10:53.729788 (+  2603us) write_op.cc:301] APPLY: starting
0709 13:10:53.729867 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:53.739802 (+  9935us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:53.739909 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:53.781192 (+ 41283us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:53.781441 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:10:53.781488 (+    47us) write_op.cc:312] APPLY: finished
0709 13:10:53.781870 (+   382us) log.cc:844] Serialized 139 byte log entry
0709 13:10:53.795815 (+ 13945us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.795993 (+   178us) write_op.cc:454] Released schema lock
0709 13:10:53.796050 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:53.829892 (+ 33842us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.829936 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75332,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":2381,"apply.run_cpu_time_us":17607,"apply.run_wall_time_us":66793,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62880,"num_ops":15,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":4770,"prepare.run_wall_time_us":36291,"replication_time_us":21397}]]}
I20260709 13:10:53.851748 22829 catalog_manager.cc:5697] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 5 to 7, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 7 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:53.863448 22829 catalog_manager.cc:5697] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.865818 22829 catalog_manager.cc:5697] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 8 to 9, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 9 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.883508 23080 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:53.885082 28306 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:53.886740 23006 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:53.882432 22829 catalog_manager.cc:5697] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 4 to 14, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 14 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.888899 22829 catalog_manager.cc:5697] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 7 to 10, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 10 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.890933 28306 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:53.919472 28273 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 9 to 11, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.926507 28389 ts_tablet_manager.cc:933] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Initiating tablet copy from peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:53.929958 23001 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 9 to 11, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.946540 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5adc1058fd2948e382bcd0ee2213ab3a with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:53.948565 22827 catalog_manager.cc:5697] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 9 to 12, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 12 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.950265 22827 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 13 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.951644 22827 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 4 to 11, NON_VOTER 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) added. New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: NON_VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: true } } }
I20260709 13:10:53.956060 22827 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 11 to 12, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 12 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.957425 22827 catalog_manager.cc:5697] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 13 to 15, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 15 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.975292 23078 raft_consensus.cc:2955] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 9 to 11, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:53.985338 22829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35496 (request call id 377) took 6992 ms. Trace:
I20260709 13:10:53.985962 22829 rpcz_store.cc:276] 0709 13:10:47.012975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.023228 (+ 10253us) service_pool.cc:224] Handling call
0709 13:10:53.926053 (+6902825us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.926078 (+    25us) write_op.cc:454] Released schema lock
0709 13:10:53.985263 (+ 59185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:53.900200 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:53.900858 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:53.900898 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:10:53.900924 (+    26us) tablet.cc:662] Decoding operations
0709 13:10:53.901934 (+  1010us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:53.902012 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:53.902056 (+    44us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:10:53.902821 (+   765us) tablet.cc:701] Row locks acquired
0709 13:10:53.902846 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:10:53.903020 (+   174us) write_op.cc:270] Start()
0709 13:10:53.903151 (+   131us) write_op.cc:276] Timestamp: P: 1783602653902956 usec, L: 0
0709 13:10:53.903180 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:10:53.903931 (+   751us) log.cc:844] Serialized 2860 byte log entry
0709 13:10:53.913182 (+  9251us) op_driver.cc:464] REPLICATION: finished
0709 13:10:53.914419 (+  1237us) write_op.cc:301] APPLY: starting
0709 13:10:53.914489 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:53.918195 (+  3706us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:53.918276 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:53.923780 (+  5504us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:53.924037 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:10:53.924077 (+    40us) write_op.cc:312] APPLY: finished
0709 13:10:53.924320 (+   243us) log.cc:844] Serialized 73 byte log entry
0709 13:10:53.925224 (+   904us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.925372 (+   148us) write_op.cc:454] Released schema lock
0709 13:10:53.925428 (+    56us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":127464,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1033,"apply.run_cpu_time_us":9092,"apply.run_wall_time_us":11289,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29344,"num_ops":7,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":4089,"prepare.run_wall_time_us":19637,"replication_time_us":9863}]]}
I20260709 13:10:54.023554 28389 tablet_copy_client.cc:323] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: tablet copy: Beginning tablet copy session from remote peer at address 127.21.67.195:45219
I20260709 13:10:54.025604 23090 tablet_copy_service.cc:140] P b655449a388a41e3a606c6ea794825ad: Received BeginTabletCopySession request for tablet da207091d69d47c2a67b181645327e1c from peer 216ff6323e434e399d196d8ba262c8f3 ({username='slave'} at 127.0.0.1:34268)
I20260709 13:10:54.057128 22826 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:54.063454 22826 catalog_manager.cc:5697] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 13 to 15, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 15 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.066598 22826 catalog_manager.cc:5697] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:54.070844 22826 catalog_manager.cc:5697] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 15 to 17, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 17 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.072734 22826 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.074541 22826 catalog_manager.cc:5697] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.075929 22826 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 13 to 15, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 15 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } }
I20260709 13:10:54.077530 22826 catalog_manager.cc:5697] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 10 to 12, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.116488 23090 tablet_copy_service.cc:161] P b655449a388a41e3a606c6ea794825ad: Beginning new tablet copy session on tablet da207091d69d47c2a67b181645327e1c from peer 216ff6323e434e399d196d8ba262c8f3 at {username='slave'} at 127.0.0.1:34268: session id = 216ff6323e434e399d196d8ba262c8f3-da207091d69d47c2a67b181645327e1c
I20260709 13:10:54.144722 22827 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 9 to 11, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.156792 23090 tablet_copy_source_session.cc:215] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:54.162408 28389 ts_tablet_manager.cc:1916] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 13:10:54.202821 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adc1058fd2948e382bcd0ee2213ab3a with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40876
I20260709 13:10:54.212308 28389 ts_tablet_manager.cc:1929] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.3
I20260709 13:10:54.214303 28389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da207091d69d47c2a67b181645327e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.217453 22829 catalog_manager.cc:5697] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 7 to 8, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 8 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.220757 22829 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 reported cstate change: term changed from 12 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193). New cstate: current_term: 13 leader_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.225638 28391 tablet_replica.cc:333] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:54.232728 28391 raft_consensus.cc:2243] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.239477 28391 raft_consensus.cc:2272] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.250593 28391 ts_tablet_manager.cc:1916] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:54.238799 28389 tablet_copy_client.cc:806] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:54.264097 28389 tablet_copy_client.cc:670] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:54.267526 22826 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35508 (request call id 375) took 1672 ms. Trace:
I20260709 13:10:54.277932 23001 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:54.267936 22826 rpcz_store.cc:276] 0709 13:10:52.596236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.598658 (+  2422us) service_pool.cc:224] Handling call
0709 13:10:54.267468 (+1668810us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:54.084129 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:54.084658 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:54.084689 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:10:54.084705 (+    16us) tablet.cc:662] Decoding operations
0709 13:10:54.085507 (+   802us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:54.085572 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:54.085612 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:10:54.089006 (+  3394us) tablet.cc:701] Row locks acquired
0709 13:10:54.089021 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:10:54.089150 (+   129us) write_op.cc:270] Start()
0709 13:10:54.089250 (+   100us) write_op.cc:276] Timestamp: P: 1783602654089111 usec, L: 0
0709 13:10:54.089268 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:10:54.089854 (+   586us) log.cc:844] Serialized 3258 byte log entry
0709 13:10:54.096799 (+  6945us) op_driver.cc:464] REPLICATION: finished
0709 13:10:54.097213 (+   414us) write_op.cc:301] APPLY: starting
0709 13:10:54.097287 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:54.102717 (+  5430us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:54.102814 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:54.115207 (+ 12393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:54.115410 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:10:54.115464 (+    54us) write_op.cc:312] APPLY: finished
0709 13:10:54.126149 (+ 10685us) log.cc:844] Serialized 81 byte log entry
0709 13:10:54.134741 (+  8592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.134859 (+   118us) write_op.cc:454] Released schema lock
0709 13:10:54.134906 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:54.135231 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.135256 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":10329,"apply.run_wall_time_us":37980,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33536,"num_ops":8,"prepare.queue_time_us":164,"prepare.run_cpu_time_us":3330,"prepare.run_wall_time_us":7722,"replication_time_us":7406}]]}
I20260709 13:10:54.295754 28389 tablet_copy_client.cc:538] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:54.330688 23655 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:54.332379 28342 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:54.336483 23080 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:54.348084 28303 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:54.360991 28389 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap starting.
I20260709 13:10:54.389508 28391 ts_tablet_manager.cc:1929] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:10:54.394945 28391 log.cc:1199] T 5adc1058fd2948e382bcd0ee2213ab3a P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/5adc1058fd2948e382bcd0ee2213ab3a
I20260709 13:10:54.402061 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet 5adc1058fd2948e382bcd0ee2213ab3a (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:10:54.411862 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.404778 28342 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:54.408098 23080 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:54.468250 22815 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e54cbb7e06ba404b91d84809d3aa8548 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:54.479535 22825 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: config changed from index 5 to 9, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 9 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.486954 23655 raft_consensus.cc:2955] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } }
I20260709 13:10:54.494436 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet e54cbb7e06ba404b91d84809d3aa8548 with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40876
I20260709 13:10:54.496172 28391 tablet_replica.cc:333] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:54.497331 28391 raft_consensus.cc:2243] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.498029 28391 raft_consensus.cc:2272] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.528990 28391 ts_tablet_manager.cc:1916] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:54.600088 28389 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:54.601183 28389 tablet_bootstrap.cc:492] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Bootstrap complete.
I20260709 13:10:54.601948 28389 ts_tablet_manager.cc:1403] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Time spent bootstrapping tablet: real 0.241s	user 0.040s	sys 0.016s
I20260709 13:10:54.608489 28389 raft_consensus.cc:359] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: NON_VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: true } }
I20260709 13:10:54.609337 28389 raft_consensus.cc:740] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Initialized, Role: LEARNER
I20260709 13:10:54.610013 28389 consensus_queue.cc:260] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: NON_VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: true } }
I20260709 13:10:54.619837 28389 ts_tablet_manager.cc:1434] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:54.621632 23090 tablet_copy_service.cc:342] P b655449a388a41e3a606c6ea794825ad: Request end of tablet copy session 216ff6323e434e399d196d8ba262c8f3-da207091d69d47c2a67b181645327e1c received from {username='slave'} at 127.0.0.1:34268
I20260709 13:10:54.622139 23090 tablet_copy_service.cc:434] P b655449a388a41e3a606c6ea794825ad: ending tablet copy session 216ff6323e434e399d196d8ba262c8f3-da207091d69d47c2a67b181645327e1c on tablet da207091d69d47c2a67b181645327e1c with peer 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:54.730525 28391 ts_tablet_manager.cc:1929] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:10:54.748730 28391 log.cc:1199] T e54cbb7e06ba404b91d84809d3aa8548 P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/e54cbb7e06ba404b91d84809d3aa8548
I20260709 13:10:54.752815 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet e54cbb7e06ba404b91d84809d3aa8548 (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:10:54.765515 23001 raft_consensus.cc:1217] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.10->[10.11-10.11]   Dedup: 10.11->[]
I20260709 13:10:54.868019 22922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:41586
I20260709 13:10:54.868875 22922 raft_consensus.cc:606] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:54.944773 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:54.945338 23002 raft_consensus.cc:606] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:54.968499 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a"
dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:46576
I20260709 13:10:54.969130 23002 raft_consensus.cc:606] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:54.972968 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:41586
I20260709 13:10:54.973496 22924 raft_consensus.cc:606] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Received request to transfer leadership to TS 01988c2c817947859340a730b7f1247d
I20260709 13:10:54.983624 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d"
dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
mode: GRACEFUL
new_leader_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:41586
I20260709 13:10:54.984158 22924 raft_consensus.cc:606] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Received request to transfer leadership to TS b655449a388a41e3a606c6ea794825ad
I20260709 13:10:54.987031 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:54.988580 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:55.041591 28403 raft_consensus.cc:993] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:10:55.046080 28169 raft_consensus.cc:1081] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:10:55.047602 23655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47786
I20260709 13:10:55.048148 23655 raft_consensus.cc:493] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.048497 23655 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.054580 23655 raft_consensus.cc:515] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.057921 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:55.058508 22922 raft_consensus.cc:3055] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:55.058806 22922 raft_consensus.cc:740] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:55.059523 22922 consensus_queue.cc:260] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.060617 22922 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.095000 22922 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:55.096807 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f4021a98714bc6b65420cc163e3a91" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:55.097846 23002 raft_consensus.cc:3060] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.105244 28403 raft_consensus.cc:993] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.105778 28403 raft_consensus.cc:1081] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.114046 23078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:10:55.114566 23078 raft_consensus.cc:493] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.114879 23078 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:55.122721 23078 raft_consensus.cc:515] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:55.125487 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:55.125991 23006 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:55.128815 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19265c3b4d3344e492485458bb4cc867" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:55.129372 22924 raft_consensus.cc:3055] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:55.129632 22924 raft_consensus.cc:740] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:55.130280 22924 consensus_queue.cc:260] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:55.131232 22924 raft_consensus.cc:3060] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:55.133577 23006 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:55.134670 23045 leader_election.cc:304] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:55.135406 28145 raft_consensus.cc:2804] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:55.135896 28145 raft_consensus.cc:697] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:55.136842 28145 consensus_queue.cc:237] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:55.142127 23078 leader_election.cc:290] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 9 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:55.150662 23002 raft_consensus.cc:2468] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:55.155166 23621 leader_election.cc:304] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:55.156090 28306 raft_consensus.cc:2804] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:55.156637 28306 raft_consensus.cc:697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:55.157801 28306 consensus_queue.cc:237] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.097298 23655 leader_election.cc:290] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:55.161531 22825 catalog_manager.cc:5697] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 8 to 9, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 9 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.153892 22924 raft_consensus.cc:2468] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:55.181933 22829 catalog_manager.cc:5697] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 13, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 13 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.209025 28402 raft_consensus.cc:993] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.211747 28303 raft_consensus.cc:1081] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.219885 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:10:55.220458 23080 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.220816 23080 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.228318 23080 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.231041 23080 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:55.232199 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:55.232976 23655 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.237075 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:55.237630 23006 raft_consensus.cc:3055] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:55.237902 23006 raft_consensus.cc:740] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:55.244324 23655 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 18.
I20260709 13:10:55.245637 23045 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:55.246423 27807 raft_consensus.cc:2804] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:55.247731 27807 raft_consensus.cc:697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 18 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:55.251282 23006 consensus_queue.cc:260] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.251678 27807 consensus_queue.cc:237] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.254192 23006 raft_consensus.cc:3060] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.272053 23006 raft_consensus.cc:2468] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 18.
I20260709 13:10:55.335507 28392 raft_consensus.cc:993] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.336236 28402 raft_consensus.cc:1081] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.346665 22829 catalog_manager.cc:5697] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 17 to 18, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 18 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.350278 27807 raft_consensus.cc:1064] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: attempting to promote NON_VOTER 216ff6323e434e399d196d8ba262c8f3 to VOTER
I20260709 13:10:55.350541 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:10:55.351097 23080 raft_consensus.cc:493] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.351429 23080 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.352743 27807 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } }
I20260709 13:10:55.366146 23080 raft_consensus.cc:515] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.368136 23080 leader_election.cc:290] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:55.383960 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:55.384522 23648 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.392176 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ed8a46c5e4f158f63440eb6fbef0a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:55.392824 23006 raft_consensus.cc:3055] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:55.393148 23006 raft_consensus.cc:740] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:55.393927 23006 consensus_queue.cc:260] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.395203 23006 raft_consensus.cc:3060] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.399308 23648 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:55.428318 23045 leader_election.cc:304] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:55.429327 28401 raft_consensus.cc:2804] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:55.429847 28401 raft_consensus.cc:697] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:55.430756 28401 consensus_queue.cc:237] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.434110 28404 raft_consensus.cc:993] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: : Instructing follower b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.434610 28404 raft_consensus.cc:1081] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Signalling peer b655449a388a41e3a606c6ea794825ad to start an election
I20260709 13:10:55.436591 23080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
 from {username='slave'} at 127.0.0.1:34280
I20260709 13:10:55.437153 23080 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.437501 23080 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.487473 23002 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEARNER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:10:55.492453 28396 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:55.494164 23080 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.497825 23006 raft_consensus.cc:2468] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:55.504050 22924 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:10:55.504505 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "0db2f61e34a24096a5baf0de9a32d4f7"
I20260709 13:10:55.505060 22922 raft_consensus.cc:3055] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:55.505338 23080 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:55.505345 22922 raft_consensus.cc:740] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0db2f61e34a24096a5baf0de9a32d4f7, State: Running, Role: LEADER
I20260709 13:10:55.506388 22922 consensus_queue.cc:260] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.507714 22922 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.508993 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:55.509529 23655 raft_consensus.cc:3060] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.522373 23655 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:55.522490 22922 raft_consensus.cc:2468] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:55.523429 23045 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:55.525250 23648 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:10:55.526253 28396 raft_consensus.cc:2804] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:55.529889 28396 raft_consensus.cc:697] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:55.530853 28396 consensus_queue.cc:237] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:55.525913 28418 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:10:55.540562 27807 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:55.564646 22829 catalog_manager.cc:5697] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 12 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.568234 23006 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:55.569695 27807 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:55.584008 23006 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:55.588353 28273 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:55.601887 27807 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Committing config change with OpId 10.12: config changed from index 11 to 12, 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:55.607496 22922 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Committing config change with OpId 10.12: config changed from index 11 to 12, 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:55.615132 22924 raft_consensus.cc:1275] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:55.619971 28401 consensus_queue.cc:1048] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:55.637197 22829 catalog_manager.cc:5697] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 12 to 13, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.662997 23648 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Committing config change with OpId 10.12: config changed from index 11 to 12, 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:55.675310 22922 raft_consensus.cc:1275] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:55.676853 28273 consensus_queue.cc:1048] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:55.691695 22829 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 11 to 12, 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:55.753109 28420 log.cc:927] Time spent T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 13:10:55.757676 23002 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Committing config change with OpId 10.12: config changed from index 11 to 12, 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { replace: true } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:55.800568 23002 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 18 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:55.802636 28401 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:55.810885 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 59555.1us
I20260709 13:10:55.828344 23657 raft_consensus.cc:1275] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:55.833277 23080 consensus_queue.cc:237] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } }
I20260709 13:10:55.834255 28401 consensus_queue.cc:1048] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:55.843094 23001 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 10 index: 13. (index mismatch)
I20260709 13:10:55.854956 22999 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:55.860170 28396 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:55.850915 28401 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:10:55.874991 23648 raft_consensus.cc:1275] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 10 index: 13. (index mismatch)
I20260709 13:10:55.879869 28418 consensus_queue.cc:1048] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:55.896462 28396 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Committing config change with OpId 10.13: config changed from index 12 to 13, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:55.902272 23006 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Committing config change with OpId 10.13: config changed from index 12 to 13, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:55.916605 23648 raft_consensus.cc:2955] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Committing config change with OpId 10.13: config changed from index 12 to 13, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:55.933691 22929 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:55.936640 28401 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:55.937577 28433 log.cc:927] Time spent T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:55.989442 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:55.991171 23657 raft_consensus.cc:1275] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:55.993857 22814 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da207091d69d47c2a67b181645327e1c with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:55.995048 22827 catalog_manager.cc:5697] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d reported cstate change: config changed from index 12 to 13, VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) evicted. New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } } }
I20260709 13:10:56.009337 22913 tablet_service.cc:1558] Processing DeleteTablet for tablet da207091d69d47c2a67b181645327e1c with delete_type TABLET_DATA_TOMBSTONED (TS 0db2f61e34a24096a5baf0de9a32d4f7 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:40876
I20260709 13:10:56.018201 28418 consensus_queue.cc:1048] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:56.028290 23648 raft_consensus.cc:1275] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:56.032007 28396 consensus_queue.cc:1048] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:56.046134 28439 tablet_replica.cc:333] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.047816 28439 raft_consensus.cc:2243] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.048696 28439 raft_consensus.cc:2272] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:56.065828 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 71958.2us
I20260709 13:10:56.096868 28439 ts_tablet_manager.cc:1916] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:56.190057 28439 ts_tablet_manager.cc:1929] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.12
I20260709 13:10:56.198385 28439 log.cc:1199] T da207091d69d47c2a67b181645327e1c P 0db2f61e34a24096a5baf0de9a32d4f7: Deleting WAL directory at /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/wals/da207091d69d47c2a67b181645327e1c
I20260709 13:10:56.200136 22816 catalog_manager.cc:5028] TS 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): tablet da207091d69d47c2a67b181645327e1c (table test-workload [id=872230e774634a39b5e9768204a6ad91]) successfully deleted
I20260709 13:10:56.268155 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
W20260709 13:10:56.275489 23622 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:10:56.302416 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.306806 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.340574 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.351153 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.377317 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.378242 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.401291 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.409242 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.415809 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.434278 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.443045 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.444427 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.476679 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.487540 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.530383 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:56.547168 21775 tablet_replica.cc:333] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.548318 21775 raft_consensus.cc:2243] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.549054 21775 raft_consensus.cc:2272] T a934a76e20344681bde221224fb9da0d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.552239 21775 tablet_replica.cc:333] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.553030 21775 raft_consensus.cc:2243] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.553571 21775 raft_consensus.cc:2272] T 58c95f8b8069443eb62239e90ed53fa1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.557475 21775 tablet_replica.cc:333] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.558279 21775 raft_consensus.cc:2243] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.563283 21775 raft_consensus.cc:2272] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.567035 21775 tablet_replica.cc:333] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
W20260709 13:10:56.567044 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.568003 21775 raft_consensus.cc:2243] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Raft consensus shutting down.
W20260709 13:10:56.572381 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.574743 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.576139 21775 raft_consensus.cc:2272] T 590119d9a7e74f099c0a28550f4fb3f5 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.578795 21775 tablet_replica.cc:333] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
W20260709 13:10:56.591162 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.603947 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.611488 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.589071 21775 raft_consensus.cc:2243] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.662809 21775 raft_consensus.cc:2272] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.668741 21775 tablet_replica.cc:333] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.678320 21775 raft_consensus.cc:2243] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:56.694460 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.711673 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:56.715288 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.720669 21775 raft_consensus.cc:2272] T 8a155859ea9d41f4a7ccad8246c9c2ba P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:56.728329 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.731041 21775 tablet_replica.cc:333] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.737651 21775 raft_consensus.cc:2243] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.739763 21775 raft_consensus.cc:2272] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:56.743052 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.743841 21775 tablet_replica.cc:333] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.745250 21775 raft_consensus.cc:2243] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.747352 21775 raft_consensus.cc:2272] T 8e8b5f462dc44c7d96f09188ade5c13d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.751693 21775 tablet_replica.cc:333] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.753209 21775 raft_consensus.cc:2243] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.754642 21775 raft_consensus.cc:2272] T 2aadad04f3914b6998492885aaba04f6 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.758239 21775 tablet_replica.cc:333] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
W20260709 13:10:56.759073 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.759426 21775 raft_consensus.cc:2243] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.762341 21775 raft_consensus.cc:2272] T 2534f3909dce4851918d5cc9a252f085 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.765431 21775 tablet_replica.cc:333] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.766848 21775 raft_consensus.cc:2243] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.769112 21775 raft_consensus.cc:2272] T d86fa0480a7543048d2dc4f8046cd314 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.772433 21775 tablet_replica.cc:333] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.773696 21775 raft_consensus.cc:2243] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.774636 21775 raft_consensus.cc:2272] T 19265c3b4d3344e492485458bb4cc867 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.777782 21775 tablet_replica.cc:333] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.784099 21775 raft_consensus.cc:2243] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.787421 21775 raft_consensus.cc:2272] T e257e4274a884c2b87551c41d6072956 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.803293 21775 tablet_replica.cc:333] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.804824 21775 raft_consensus.cc:2243] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.806252 21775 raft_consensus.cc:2272] T adf5adaae5184191bdaff064d051da2a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.809481 21775 tablet_replica.cc:333] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.810396 21775 raft_consensus.cc:2243] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.812206 21775 raft_consensus.cc:2272] T 808909fe49ff4730b32151fb7a7b559e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:56.828390 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.830715 21775 tablet_replica.cc:333] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.832096 21775 raft_consensus.cc:2243] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.835150 21775 raft_consensus.cc:2272] T f09dae9312b04b4c8d390ab7d430e7cb P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.862416 21775 tablet_replica.cc:333] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
W20260709 13:10:56.870081 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.863394 21775 raft_consensus.cc:2243] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.877246 21775 raft_consensus.cc:2272] T eccda721d3ee4ac79479134d323b9640 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.892967 21775 tablet_replica.cc:333] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.894153 21775 raft_consensus.cc:2243] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.930665 21775 raft_consensus.cc:2272] T 94bcbf412cf54b0fa378f2ce70dec99f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.934976 21775 tablet_replica.cc:333] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.975832 21775 raft_consensus.cc:2243] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.977360 21775 raft_consensus.cc:2272] T 72f4ca03b8704b4ca2ad66da9add8692 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.989567 21775 tablet_replica.cc:333] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:56.998771 21775 raft_consensus.cc:2243] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.044394 21775 raft_consensus.cc:2272] T b8c270d6f9de4942999edb2e7e999066 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.048772 21775 tablet_replica.cc:333] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.050844 21775 raft_consensus.cc:2243] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.074613 21775 raft_consensus.cc:2272] T ca18e836a5464ec5b09378b03ae8b23f P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.109344 21775 tablet_replica.cc:333] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.110283 21775 raft_consensus.cc:2243] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.111764 21775 raft_consensus.cc:2272] T 1a642095ff8a4146b8e977c3af22c826 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.115430 21775 tablet_replica.cc:333] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.116894 21775 raft_consensus.cc:2243] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.117714 21775 raft_consensus.cc:2272] T 387a947805334b78b3ac130dee5e4d40 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.121515 21775 tablet_replica.cc:333] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.122418 21775 raft_consensus.cc:2243] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.123185 21775 raft_consensus.cc:2272] T ee9d7188ba094ea3b277000bf9f3a73e P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.148442 21775 tablet_replica.cc:333] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.149453 21775 raft_consensus.cc:2243] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.150219 21775 raft_consensus.cc:2272] T f56c90b2fb06459db835049dbf5a060d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.159008 21775 tablet_replica.cc:333] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.169524 21775 raft_consensus.cc:2243] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.172802 21775 raft_consensus.cc:2272] T d3222d52f8784a58a81fe1c534bbaf98 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.177798 21775 tablet_replica.cc:333] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.179067 21775 raft_consensus.cc:2243] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.180392 21775 raft_consensus.cc:2272] T a0fd26ed0b904e01959f5f0d30437e69 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.199998 21775 tablet_replica.cc:333] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.201143 21775 raft_consensus.cc:2243] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.212277 21775 raft_consensus.cc:2272] T 003d4c22ec774af79682d96196a7e8b7 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.215399 21775 tablet_replica.cc:333] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.216315 21775 raft_consensus.cc:2243] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.217240 21775 raft_consensus.cc:2272] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.220818 21775 tablet_replica.cc:333] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.221751 21775 raft_consensus.cc:2243] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.223143 21775 raft_consensus.cc:2272] T 682d24a2200c4222a401f9ab803af214 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.226322 21775 tablet_replica.cc:333] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.231619 21775 raft_consensus.cc:2243] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.248973 21775 raft_consensus.cc:2272] T 9dfb822e7cb640e68719af6e16591c4a P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.252195 21775 tablet_replica.cc:333] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.253170 21775 raft_consensus.cc:2243] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.253926 21775 raft_consensus.cc:2272] T a5f4021a98714bc6b65420cc163e3a91 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.256886 21775 tablet_replica.cc:333] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.257790 21775 raft_consensus.cc:2243] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.258626 21775 raft_consensus.cc:2272] T 492dd607be6348c79999243a8383806d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.261459 21775 tablet_replica.cc:333] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.262184 21775 raft_consensus.cc:2243] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.263626 21775 raft_consensus.cc:2272] T 20adeb7c99154724bd868029eb5ed0df P 0db2f61e34a24096a5baf0de9a32d4f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.270104 23006 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:10:57.289149 21775 tablet_replica.cc:333] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.290290 21775 raft_consensus.cc:2243] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.333684 28169 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:10:57.334326 28169 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:57.336786 28169 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:57.339749 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:57.342198 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2806bd6497384caf84700ae1cb863e9b" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:57.380733 28169 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:10:57.381671 28169 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:57.382506 22895 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:57.383536 28404 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.386468 28169 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:57.387212 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:57.395720 28169 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:10:57.396596 28169 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:57.399977 28169 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:57.408015 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:57.437819 22896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 48666.6us
I20260709 13:10:57.438297 21775 raft_consensus.cc:2272] T 71491ce9117b44a08c83b84589d0ba9d P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.439741 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:57.441829 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:57.451211 21775 tablet_replica.cc:333] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.452214 21775 raft_consensus.cc:2243] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:57.460239 22972 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.464735 23657 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
I20260709 13:10:57.464905 21775 raft_consensus.cc:2272] T 2806bd6497384caf84700ae1cb863e9b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.467770 22896 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:57.470523 21775 tablet_replica.cc:333] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.471338 21775 raft_consensus.cc:2243] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.471920 28458 raft_consensus.cc:2706] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Received pre-election callback for term 11 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:10:57.473076 22896 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0db2f61e34a24096a5baf0de9a32d4f7; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:57.473795 28458 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.474917 21775 raft_consensus.cc:2272] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.476071 23076 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
I20260709 13:10:57.467803 28392 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:10:57.482792 21775 tablet_replica.cc:333] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.483227 28447 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:57.484445 21775 raft_consensus.cc:2243] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.490374 21775 raft_consensus.cc:2272] T 8c7d0f07529640fcbd96e1a627491d86 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.493561 21775 tablet_replica.cc:333] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.494287 21775 raft_consensus.cc:2243] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.495390 21775 raft_consensus.cc:2272] T e45d03aff8ab48f6bc531f18ca6d386c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.508829 21775 tablet_replica.cc:333] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.509680 21775 raft_consensus.cc:2243] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.510355 21775 raft_consensus.cc:2272] T 9c57d9be04024fee96aa769711f72d7c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.513518 21775 tablet_replica.cc:333] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.514303 21775 raft_consensus.cc:2243] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.529819 21775 raft_consensus.cc:2272] T 7c435cd2efc84579b5b18dbaa04ee538 P 0db2f61e34a24096a5baf0de9a32d4f7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.539688 28342 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Committing config change with OpId 15.16: config changed from index 5 to 16, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
I20260709 13:10:57.551549 21775 tablet_replica.cc:333] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.552294 21775 raft_consensus.cc:2243] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.555264 23079 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Committing config change with OpId 15.16: config changed from index 5 to 16, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
I20260709 13:10:57.558394 28454 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:57.559141 28454 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:57.563953 21775 raft_consensus.cc:2272] T f5db53771823404097dd71493c3b242b P 0db2f61e34a24096a5baf0de9a32d4f7 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:57.570644 22972 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:57.573390 28454 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:57.574555 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:57.576149 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:57.576076 23657 raft_consensus.cc:2955] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Committing config change with OpId 15.16: config changed from index 5 to 16, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
I20260709 13:10:57.581205 21775 tablet_replica.cc:333] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7: stopping tablet replica
I20260709 13:10:57.580941 22825 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 5 to 16, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New cstate: current_term: 15 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
I20260709 13:10:57.581883 21775 raft_consensus.cc:2243] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.582772 21775 raft_consensus.cc:2272] T ce98d2857d3f449c8d9052124b418f8c P 0db2f61e34a24096a5baf0de9a32d4f7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.577417 28454 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.709564 28456 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:57.710546 28456 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:57.713285 28456 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:57.717007 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:57.720329 23622 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:57.720824 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:57.721990 28456 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.845366 28436 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:57.845976 28436 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:57.848320 28436 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:57.858172 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:57.872082 23046 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:57.872650 23046 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:57.892120 28436 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:57.934484 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 52481.4us
I20260709 13:10:57.944868 28440 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:57.945437 28440 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:57.947773 28440 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:57.950671 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:57.951339 23657 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
W20260709 13:10:57.951547 23046 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:57.954190 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:57.955420 28440 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.955902 28440 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:57.956321 28440 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.959489 28453 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:57.960124 28453 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:57.962950 28453 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:57.963996 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:57.964605 23006 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:57.965785 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:57.966548 28453 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:57.966905 28453 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:57.967260 28453 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:57.972774 23622 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:57.989224 28440 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:57.991490 28440 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:57.992633 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:57.993275 23648 raft_consensus.cc:3060] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:57.994382 23046 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:58.000751 23648 raft_consensus.cc:2468] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:58.002117 23045 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.003106 28440 raft_consensus.cc:2804] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:58.003672 28440 raft_consensus.cc:697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 14 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:58.004673 28440 consensus_queue.cc:237] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.023908 28453 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.027102 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:58.027765 23006 raft_consensus.cc:3060] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.030591 28342 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.031234 28342 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.033110 28342 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.035274 23006 raft_consensus.cc:2468] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
I20260709 13:10:58.036439 23621 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:58.037281 28456 raft_consensus.cc:2804] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:58.042398 22825 catalog_manager.cc:5697] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 13 to 14, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 14 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.048105 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:10:58.051990 22972 connection.cc:769] client connection to 127.21.67.193:39171 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:10:58.065640 28465 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.066246 28465 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.067965 28453 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:58.071727 23046 leader_election.cc:336] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:58.072721 28465 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.100865 28454 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.101501 28454 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.103243 28465 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.103734 28454 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:58.103886 28465 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.106417 28465 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:58.109404 23046 leader_election.cc:336] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:58.116302 28469 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.118402 28469 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.121814 28469 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.122786 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:58.123432 23006 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:10:58.124606 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:58.126487 28469 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:58.127720 28469 raft_consensus.cc:493] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.128110 28469 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.140061 28469 raft_consensus.cc:515] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:58.140110 23622 connection.cc:769] client connection to 127.21.67.193:39171 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:10:58.132022 28456 raft_consensus.cc:697] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
W20260709 13:10:58.146795 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 91608.5us
I20260709 13:10:58.152657 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:58.153386 23655 raft_consensus.cc:2393] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 14: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:58.156829 28456 consensus_queue.cc:237] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.174546 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7518f17f1ae4b619ddf2d5e1eeb0c3d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:58.175300 23002 raft_consensus.cc:3060] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.184981 23002 raft_consensus.cc:2468] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:10:58.186021 23621 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:58.186940 28472 raft_consensus.cc:2804] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:58.187657 28472 raft_consensus.cc:697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:58.188369 28469 leader_election.cc:290] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.188895 28472 consensus_queue.cc:237] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.192821 28447 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.197477 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:58.193608 28447 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.206065 23006 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 14.
I20260709 13:10:58.208873 28447 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.196573 28453 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.210409 28453 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.212589 28453 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.214228 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:58.214917 22999 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 16.
I20260709 13:10:58.217178 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:58.220664 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.221453 28440 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:58.221798 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:58.220674 28467 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:58.222738 28467 raft_consensus.cc:493] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.221838 28440 raft_consensus.cc:493] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.223133 28467 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.223446 28440 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.226879 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:58.229113 23622 leader_election.cc:336] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.229590 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:58.230933 28471 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:58.229838 23622 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:58.231914 22972 leader_election.cc:336] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.232344 22972 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:58.232873 28467 raft_consensus.cc:515] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:58.234475 23622 leader_election.cc:336] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:58.235203 23622 leader_election.cc:336] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.235358 28454 raft_consensus.cc:2749] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.235510 28447 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.235205 28342 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.236542 28342 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.237432 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eccda721d3ee4ac79479134d323b9640" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:58.238112 23006 raft_consensus.cc:3060] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.242831 28467 leader_election.cc:290] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.246492 28342 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.236169 28447 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.249774 28447 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.250749 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:58.251360 23080 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 13.
W20260709 13:10:58.254493 22972 leader_election.cc:336] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.254982 22972 leader_election.cc:304] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:58.256006 22972 leader_election.cc:336] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.259804 28454 raft_consensus.cc:2749] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.263309 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:58.263974 23080 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 16.
I20260709 13:10:58.269062 28469 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.269608 28469 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.272143 28469 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.273443 28440 raft_consensus.cc:515] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.273659 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:58.259161 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:58.275770 22972 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.252625 23006 raft_consensus.cc:2468] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 17.
I20260709 13:10:58.277122 22970 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:58.279934 28447 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:58.280241 23076 raft_consensus.cc:2393] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 15: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:58.280329 28447 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.280822 28447 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.281761 28342 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:58.282120 28342 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.282460 28342 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.282876 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8b5f462dc44c7d96f09188ade5c13d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:58.283428 22999 raft_consensus.cc:3060] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:58.292376 22972 leader_election.cc:336] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.294386 22970 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:58.296582 28440 leader_election.cc:290] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.297140 23621 leader_election.cc:304] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:10:58.298141 28467 raft_consensus.cc:2804] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:58.298660 28467 raft_consensus.cc:697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 17 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:58.299700 28467 consensus_queue.cc:237] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.303423 28342 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.304745 22999 raft_consensus.cc:2468] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 15.
I20260709 13:10:58.305488 28454 raft_consensus.cc:2749] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.306041 23045 leader_election.cc:304] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:58.308776 28471 raft_consensus.cc:2804] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:58.310606 28471 raft_consensus.cc:697] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:58.311474 28471 consensus_queue.cc:237] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.314960 28342 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.319916 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fa0480a7543048d2dc4f8046cd314" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:58.316743 22825 catalog_manager.cc:5697] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 11, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.320453 23076 raft_consensus.cc:3060] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.308250 28447 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:58.329499 22972 leader_election.cc:336] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.331387 28447 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.332477 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e257e4274a884c2b87551c41d6072956" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:58.333087 23080 raft_consensus.cc:3060] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.340518 23080 raft_consensus.cc:2468] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 14.
W20260709 13:10:58.341311 23046 leader_election.cc:336] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.341624 22970 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:58.346199 22972 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.346525 28342 raft_consensus.cc:2804] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:58.344628 23076 raft_consensus.cc:2468] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 17.
I20260709 13:10:58.348086 22970 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.348918 28342 raft_consensus.cc:697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:58.349018 28472 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.349525 28472 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.350018 28454 raft_consensus.cc:2804] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:58.350561 28454 raft_consensus.cc:697] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:58.351454 28454 consensus_queue.cc:237] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:58.354945 23622 leader_election.cc:336] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.355073 28342 consensus_queue.cc:237] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.357220 28472 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.367101 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:58.371946 28392 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.381382 22825 catalog_manager.cc:5697] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 14 to 15, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 15 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.382381 28392 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.385483 28392 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:58.389870 22972 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.390370 22826 catalog_manager.cc:5697] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 13 to 14, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 14 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:58.400014 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.399972 23622 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.400674 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:58.404709 28467 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:58.407225 23622 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.407866 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:58.408777 28456 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.415839 28436 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.416445 28436 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.394860 22826 catalog_manager.cc:5697] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 16 to 17, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 17 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.420962 28436 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:58.425398 23046 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.445982 28392 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.446750 28392 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.449230 28392 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:58.453826 22972 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.461640 28456 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.462337 28456 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.479830 28342 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:58.484022 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 91699.9us
I20260709 13:10:58.489897 28456 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.493431 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:10:58.499444 23622 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.480504 28342 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.508389 22999 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 10.
I20260709 13:10:58.509727 22826 catalog_manager.cc:5697] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 13 to 14, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 14 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.510525 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.512212 28465 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.512768 28465 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.514722 28342 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:58.514744 28465 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.511492 28467 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:58.548210 28467 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.548640 28467 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:58.519249 22972 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.511971 28436 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.561316 28436 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.511271 22826 catalog_manager.cc:5697] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 16 to 17, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 17 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.563669 28456 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.564256 28456 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:58.524678 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 152330us
I20260709 13:10:58.566488 28456 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.527900 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:58.567571 23080 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 15.
I20260709 13:10:58.529760 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:58.569339 23076 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:58.570364 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.571991 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:58.572748 23622 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.571447 22970 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:58.525322 23046 leader_election.cc:336] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.530063 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:58.535993 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:58.542796 28484 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
W20260709 13:10:58.575102 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 49803us
I20260709 13:10:58.575241 22999 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:58.575619 23002 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:10:58.580073 28342 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:58.580488 28342 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.581074 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.582347 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:58.583350 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.582335 28342 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.583746 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:10:58.584277 28440 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:58.585533 28440 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.585924 28440 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.581490 28484 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.577628 28485 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:58.588572 23620 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:10:58.589191 28471 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:58.578277 28436 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.589610 28471 raft_consensus.cc:493] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.595918 28471 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.590307 28456 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.590896 28392 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.597280 28392 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.598044 28484 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:58.610064 28342 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:58.619940 22972 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.587852 28485 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.623858 28342 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:10:58.622632 23046 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:58.624481 23046 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:58.626011 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 43924.3us
I20260709 13:10:58.628024 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:58.626142 28485 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.632962 28447 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.633540 28447 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.636114 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:58.636446 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.636761 28392 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:58.636793 23652 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 9.
I20260709 13:10:58.640240 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.641579 28454 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:58.642062 28454 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.642520 28454 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.646443 28447 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:58.649168 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:10:58.654110 22972 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:58.654888 22972 leader_election.cc:336] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.655365 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.656247 28447 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.657565 28467 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.659055 23655 raft_consensus.cc:2393] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:10:58.662279 22971 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.663740 28392 raft_consensus.cc:3060] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.666612 28471 raft_consensus.cc:515] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.670737 28440 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.672742 23076 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 216ff6323e434e399d196d8ba262c8f3 in current term 11: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:10:58.697446 22970 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:10:58.697523 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 114251us
I20260709 13:10:58.698328 28483 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.700168 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:58.700824 23652 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 11.
I20260709 13:10:58.701277 23655 raft_consensus.cc:1275] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:58.703378 28392 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.703207 28454 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.704469 28485 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:10:58.705034 23622 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.714125 28471 leader_election.cc:290] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.715029 22999 raft_consensus.cc:2393] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 16: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:58.716089 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:58.716629 23648 raft_consensus.cc:3060] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.709178 23006 raft_consensus.cc:1275] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:58.710997 23002 raft_consensus.cc:1275] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:10:58.719569 22972 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:58.720309 22972 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.711289 28454 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:58.724018 23648 raft_consensus.cc:2468] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 10.
I20260709 13:10:58.729377 23080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f4ca03b8704b4ca2ad66da9add8692" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:10:58.731917 23080 raft_consensus.cc:3060] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.724843 28485 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:10:58.728791 28476 consensus_queue.cc:1048] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:10:58.737736 28469 consensus_queue.cc:1048] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:58.738406 28467 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:58.740692 22971 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:58.741264 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.741585 28483 raft_consensus.cc:2804] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:58.742066 28483 raft_consensus.cc:697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:58.742952 28483 consensus_queue.cc:237] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.744496 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:58.746649 23078 raft_consensus.cc:1275] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:10:58.749933 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 43953.3us
I20260709 13:10:58.752065 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:10:58.757972 23080 raft_consensus.cc:2468] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 16.
I20260709 13:10:58.750872 28392 consensus_queue.cc:1048] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:10:58.740317 23046 leader_election.cc:336] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.760466 23001 raft_consensus.cc:1275] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:58.760752 22970 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.761157 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c270d6f9de4942999edb2e7e999066" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:58.759946 28484 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.767700 22998 raft_consensus.cc:3060] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.767879 28469 consensus_queue.cc:1048] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:58.770197 28392 raft_consensus.cc:2804] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.770742 28392 raft_consensus.cc:697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 16 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:10:58.771634 28392 consensus_queue.cc:237] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:58.775276 22998 raft_consensus.cc:2468] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
I20260709 13:10:58.778172 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.759634 23002 raft_consensus.cc:2468] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 11.
W20260709 13:10:58.764267 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.779870 23046 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:58.780299 23621 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:58.787091 28476 raft_consensus.cc:2804] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:58.787599 28476 raft_consensus.cc:697] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:58.787734 28488 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:58.788259 28488 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.788604 28488 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:58.788493 28476 consensus_queue.cc:237] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.807256 23078 raft_consensus.cc:1275] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:10:58.810380 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:58.804062 28465 consensus_queue.cc:1048] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:58.818282 28483 consensus_queue.cc:1048] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:10:58.849043 28440 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:58.919749 28491 log.cc:927] Time spent T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:58.933939 28488 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.938558 22826 catalog_manager.cc:5697] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 9 to 10, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 10 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:58.948165 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:58.949211 28467 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:58.957288 22825 catalog_manager.cc:5697] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 10 to 11, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.959422 28467 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:58.963162 28467 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:10:58.976284 28497 log.cc:927] Time spent T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:10:58.967731 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.990778 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.991310 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.994547 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.967041 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.020061 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 53049.1us
W20260709 13:10:59.020767 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:59.039759 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 210728us
W20260709 13:10:59.044515 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 192798us
I20260709 13:10:59.070887 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:59.071966 23002 raft_consensus.cc:2393] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 11: Already voted for candidate 216ff6323e434e399d196d8ba262c8f3 in this term.
I20260709 13:10:59.076642 22999 raft_consensus.cc:1275] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:59.043244 28488 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:59.084859 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:10:59.085599 23002 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 15.
I20260709 13:10:59.122561 22826 catalog_manager.cc:5697] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 15 to 16, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 16 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:59.144170 21775 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22952)
W20260709 13:10:59.161413 23622 leader_election.cc:336] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:59.171490 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:59.172144 23652 raft_consensus.cc:3060] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.179404 23652 raft_consensus.cc:2468] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:59.182117 28484 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:59.182900 28484 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:59.184985 28484 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:10:59.186286 23045 leader_election.cc:304] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:59.189354 28436 raft_consensus.cc:2804] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:59.189862 28436 raft_consensus.cc:697] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:59.200320 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:10:59.195819 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.202805 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.204022 28465 consensus_queue.cc:1048] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:10:59.225668 23076 raft_consensus.cc:1275] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:59.243589 28436 consensus_queue.cc:237] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:10:59.212520 28484 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:59.268373 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:59.269490 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 69998.5us
I20260709 13:10:59.273910 28487 consensus_queue.cc:1048] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:59.277750 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:10:59.281188 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.280346 23045 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:59.281915 28508 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:59.282052 28484 raft_consensus.cc:2804] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:59.282361 28508 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:59.282912 28508 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.282992 28484 raft_consensus.cc:697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:59.284169 28484 consensus_queue.cc:237] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:59.284834 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.270049 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.293301 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.302662 23046 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:59.304873 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.305902 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.328868 22998 raft_consensus.cc:1275] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:59.329860 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:10:59.330535 23649 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:10:59.351467 23649 raft_consensus.cc:1275] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:10:59.353909 28469 consensus_queue.cc:1048] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:59.360891 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:10:59.362442 28342 consensus_queue.cc:1048] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:59.373044 28495 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:59.373498 28495 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0db2f61e34a24096a5baf0de9a32d4f7)
I20260709 13:10:59.373844 28495 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:59.380901 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.381546 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.390648 28508 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:59.391921 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.399174 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 61768us
W20260709 13:10:59.406977 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 95313.7us
I20260709 13:10:59.408675 28495 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:10:59.410761 28495 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:10:59.423309 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.433408 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:10:59.434031 23654 raft_consensus.cc:3060] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:59.452036 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.474334 28508 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:10:59.487185 23654 raft_consensus.cc:2468] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:10:59.488046 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:10:59.492149 23002 raft_consensus.cc:3060] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:59.489548 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.490836 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.496505 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.496968 23046 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:59.497597 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.498191 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.510890 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.511312 23045 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:10:59.511477 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.513638 28471 raft_consensus.cc:2804] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:59.524559 23622 leader_election.cc:336] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:10:59.523852 22825 catalog_manager.cc:5697] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 11 to 12, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 12 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.519493 28471 raft_consensus.cc:697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:10:59.529075 22825 catalog_manager.cc:5697] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 9 to 10, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:59.529289 28471 consensus_queue.cc:237] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:59.534437 23046 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:10:59.535457 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.558696 23002 raft_consensus.cc:2468] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 16.
I20260709 13:10:59.565609 23621 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:10:59.573288 28508 raft_consensus.cc:2804] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:59.573772 28508 raft_consensus.cc:697] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 16 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:10:59.574596 28508 consensus_queue.cc:237] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:10:59.585978 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.618563 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.621398 22826 catalog_manager.cc:5697] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 12 to 13, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:59.630503 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:59.656344 22825 catalog_manager.cc:5697] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 15 to 16, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 16 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:59.667737 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:59.691255 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.753705 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.788184 22998 raft_consensus.cc:1275] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:59.790777 28488 consensus_queue.cc:1048] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:59.835333 23649 raft_consensus.cc:1275] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:59.836782 28471 consensus_queue.cc:1048] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:59.938473 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 81919.3us
I20260709 13:10:59.960103 23654 raft_consensus.cc:1275] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:59.967407 28471 consensus_queue.cc:1048] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:59.999979 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:00.071408 22972 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:00.095530 23002 raft_consensus.cc:1275] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:00.102469 28467 consensus_queue.cc:1048] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:00.155083 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:00.162770 21775 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:00.801740 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.817047 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 45397.8us
I20260709 13:11:00.856688 28532 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.857362 28532 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:00.860800 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:00.861467 23078 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:11:00.862814 22970 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:00.863708 28485 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:00.864090 28485 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.864420 28485 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:00.868343 28532 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:00.874066 28485 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:00.923115 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fd26ed0b904e01959f5f0d30437e69" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:00.923823 23078 raft_consensus.cc:3060] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:00.947795 28485 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:00.920244 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 82458.9us
W20260709 13:11:00.916024 22972 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:00.984030 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 68035.1us
I20260709 13:11:00.931561 23078 raft_consensus.cc:2468] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:11:01.001498 22970 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:01.003252 28485 raft_consensus.cc:2804] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:01.003793 28485 raft_consensus.cc:697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:11:01.004669 28485 consensus_queue.cc:237] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:11:01.068954 22972 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:01.070957 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 44329.6us
I20260709 13:11:01.088925 22825 catalog_manager.cc:5697] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 10 to 12, leader changed from 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:01.128013 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:01.150416 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:01.158111 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:01.163223 21775 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:01.178840 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:01.245363 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:01.276679 23046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111) [suppressed 391 similar messages]
W20260709 13:11:01.325214 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:01.430689 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:01.475929 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:01.493178 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.163728 21775 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:02.330022 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 128540us
W20260709 13:11:02.335093 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 62517.3us
W20260709 13:11:02.336601 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.337373 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.357265 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.358044 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.358677 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.359144 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.359558 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:02.362226 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.362663 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.395782 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 75619.8us
I20260709 13:11:02.399881 23078 raft_consensus.cc:1275] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:11:02.427917 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.438555 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.439203 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.443540 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.444098 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.444515 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.444955 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.445369 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:02.445403 28546 consensus_queue.cc:1048] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:02.490829 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.503443 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.506131 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.506649 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.544637 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.547384 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.548002 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.659441 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.719636 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.758458 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.766044 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.777875 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:02.784184 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.786625 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:02.882695 22860 debug-util.cc:398] Leaking SignalData structure 0x7b0800039380 after lost signal to thread 21778
W20260709 13:11:02.883791 22860 debug-util.cc:398] Leaking SignalData structure 0x7b0800336940 after lost signal to thread 22863
W20260709 13:11:02.884974 22860 debug-util.cc:398] Leaking SignalData structure 0x7b0800039d40 after lost signal to thread 23030
W20260709 13:11:02.886022 22860 debug-util.cc:398] Leaking SignalData structure 0x7b0800135b80 after lost signal to thread 23104
W20260709 13:11:02.887120 22860 debug-util.cc:398] Leaking SignalData structure 0x7b0800154560 after lost signal to thread 23681
W20260709 13:11:02.967519 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:03.164225 21775 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:03.185983 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:03.229110 22972 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:03.332499 22970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 109760us
W20260709 13:11:03.572541 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:03.682730 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.056080 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.021389 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.073621 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 52283.4us
W20260709 13:11:04.164681 21775 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:04.167397 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.295599 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.305881 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.367046 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.381207 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.488459 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.556942 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.563761 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.598565 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.649544 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.670765 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.672161 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.680780 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.776048 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.778167 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.779131 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.791869 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.800794 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.815917 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.854303 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.887938 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.951910 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:04.976310 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:04.989547 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.021556 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:05.032212 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.039426 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:05.057032 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.080161 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.148052 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.159832 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.165127 21775 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:05.179690 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.266311 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.284679 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:05.306303 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.343680 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.446031 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:05.700470 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.758167 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.858480 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 73929us
W20260709 13:11:05.888417 22972 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:05.897430 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:06.165568 21775 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:06.198257 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:06.285128 23622 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111) [suppressed 383 similar messages]
W20260709 13:11:06.299305 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:06.435849 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:06.648617 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:06.801039 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:06.932889 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:06.933775 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:06.971916 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:06.972254 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.005471 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.026644 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.037246 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:07.118148 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:07.122854 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.166206 21775 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:07.178577 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:07.199529 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 44570us
W20260709 13:11:07.201035 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.249845 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:07.251475 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.307835 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.334690 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.359905 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.367165 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:07.391075 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.452909 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.525741 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.542763 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:07.606496 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:07.607318 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.628798 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.643680 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.665980 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.678624 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.694996 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.720713 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.747107 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:07.765430 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:07.874075 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:08.042321 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:08.055928 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:08.088310 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:08.120414 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:08.166742 21775 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:08.229959 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 55809.7us
W20260709 13:11:08.382166 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:08.414060 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:08.684996 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:08.763401 22972 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.075304 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.148648 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.167258 21775 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:09.282881 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.374091 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.380532 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.401353 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.443301 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.455698 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.533702 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.546571 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.557289 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.589291 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.600728 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.623631 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.674794 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.680624 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.680624 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.713513 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.828469 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.840920 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.916952 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:09.932891 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:09.973568 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.000622 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.007100 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:10.019088 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.026722 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.044135 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:10.125653 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.126518 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.167725 21775 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:10.234804 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.252099 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.257788 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.405525 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:10.439046 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:10.440986 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.447026 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:10.716949 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.774313 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.788152 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:10.987362 22971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:35811, user_credentials={real_user=slave}} blocked reactor thread for 62292.6us
W20260709 13:11:11.025174 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:11.118763 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:11.145949 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:11.168210 21775 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:11.286754 23046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111) [suppressed 436 similar messages]
W20260709 13:11:11.302855 22972 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:11.433046 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:11.749233 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:11.779165 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:11.781847 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:11.880748 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:11.907130 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:11.966631 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:11.991756 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.014762 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.060833 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.077785 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:12.097755 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.143301 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:12.147560 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.168735 21775 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:12.205346 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:12.226892 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.227911 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.228646 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:12.278787 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.281065 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.350965 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.371567 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.394151 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.482488 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.572124 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.591837 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.593465 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.615993 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.625963 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:12.626901 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.772809 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.802387 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:12.821611 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:12.843171 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:12.868698 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:13.037978 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:13.126886 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:13.169263 21775 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:13.222260 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:13.284795 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:13.378159 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:13.506139 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:13.669750 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:13.770702 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:13.776054 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:13.848052 22972 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.167718 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.169736 21775 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:14.354992 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.416610 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.425513 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.441274 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.468371 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.498598 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.522708 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.547083 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.560310 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.567245 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.654222 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.675150 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.707230 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:14.719920 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.750754 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.762745 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.810012 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:14.821165 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:14.916787 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.046075 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.068038 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:15.076399 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.082472 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.093674 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.141395 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.145047 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.154009 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.170174 21775 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:15.301618 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:15.302300 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:15.375837 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.436580 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.445626 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:15.453147 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:16.170701 21775 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 22952)
I20260709 13:11:16.483204 28609 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.484256 28609 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.489250 28609 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.506583 28609 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.507233 28609 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.511106 28609 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.511806 28609 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.512447 28609 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.516259 28609 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.544626 28609 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.545442 28609 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.548904 28609 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.549283 28610 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.550755 28610 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.565428 28615 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:11:16.566121 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef3a0 after lost signal to thread 21778
I20260709 13:11:16.571277 28615 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.573971 28615 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.574647 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:11:16.568576 23046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111) [suppressed 368 similar messages]
I20260709 13:11:16.574815 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.577188 28610 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.577601 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.578008 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.582592 23072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.583190 23072 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 11.
I20260709 13:11:16.592494 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:16.593475 28607 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:16.593868 28607 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.594230 28607 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:16.578189 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.600301 28614 raft_consensus.cc:493] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.601023 28614 raft_consensus.cc:515] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.603505 28614 leader_election.cc:290] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:11:16.614261 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 45710.4us
I20260709 13:11:16.658308 28599 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.658934 28599 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:11:16.661049 28599 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.662249 28604 raft_consensus.cc:493] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.662774 28604 raft_consensus.cc:515] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.668279 28604 leader_election.cc:290] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.672262 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.667479 28613 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.699806 28598 raft_consensus.cc:493] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.700124 28621 raft_consensus.cc:493] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.700408 28598 raft_consensus.cc:515] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.730400 28611 raft_consensus.cc:493] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.731194 28611 raft_consensus.cc:515] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.708140 28607 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.734663 28595 raft_consensus.cc:493] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.735373 28595 raft_consensus.cc:515] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.699807 28606 raft_consensus.cc:493] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.735001 28607 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Requested vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.701648 28613 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.749768 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:16.750725 23074 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:16.737547 28614 raft_consensus.cc:493] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.760386 28614 raft_consensus.cc:515] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:16.762470 28614 leader_election.cc:290] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.737197 28621 raft_consensus.cc:515] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.753091 28595 leader_election.cc:290] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.753427 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:11:16.757736 23101 debug-util.cc:398] Leaking SignalData structure 0x7b080004c5c0 after lost signal to thread 22863
W20260709 13:11:16.771342 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc100 after lost signal to thread 23030
I20260709 13:11:16.757601 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.759778 28605 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
W20260709 13:11:16.772630 23101 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc1a0 after lost signal to thread 23104
W20260709 13:11:16.774222 23101 debug-util.cc:398] Leaking SignalData structure 0x7b0800377c80 after lost signal to thread 23681
I20260709 13:11:16.782568 23079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003d4c22ec774af79682d96196a7e8b7" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.786996 23074 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:11:16.744763 28606 raft_consensus.cc:515] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.790735 28606 leader_election.cc:290] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.790858 28621 leader_election.cc:290] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.791095 28598 leader_election.cc:290] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.792428 28613 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.793068 28608 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.795133 28605 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } }
I20260709 13:11:16.795828 28608 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.798341 28605 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:16.799124 28608 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.794586 28590 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.806469 22970 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:16.743132 28611 leader_election.cc:290] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.813196 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.812638 28590 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:11:16.812672 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.819231 28630 raft_consensus.cc:493] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.819890 28590 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.819766 28630 raft_consensus.cc:515] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.812806 28609 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:16.825835 28609 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Leader. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:11:16.812726 28629 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.826834 28629 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.834086 28629 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:16.838090 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:16.838917 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:16.839462 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:16.835268 28630 leader_election.cc:290] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:11:16.840709 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:16.844828 28609 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.848927 28630 raft_consensus.cc:493] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.849447 28630 raft_consensus.cc:515] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.851382 28630 leader_election.cc:290] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:11:16.851558 23046 leader_election.cc:336] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:16.851858 28630 raft_consensus.cc:493] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.852385 28630 raft_consensus.cc:515] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.854439 28630 leader_election.cc:290] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.859596 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:11:16.864198 23046 leader_election.cc:336] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:16.873472 28608 raft_consensus.cc:493] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.874014 28608 raft_consensus.cc:515] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.876542 28622 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.877125 28622 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.878801 28622 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.879930 28622 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.880323 28622 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.881795 28622 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.882885 28622 raft_consensus.cc:493] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.883322 28622 raft_consensus.cc:515] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.885335 28622 leader_election.cc:290] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.890798 28616 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.890339 28621 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.897989 28621 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.897872 28616 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.890983 28590 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.900203 28621 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.886232 28615 raft_consensus.cc:493] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.900290 28590 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.890110 28623 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.890514 28605 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.906801 28623 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.906989 28605 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.908869 28623 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.908988 28605 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:16.909317 28623 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.909796 28623 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.911635 28611 raft_consensus.cc:493] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.911805 28623 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:16.912196 28611 raft_consensus.cc:515] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.912737 28631 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.913286 28631 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.914564 28611 leader_election.cc:290] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.915220 28631 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:16.915429 23077 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:16.915815 28631 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.916170 28598 raft_consensus.cc:493] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.916455 28631 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.916687 28598 raft_consensus.cc:515] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.917402 28590 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.918426 28616 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.886929 28608 leader_election.cc:290] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.905879 28609 raft_consensus.cc:493] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.921003 28609 raft_consensus.cc:515] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.918463 28598 leader_election.cc:290] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.923777 28609 leader_election.cc:290] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.901203 28615 raft_consensus.cc:515] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.924758 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 13 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.931564 23001 raft_consensus.cc:1240] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Rejecting Update request from peer 01988c2c817947859340a730b7f1247d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:16.927917 28598 raft_consensus.cc:493] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:16.932649 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808909fe49ff4730b32151fb7a7b559e" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.932931 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.933163 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98d2857d3f449c8d9052124b418f8c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.933990 23005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.934166 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20adeb7c99154724bd868029eb5ed0df" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.935341 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.936002 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.932188 28598 raft_consensus.cc:515] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.918438 28631 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.937191 28605 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.937935 28598 leader_election.cc:290] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.937733 28605 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.932708 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.925657 28615 leader_election.cc:290] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.939872 28605 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:16.939911 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
W20260709 13:11:16.947602 23046 leader_election.cc:336] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:16.952404 28621 consensus_queue.cc:1059] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:16.953197 28621 consensus_queue.cc:1243] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Peer 216ff6323e434e399d196d8ba262c8f3 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:16.953788 28622 raft_consensus.cc:3055] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:16.954150 28622 raft_consensus.cc:740] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:11:16.954293 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5db53771823404097dd71493c3b242b" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.955113 28622 consensus_queue.cc:260] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.956725 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf5adaae5184191bdaff064d051da2a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.958447 28615 raft_consensus.cc:493] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01988c2c817947859340a730b7f1247d)
I20260709 13:11:16.958926 28615 raft_consensus.cc:515] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.960628 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bcbf412cf54b0fa378f2ce70dec99f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.961318 28615 leader_election.cc:290] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:16.963377 28622 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:16.967295 23046 leader_election.cc:336] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:16.971637 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a642095ff8a4146b8e977c3af22c826" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.974228 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da207091d69d47c2a67b181645327e1c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 13 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.975636 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:11:16.976488 22972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 100503us
I20260709 13:11:16.977177 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cccb8c9157c4c8f9c0a83fbb86bfdc3" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.985620 23074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492dd607be6348c79999243a8383806d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.986197 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45d03aff8ab48f6bc531f18ca6d386c" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.986467 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.984649 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.987176 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a155859ea9d41f4a7ccad8246c9c2ba" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:16.989841 28623 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.990361 28623 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:16.992393 28623 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:16.994084 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:16.993602 28623 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:16.995229 28623 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:17.000659 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:17.002017 28623 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:17.007400 23620 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.008126 28621 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:17.009274 23620 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.009936 28621 raft_consensus.cc:2749] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:17.015250 28621 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:17.015766 28621 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:17.017910 28621 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:17.014755 23620 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.046770 23620 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.062019 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.062649 28622 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:17.066133 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.068702 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387a947805334b78b3ac130dee5e4d40" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.069685 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c9f6da39cd452dbbc2fe4221c4b7ee" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.070102 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e2e961b20a4588ba99edcaeaaf578c" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.071163 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f3909dce4851918d5cc9a252f085" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.071394 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7d0f07529640fcbd96e1a627491d86" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.061524 28621 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:17.089574 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.090634 23650 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 15.
I20260709 13:11:17.061877 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.093765 23649 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 12.
I20260709 13:11:17.095078 23657 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:11:17.066068 23651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.108429 23649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.111279 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590119d9a7e74f099c0a28550f4fb3f5" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.112955 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0633fbe8ee1c4284a67d72b00a0285a0" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.114563 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:11:17.115628 23652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.124753 23652 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
I20260709 13:11:17.110811 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3222d52f8784a58a81fe1c534bbaf98" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.122154 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9dd0ac5baf440fc96bcfc581bb5d2de" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.125994 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3bed822a364ea9afe4d449542afc6b" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:11:17.142237 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:17.149633 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.159570 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56c90b2fb06459db835049dbf5a060d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:17.150637 23654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d24a2200c4222a401f9ab803af214" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.151063 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb822e7cb640e68719af6e16591c4a" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.151127 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c435cd2efc84579b5b18dbaa04ee538" candidate_uuid: "216ff6323e434e399d196d8ba262c8f3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:17.152175 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca18e836a5464ec5b09378b03ae8b23f" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:17.157128 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:17.158869 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22342f9fc8d5439e9dc7755716c74fdb" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:17.163100 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c95f8b8069443eb62239e90ed53fa1" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:11:17.166069 22972 leader_election.cc:336] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.168912 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:17.169174 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:11:17.171756 21775 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 22952)
I20260709 13:11:17.167544 23045 leader_election.cc:304] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:11:17.174523 22972 leader_election.cc:336] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.169588 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9d1a1bba44536a9f74a4b0a1ae1ff" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:17.178718 22971 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.181270 28624 raft_consensus.cc:2749] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:17.183516 28609 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.185710 23045 leader_election.cc:304] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:11:17.187031 28624 raft_consensus.cc:2749] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:17.189158 22971 leader_election.cc:304] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:11:17.189482 23045 leader_election.cc:304] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.190140 28609 raft_consensus.cc:2749] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.190475 28624 raft_consensus.cc:2749] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:17.184770 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.191354 28621 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:17.191852 22971 leader_election.cc:304] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.192610 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.192866 28609 raft_consensus.cc:2749] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:17.193609 28621 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.194898 23650 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216ff6323e434e399d196d8ba262c8f3 in term 12.
W20260709 13:11:17.167582 23622 leader_election.cc:336] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.196302 23622 leader_election.cc:304] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.202126 23620 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.205217 28621 raft_consensus.cc:2749] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:17.205807 28622 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:17.206480 23622 leader_election.cc:336] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.207120 23622 leader_election.cc:304] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.207913 28622 raft_consensus.cc:2749] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:17.208544 23622 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.209071 23622 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.209263 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.209959 28622 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:17.210645 23622 leader_election.cc:336] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.211167 23622 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:11:17.185765 22972 leader_election.cc:336] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.211350 28622 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:17.211869 22972 leader_election.cc:304] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.213420 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.216904 28622 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:17.217265 22971 leader_election.cc:304] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:11:17.218315 28607 raft_consensus.cc:2749] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.218842 22971 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.219869 28607 raft_consensus.cc:2749] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:17.220026 28608 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.220779 22971 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.221520 28609 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.225329 22971 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.226227 28608 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:17.227564 23045 leader_election.cc:304] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:11:17.228930 28630 raft_consensus.cc:2749] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:17.230786 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.231967 28615 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:17.232455 28615 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:17.232883 28615 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.233202 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.234194 28624 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:17.234634 28624 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:17.235028 28624 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:17.235522 23045 leader_election.cc:304] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.237360 28612 raft_consensus.cc:2749] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.237728 23045 leader_election.cc:304] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.238888 28612 raft_consensus.cc:2749] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.252081 23045 leader_election.cc:304] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:11:17.253320 28624 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:17.254407 23078 raft_consensus.cc:1240] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:17.262765 28611 consensus_queue.cc:1059] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:17.264285 28604 raft_consensus.cc:3055] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:17.264696 28604 raft_consensus.cc:740] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:11:17.266075 28604 consensus_queue.cc:260] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:17.270818 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.270960 28627 raft_consensus.cc:2749] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.278472 28604 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:17.283357 28615 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
W20260709 13:11:17.283730 22972 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.283774 22825 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 reported cstate change: term changed from 11 to 12, leader changed from 01988c2c817947859340a730b7f1247d (127.21.67.196) to 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194). New cstate: current_term: 12 leader_uuid: "216ff6323e434e399d196d8ba262c8f3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:17.285063 22972 leader_election.cc:336] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.285548 22972 leader_election.cc:304] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
I20260709 13:11:17.286309 28608 raft_consensus.cc:2749] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:17.287904 28598 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:17.290225 23622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 79665.4us
W20260709 13:11:17.291464 23622 leader_election.cc:336] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.292127 23622 leader_election.cc:304] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.292398 23075 raft_consensus.cc:1240] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:17.295236 28611 consensus_queue.cc:1059] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:17.296689 28611 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:17.297089 28611 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:11:17.298341 28611 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 15.16, Last appended by leader: 16, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:11:17.300173 28611 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.255507 28624 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:17.301262 28628 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:17.307950 28628 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:17.308486 28628 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:17.308739 23622 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.309213 23622 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.309379 28616 raft_consensus.cc:2749] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:17.291505 22972 leader_election.cc:336] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.310005 22972 leader_election.cc:304] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:11:17.311058 22972 leader_election.cc:336] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.311494 22972 leader_election.cc:304] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3; no voters: 01988c2c817947859340a730b7f1247d, 0db2f61e34a24096a5baf0de9a32d4f7
W20260709 13:11:17.304239 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:17.312201 28608 raft_consensus.cc:2749] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.315204 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:11:17.312044 28609 raft_consensus.cc:2749] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:17.324852 28615 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:17.325533 23003 raft_consensus.cc:2468] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 13.
I20260709 13:11:17.336261 28632 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:17.328378 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:11:17.339521 23045 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:17.339601 23648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:11:17.340538 28595 raft_consensus.cc:2804] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:17.341018 28595 raft_consensus.cc:697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:11:17.341969 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18ae3a17d947e8b70820e473626cb8" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:11:17.342051 28595 consensus_queue.cc:237] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:17.346165 23622 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.347376 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.350669 28631 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:17.351224 23622 leader_election.cc:336] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.354058 23622 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.352564 23000 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 16.
I20260709 13:11:17.331017 28628 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:17.356911 23045 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d
I20260709 13:11:17.358250 28631 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:17.359009 28628 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
W20260709 13:11:17.359198 23622 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:17.357991 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:17.365056 28595 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:17.365577 28595 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:11:17.365175 23653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:11:17.366974 23622 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.368367 28631 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:17.369877 23622 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.370404 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.371212 28631 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:17.373071 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:11:17.374562 23045 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.375385 28627 raft_consensus.cc:2749] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:17.377375 28595 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 15.16, Last appended by leader: 16, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
W20260709 13:11:17.380002 23622 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:17.386641 23622 leader_election.cc:336] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.387814 23653 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:17.382929 22826 catalog_manager.cc:5697] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 12 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 13 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.391887 23622 leader_election.cc:304] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.393740 28611 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:17.403859 28631 raft_consensus.cc:2749] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:17.408589 23622 leader_election.cc:336] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.409143 23622 leader_election.cc:304] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:17.411288 28631 raft_consensus.cc:2749] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:17.412223 23622 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.413182 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:17.414413 28631 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.438762 23078 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Refusing update from remote peer 216ff6323e434e399d196d8ba262c8f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:17.446233 28611 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:17.495919 23075 raft_consensus.cc:1240] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Rejecting Update request from peer 216ff6323e434e399d196d8ba262c8f3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:17.498186 28609 consensus_queue.cc:1059] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:17.500283 28609 raft_consensus.cc:3055] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:17.500625 28609 raft_consensus.cc:740] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 216ff6323e434e399d196d8ba262c8f3, State: Running, Role: LEADER
I20260709 13:11:17.501479 28609 consensus_queue.cc:260] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:17.502733 28609 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:17.522331 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:17.535465 23622 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:17.536044 23622 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
W20260709 13:11:17.543259 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:17.544267 28623 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:17.557614 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:17.559094 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:17.613085 22827 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 15 to 16, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 16 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:17.616469 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:17.641957 23078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:11:17.642660 23078 raft_consensus.cc:606] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Received request to transfer leadership
I20260709 13:11:17.648329 23078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:11:17.648841 23078 raft_consensus.cc:606] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Received request to transfer leadership
I20260709 13:11:17.661830 23075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570"
dest_uuid: "b655449a388a41e3a606c6ea794825ad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:11:17.662388 23075 raft_consensus.cc:606] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Received request to transfer leadership
W20260709 13:11:17.672879 22877 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:11:17.673254 22877 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 23b2c8978a514c01ba48a8c4a08a7570 already in progress
W20260709 13:11:17.673527 22877 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 23b2c8978a514c01ba48a8c4a08a7570 already in progress
W20260709 13:11:17.727312 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:17.783151 23657 raft_consensus.cc:3060] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:17.802793 23046 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.805217 23657 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:17.813149 28628 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:17.887262 23006 raft_consensus.cc:1275] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:17.889014 28615 consensus_queue.cc:1048] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:17.908735 23657 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.928366 23657 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 15 index: 16. Preceding OpId from leader: term: 16 index: 17. (index mismatch)
I20260709 13:11:17.929919 28615 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:11:17.940379 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:17.980067 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:17.982057 28627 raft_consensus.cc:993] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: : Instructing follower 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:11:17.982645 28627 raft_consensus.cc:1081] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Signalling peer 01988c2c817947859340a730b7f1247d to start an election
I20260709 13:11:17.985097 23653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570"
dest_uuid: "01988c2c817947859340a730b7f1247d"
 from {username='slave'} at 127.0.0.1:47784
I20260709 13:11:17.985728 23653 raft_consensus.cc:493] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.986095 23653 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.991102 23006 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 15 index: 16. Preceding OpId from leader: term: 16 index: 17. (index mismatch)
I20260709 13:11:17.992513 28627 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:11:18.036016 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:18.023150 23653 raft_consensus.cc:515] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:11:18.059185 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: true dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:11:18.059844 23006 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:18.075053 23006 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 17.
I20260709 13:11:18.075631 23653 leader_election.cc:290] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:18.077004 23621 leader_election.cc:304] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:11:18.078292 28598 raft_consensus.cc:2804] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:18.078717 28598 raft_consensus.cc:697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 17 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:11:18.079561 28598 consensus_queue.cc:237] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 16.17, Last appended by leader: 17, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:11:18.091235 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b2c8978a514c01ba48a8c4a08a7570" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: true dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:18.091944 23078 raft_consensus.cc:3055] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:18.092275 23078 raft_consensus.cc:740] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
W20260709 13:11:18.105121 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:18.122979 23078 consensus_queue.cc:260] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 16.17, Last appended by leader: 17, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:11:18.123366 22825 catalog_manager.cc:5697] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 16 to 17, leader changed from b655449a388a41e3a606c6ea794825ad (127.21.67.195) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 17 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.137836 23078 raft_consensus.cc:3060] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:18.146450 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.125207 22972 consensus_peers.cc:597] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.172250 21775 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:18.180486 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:18.195140 23078 raft_consensus.cc:2468] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 17.
W20260709 13:11:18.312861 22972 consensus_peers.cc:597] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.342026 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.354488 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.377027 22972 consensus_peers.cc:597] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.377769 22972 consensus_peers.cc:597] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:18.396950 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.491101 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:18.493098 23078 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 16 index: 17. Preceding OpId from leader: term: 17 index: 18. (index mismatch)
I20260709 13:11:18.494899 28623 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:11:18.568923 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.570652 22972 consensus_peers.cc:597] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:18.584357 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:18.596064 23003 raft_consensus.cc:1275] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 16 index: 17. Preceding OpId from leader: term: 17 index: 18. (index mismatch)
I20260709 13:11:18.606223 28598 consensus_queue.cc:1048] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:11:18.611047 28598 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:18.612407 28598 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:18.617537 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:18.618135 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:18.621966 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3" is_pre_election: true
I20260709 13:11:18.622782 23006 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:11:18.624135 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: 
I20260709 13:11:18.626125 28623 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:18.626539 28623 raft_consensus.cc:493] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:18.626933 28623 raft_consensus.cc:3060] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:18.630625 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:18.631213 23622 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:18.631733 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:18.633792 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:18.634871 23078 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
I20260709 13:11:18.638767 28598 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:18.666960 28623 raft_consensus.cc:515] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:18.671128 23006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "216ff6323e434e399d196d8ba262c8f3"
I20260709 13:11:18.671386 28623 leader_election.cc:290] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:18.679752 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238b133cf6c4b948cf771c94b860716" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:18.680442 23078 raft_consensus.cc:2393] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01988c2c817947859340a730b7f1247d in current term 14: Already voted for candidate b655449a388a41e3a606c6ea794825ad in this term.
W20260709 13:11:18.704527 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:18.710064 23006 raft_consensus.cc:2468] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 14.
I20260709 13:11:18.712112 23621 leader_election.cc:304] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3; no voters: b655449a388a41e3a606c6ea794825ad
I20260709 13:11:18.713169 28623 raft_consensus.cc:2804] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:18.713776 28623 raft_consensus.cc:697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:11:18.715303 28623 consensus_queue.cc:237] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:18.768339 22827 catalog_manager.cc:5697] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 13 to 14, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 14 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:18.853256 22972 consensus_peers.cc:597] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:18.876134 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:18.942925 23653 consensus_queue.cc:237] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } }
I20260709 13:11:18.971055 23078 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:18.977197 23006 raft_consensus.cc:1275] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:18.981158 28663 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:18.993376 28663 consensus_queue.cc:1048] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:18.997575 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:19.003142 23622 consensus_peers.cc:597] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.039451 28623 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 4 to 11, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
I20260709 13:11:19.057206 23076 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 4 to 11, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
W20260709 13:11:19.074339 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:19.078356 22827 catalog_manager.cc:5697] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad reported cstate change: config changed from index 4 to 11, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New cstate: current_term: 11 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
I20260709 13:11:19.119357 23003 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:19.118201 23006 raft_consensus.cc:2955] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 4 to 11, NON_VOTER 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: NON_VOTER last_known_addr { host: "127.21.67.193" port: 39171 } attrs { promote: true } } }
I20260709 13:11:19.122962 28598 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:19.157305 23076 raft_consensus.cc:1275] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:19.158826 28598 consensus_queue.cc:1048] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:19.172750 21775 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 22952)
W20260709 13:11:19.287808 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:19.320255 22972 consensus_peers.cc:597] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:19.325311 22972 consensus_peers.cc:597] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:19.646227 22972 consensus_peers.cc:597] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:19.753836 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:19.873847 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:19.880066 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:19.880537 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:19.881198 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:19.881568 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:20.044278 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:20.206498 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:20.456773 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:20.500375 22972 consensus_peers.cc:597] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:20.576822 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
W20260709 13:11:20.616779 22972 consensus_peers.cc:597] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:20.663213 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:20.743902 22972 consensus_peers.cc:597] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:20.749579 22972 consensus_peers.cc:597] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:20.744935 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
W20260709 13:11:20.773228 23045 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.773752 23621 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.777231 23621 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.777747 23621 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.789268 23621 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.797602 23045 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.801477 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:20.827039 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:20.832769 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:20.833802 21775 tablet_replica.cc:333] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.834810 21775 raft_consensus.cc:2243] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.835493 21775 raft_consensus.cc:2272] T da207091d69d47c2a67b181645327e1c P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.838701 21775 tablet_replica.cc:333] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.839548 21775 raft_consensus.cc:2243] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.840072 21775 raft_consensus.cc:2272] T 6238b133cf6c4b948cf771c94b860716 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.842727 21775 tablet_replica.cc:333] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.860349 21775 raft_consensus.cc:2243] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.860992 21775 raft_consensus.cc:2272] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:20.863258 23622 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.863993 21775 tablet_replica.cc:333] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.865903 21775 raft_consensus.cc:2243] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.866520 21775 raft_consensus.cc:2272] T 590119d9a7e74f099c0a28550f4fb3f5 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.869858 21775 tablet_replica.cc:333] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.870937 21775 raft_consensus.cc:2243] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.872212 21775 raft_consensus.cc:2272] T 2aadad04f3914b6998492885aaba04f6 P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.874845 21775 tablet_replica.cc:333] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.875401 21775 raft_consensus.cc:2243] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.876144 21775 raft_consensus.cc:2272] T a934a76e20344681bde221224fb9da0d P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.883561 21775 tablet_replica.cc:333] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.884289 21775 raft_consensus.cc:2243] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.885337 21775 raft_consensus.cc:2272] T 6c18ae3a17d947e8b70820e473626cb8 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.894501 21775 tablet_replica.cc:333] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.895520 21775 raft_consensus.cc:2243] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.896202 21775 raft_consensus.cc:2272] T 8e8b5f462dc44c7d96f09188ade5c13d P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.903517 21775 tablet_replica.cc:333] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.904317 21775 raft_consensus.cc:2243] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.905503 21775 raft_consensus.cc:2272] T d86fa0480a7543048d2dc4f8046cd314 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.908121 21775 tablet_replica.cc:333] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.908913 21775 raft_consensus.cc:2243] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.909725 21775 raft_consensus.cc:2272] T 808909fe49ff4730b32151fb7a7b559e P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.911366 21775 tablet_replica.cc:333] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.912128 21775 raft_consensus.cc:2243] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.912678 21775 raft_consensus.cc:2272] T 952ed8a46c5e4f158f63440eb6fbef0a P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.915023 21775 tablet_replica.cc:333] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.915685 21775 raft_consensus.cc:2243] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.916234 21775 raft_consensus.cc:2272] T f09dae9312b04b4c8d390ab7d430e7cb P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.919054 21775 tablet_replica.cc:333] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.919843 21775 raft_consensus.cc:2243] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.920430 21775 raft_consensus.cc:2272] T eccda721d3ee4ac79479134d323b9640 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.923013 21775 tablet_replica.cc:333] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.923791 21775 raft_consensus.cc:2243] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.924885 21775 raft_consensus.cc:2272] T 5adc1058fd2948e382bcd0ee2213ab3a P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.927201 21775 tablet_replica.cc:333] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.927930 21775 raft_consensus.cc:2243] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.928529 21775 raft_consensus.cc:2272] T 19265c3b4d3344e492485458bb4cc867 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.930944 21775 tablet_replica.cc:333] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.931744 21775 raft_consensus.cc:2243] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.932904 21775 raft_consensus.cc:2272] T e257e4274a884c2b87551c41d6072956 P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.935307 21775 tablet_replica.cc:333] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.936060 21775 raft_consensus.cc:2243] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.936990 21775 raft_consensus.cc:2272] T 94bcbf412cf54b0fa378f2ce70dec99f P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.939554 21775 tablet_replica.cc:333] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.940316 21775 raft_consensus.cc:2243] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.941326 21775 raft_consensus.cc:2272] T 72f4ca03b8704b4ca2ad66da9add8692 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.943684 21775 tablet_replica.cc:333] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.944317 21775 raft_consensus.cc:2243] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.944847 21775 raft_consensus.cc:2272] T b8c270d6f9de4942999edb2e7e999066 P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.947355 21775 tablet_replica.cc:333] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.948144 21775 raft_consensus.cc:2243] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.949190 21775 raft_consensus.cc:2272] T defec66b69804f8c85671fbdd904172d P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.951493 21775 tablet_replica.cc:333] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.952327 21775 raft_consensus.cc:2243] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.952966 21775 raft_consensus.cc:2272] T ca18e836a5464ec5b09378b03ae8b23f P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.955364 21775 tablet_replica.cc:333] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.955958 21775 raft_consensus.cc:2243] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.956607 21775 raft_consensus.cc:2272] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.959303 21775 tablet_replica.cc:333] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.960031 21775 raft_consensus.cc:2243] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.961148 21775 raft_consensus.cc:2272] T 5bf6397d6bc54a22915e0146962b443d P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.963618 21775 tablet_replica.cc:333] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.964457 21775 raft_consensus.cc:2243] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.965580 21775 raft_consensus.cc:2272] T a0fd26ed0b904e01959f5f0d30437e69 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.968182 21775 tablet_replica.cc:333] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.969041 21775 raft_consensus.cc:2243] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.969780 21775 raft_consensus.cc:2272] T 9c57d9be04024fee96aa769711f72d7c P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.972342 21775 tablet_replica.cc:333] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.973105 21775 raft_consensus.cc:2243] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:20.974054 21775 raft_consensus.cc:2272] T ee9d7188ba094ea3b277000bf9f3a73e P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.976678 21775 tablet_replica.cc:333] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.977363 21775 raft_consensus.cc:2243] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.978045 21775 raft_consensus.cc:2272] T d9dd0ac5baf440fc96bcfc581bb5d2de P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.980558 21775 tablet_replica.cc:333] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.981284 21775 raft_consensus.cc:2243] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.981920 21775 raft_consensus.cc:2272] T 682d24a2200c4222a401f9ab803af214 P 216ff6323e434e399d196d8ba262c8f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.984548 21775 tablet_replica.cc:333] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.985459 21775 raft_consensus.cc:2243] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.986655 21775 raft_consensus.cc:2272] T 37e2e961b20a4588ba99edcaeaaf578c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.989624 21775 tablet_replica.cc:333] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.990538 21775 raft_consensus.cc:2243] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.991276 21775 raft_consensus.cc:2272] T 23b2c8978a514c01ba48a8c4a08a7570 P 216ff6323e434e399d196d8ba262c8f3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.994226 21775 tablet_replica.cc:333] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.995118 21775 raft_consensus.cc:2243] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.995899 21775 raft_consensus.cc:2272] T 7c435cd2efc84579b5b18dbaa04ee538 P 216ff6323e434e399d196d8ba262c8f3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.998831 21775 tablet_replica.cc:333] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:20.999770 21775 raft_consensus.cc:2243] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:21.000939 21775 raft_consensus.cc:2272] T 20adeb7c99154724bd868029eb5ed0df P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.003473 21775 tablet_replica.cc:333] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.004246 21775 raft_consensus.cc:2243] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.005249 21775 raft_consensus.cc:2272] T 71491ce9117b44a08c83b84589d0ba9d P 216ff6323e434e399d196d8ba262c8f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.008420 21775 tablet_replica.cc:333] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.009397 21775 raft_consensus.cc:2243] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:21.010715 21775 raft_consensus.cc:2272] T 2806bd6497384caf84700ae1cb863e9b P 216ff6323e434e399d196d8ba262c8f3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.013959 21775 tablet_replica.cc:333] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.014911 21775 raft_consensus.cc:2243] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.015690 21775 raft_consensus.cc:2272] T d3222d52f8784a58a81fe1c534bbaf98 P 216ff6323e434e399d196d8ba262c8f3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.018653 21775 tablet_replica.cc:333] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.019630 21775 raft_consensus.cc:2243] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.020468 21775 raft_consensus.cc:2272] T 0633fbe8ee1c4284a67d72b00a0285a0 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.023182 21775 tablet_replica.cc:333] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.024019 21775 raft_consensus.cc:2243] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.024757 21775 raft_consensus.cc:2272] T 9dfb822e7cb640e68719af6e16591c4a P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.027551 21775 tablet_replica.cc:333] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.028214 21775 raft_consensus.cc:2243] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:21.029264 21775 raft_consensus.cc:2272] T f9d4f6ae66214bcb808947c251df9862 P 216ff6323e434e399d196d8ba262c8f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.031805 21775 tablet_replica.cc:333] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.032507 21775 raft_consensus.cc:2243] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.033109 21775 raft_consensus.cc:2272] T a5f4021a98714bc6b65420cc163e3a91 P 216ff6323e434e399d196d8ba262c8f3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.035615 21775 tablet_replica.cc:333] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.036299 21775 raft_consensus.cc:2243] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.037241 21775 raft_consensus.cc:2272] T 8f3bed822a364ea9afe4d449542afc6b P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:21.039776 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:21.040009 21775 tablet_replica.cc:333] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.040874 21775 raft_consensus.cc:2243] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.041627 21775 raft_consensus.cc:2272] T 003d4c22ec774af79682d96196a7e8b7 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.044521 21775 tablet_replica.cc:333] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.045249 21775 raft_consensus.cc:2243] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:21.046187 21775 raft_consensus.cc:2272] T e54cbb7e06ba404b91d84809d3aa8548 P 216ff6323e434e399d196d8ba262c8f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.048650 21775 tablet_replica.cc:333] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.049316 21775 raft_consensus.cc:2243] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:21.050544 21775 raft_consensus.cc:2272] T ce98d2857d3f449c8d9052124b418f8c P 216ff6323e434e399d196d8ba262c8f3 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:21.052938 23621 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.053181 21775 tablet_replica.cc:333] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.054574 21775 raft_consensus.cc:2243] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.055262 21775 raft_consensus.cc:2272] T 09c7979afa3c4fcb83838f29edec3b67 P 216ff6323e434e399d196d8ba262c8f3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:21.056897 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:21.057888 21775 tablet_replica.cc:333] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3: stopping tablet replica
I20260709 13:11:21.058629 21775 raft_consensus.cc:2243] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.059456 21775 raft_consensus.cc:2272] T 22342f9fc8d5439e9dc7755716c74fdb P 216ff6323e434e399d196d8ba262c8f3 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:21.062530 23621 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.063177 23621 consensus_peers.cc:597] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.063762 23621 consensus_peers.cc:597] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.064256 23621 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.064700 23621 consensus_peers.cc:597] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.065114 23621 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.065555 23621 consensus_peers.cc:597] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.082754 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003833e0 after lost signal to thread 21778
W20260709 13:11:21.084007 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1c60 after lost signal to thread 22863
W20260709 13:11:21.085297 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08004283e0 after lost signal to thread 23030
W20260709 13:11:21.086437 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8be0 after lost signal to thread 23104
W20260709 13:11:21.087668 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08000acd60 after lost signal to thread 23681
W20260709 13:11:21.097229 23045 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.097452 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.098109 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.098785 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.100270 23045 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.100976 23045 consensus_peers.cc:597] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.101471 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:21.101699 23045 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.104374 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:21.110380 23045 consensus_peers.cc:597] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.117362 23045 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.122103 23621 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.125317 23622 consensus_peers.cc:597] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:21.128031 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.158456 23621 consensus_peers.cc:597] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.164395 23621 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.197518 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.207094 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.230053 23621 consensus_peers.cc:597] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.260584 23045 consensus_peers.cc:597] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.268324 23621 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.309047 23045 consensus_peers.cc:597] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.424230 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.448065 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.571601 23621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111) [suppressed 469 similar messages]
W20260709 13:11:21.596078 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:21.648293 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:21.670125 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.674647 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.685142 23046 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:21.793737 23046 consensus_peers.cc:597] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:21.851423 28628 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:21.851919 28628 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:21.853669 28628 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:21.858299 23045 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:21.858855 23046 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:21.859211 23046 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:21.859784 28628 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:21.885852 23027 debug-util.cc:398] Leaking SignalData structure 0x7b080034f6e0 after lost signal to thread 21778
W20260709 13:11:21.886904 23027 debug-util.cc:398] Leaking SignalData structure 0x7b0800397d20 after lost signal to thread 22863
W20260709 13:11:21.887439 23027 debug-util.cc:398] Leaking SignalData structure 0x7b08003b15e0 after lost signal to thread 23030
W20260709 13:11:21.888496 23027 debug-util.cc:398] Leaking SignalData structure 0x7b0800194480 after lost signal to thread 23104
W20260709 13:11:21.889999 23027 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1600 after lost signal to thread 23681
I20260709 13:11:21.948412 28688 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:21.949081 28688 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:21.951360 28688 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:21.961611 23045 leader_election.cc:336] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:21.978641 23046 leader_election.cc:336] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:21.979236 23046 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:21.980106 28688 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:21.983712 28660 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:21.984282 28660 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:21.986408 28660 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:21.992403 23622 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:21.993146 23621 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:21.993568 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:21.994272 28660 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:21.994951 28688 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:21.995507 28688 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:21.997669 28688 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:22.001464 28660 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.001974 28660 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.003149 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:22.004679 28660 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:22.020567 28688 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.021184 28688 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.023270 28688 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:22.023852 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:22.028167 23076 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 17.
W20260709 13:11:22.033471 23046 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:22.025596 23621 leader_election.cc:336] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.036725 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.040723 28623 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:22.041091 28623 raft_consensus.cc:493] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.041441 28623 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.044015 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:11:22.050262 23045 leader_election.cc:336] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.053618 23045 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.054243 28663 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.063527 28663 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.065709 28663 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:22.066658 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:22.066795 28688 raft_consensus.cc:2749] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.067644 23076 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:11:22.068746 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:22.069518 28663 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:22.069872 28663 raft_consensus.cc:493] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.070223 28663 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:22.076926 23045 leader_election.cc:336] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:22.082634 23621 leader_election.cc:336] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.082657 28660 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.087627 28660 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.089756 28660 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:22.083846 28663 raft_consensus.cc:515] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.093415 28663 leader_election.cc:290] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:22.084928 23046 consensus_peers.cc:597] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:22.061378 28623 raft_consensus.cc:515] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.098661 23650 raft_consensus.cc:2393] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b655449a388a41e3a606c6ea794825ad in current term 18: Already voted for candidate 01988c2c817947859340a730b7f1247d in this term.
I20260709 13:11:22.102970 28623 leader_election.cc:290] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:22.105324 23621 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.106884 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf6397d6bc54a22915e0146962b443d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:22.107122 23077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defec66b69804f8c85671fbdd904172d" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:22.107398 23076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:22.107810 23077 raft_consensus.cc:3060] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.107486 23075 raft_consensus.cc:3060] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:22.109153 23620 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:22.112205 28628 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.112656 28628 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:22.113056 28663 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:22.114424 28628 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:22.115495 23077 raft_consensus.cc:2468] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 18.
I20260709 13:11:22.116840 23620 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:22.117692 28660 raft_consensus.cc:2804] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:22.118158 28660 raft_consensus.cc:697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 18 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:11:22.119010 28660 consensus_queue.cc:237] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:22.122172 23046 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:22.136669 23621 leader_election.cc:336] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:22.138370 23621 leader_election.cc:336] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.141402 28688 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.149868 28688 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.151872 28688 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:22.153793 22827 catalog_manager.cc:5697] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 17 to 18, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 18 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.155982 28663 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.156474 28663 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.159158 28663 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:22.140689 23075 raft_consensus.cc:2468] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:11:22.161375 23620 leader_election.cc:304] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.140645 23045 leader_election.cc:304] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.170012 28699 raft_consensus.cc:2804] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:22.170612 28699 raft_consensus.cc:697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:11:22.170709 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
W20260709 13:11:22.172798 23045 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.167882 28688 raft_consensus.cc:2749] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.173650 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.173036 28699 consensus_queue.cc:237] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:22.174226 21775 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23027)
W20260709 13:11:22.178099 23621 leader_election.cc:336] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.181339 28628 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:22.185362 23622 leader_election.cc:336] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:22.185868 23622 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.186710 28698 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:22.190656 23045 leader_election.cc:336] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.191404 28628 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.191691 23045 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.191929 28628 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.193248 28692 raft_consensus.cc:2749] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.193688 28628 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:22.196159 28688 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.197865 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:22.199103 28688 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:22.201891 28688 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:22.206257 23046 leader_election.cc:336] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:22.208499 23045 leader_election.cc:336] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.208959 23045 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 01988c2c817947859340a730b7f1247d, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.212399 28688 raft_consensus.cc:2749] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.219689 28698 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.220189 28698 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:22.221913 23045 leader_election.cc:336] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.222342 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.222966 28688 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:22.224038 28688 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.224480 28688 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:22.226343 28688 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:22.231014 23621 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:22.232095 23622 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:22.232537 23622 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.233624 28698 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:22.234513 28699 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:22.234113 23046 leader_election.cc:336] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:22.238338 28688 raft_consensus.cc:493] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.238916 28688 raft_consensus.cc:515] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:11:22.246193 23046 leader_election.cc:336] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:22.247632 28688 leader_election.cc:290] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:22.268774 23045 leader_election.cc:336] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.269870 23045 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.270689 28628 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:22.275933 23045 leader_election.cc:336] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.276404 23045 leader_election.cc:304] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.277256 28688 raft_consensus.cc:2749] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.305590 22827 catalog_manager.cc:5697] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 13 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.315196 28688 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.316045 28688 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:22.318174 28688 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:22.319367 28699 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.324471 28699 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:22.320876 23046 consensus_peers.cc:597] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:22.326691 28699 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:22.330919 23621 leader_election.cc:336] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.330852 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
W20260709 13:11:22.330693 23046 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:22.331594 23075 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:11:22.336324 23620 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.337742 28699 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:22.341774 28699 raft_consensus.cc:493] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.342226 28699 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:22.347759 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:22.351686 28698 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.352205 28698 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.354210 28698 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:22.359537 28663 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.360055 28663 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.362174 28663 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:22.363240 23622 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:22.369298 28688 raft_consensus.cc:493] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.369843 28688 raft_consensus.cc:515] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:22.370285 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad" is_pre_election: true
I20260709 13:11:22.373984 23078 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 12.
I20260709 13:11:22.376067 28688 leader_election.cc:290] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:22.380456 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:22.390370 28698 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:22.390825 28698 raft_consensus.cc:493] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.391304 28698 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:22.381008 23621 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.396060 23621 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.398111 28663 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:22.399173 23621 leader_election.cc:336] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.413966 28698 raft_consensus.cc:515] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:22.415549 23046 leader_election.cc:336] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:22.439057 23046 consensus_peers.cc:597] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:22.426847 28699 raft_consensus.cc:515] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.447876 28699 leader_election.cc:290] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:22.448618 23078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adc1058fd2948e382bcd0ee2213ab3a" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:22.450145 23078 raft_consensus.cc:3060] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:22.460902 23078 raft_consensus.cc:2468] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
W20260709 13:11:22.438252 23045 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.481678 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.482712 28692 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:22.483779 23045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 45552.6us
W20260709 13:11:22.484439 23045 leader_election.cc:336] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.487025 23045 leader_election.cc:304] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.489822 28698 leader_election.cc:290] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:22.485792 23075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d4f6ae66214bcb808947c251df9862" candidate_uuid: "01988c2c817947859340a730b7f1247d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b655449a388a41e3a606c6ea794825ad"
I20260709 13:11:22.491967 23075 raft_consensus.cc:3060] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:22.491998 23621 leader_election.cc:336] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.498687 23075 raft_consensus.cc:2468] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01988c2c817947859340a730b7f1247d in term 13.
I20260709 13:11:22.490365 28692 raft_consensus.cc:2749] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:22.485667 23046 consensus_peers.cc:597] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:22.501185 23620 leader_election.cc:304] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.502825 28699 raft_consensus.cc:2804] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:22.503557 28699 raft_consensus.cc:697] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:11:22.504572 28699 consensus_queue.cc:237] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.507833 23620 leader_election.cc:304] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:22.508802 28698 raft_consensus.cc:2804] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:22.510532 28698 raft_consensus.cc:697] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Becoming Leader. State: Replica: 01988c2c817947859340a730b7f1247d, State: Running, Role: LEADER
I20260709 13:11:22.515280 28698 consensus_queue.cc:237] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:22.537540 23621 leader_election.cc:336] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.558043 28688 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.558578 28688 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.560644 28688 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:22.576421 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d" is_pre_election: true
I20260709 13:11:22.577006 23650 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 9.
I20260709 13:11:22.582446 22827 catalog_manager.cc:5697] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 13 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.602900 28628 raft_consensus.cc:493] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.603457 28628 raft_consensus.cc:515] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:22.605540 28628 leader_election.cc:290] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:22.607234 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
W20260709 13:11:22.626087 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:22.632006 28628 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:22.632606 28628 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:22.632952 28628 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.642661 28628 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:22.644670 28628 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Requested vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), 01988c2c817947859340a730b7f1247d (127.21.67.196:35811)
I20260709 13:11:22.660288 22827 catalog_manager.cc:5697] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d reported cstate change: term changed from 12 to 13, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to 01988c2c817947859340a730b7f1247d (127.21.67.196). New cstate: current_term: 13 leader_uuid: "01988c2c817947859340a730b7f1247d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.669175 23077 raft_consensus.cc:1275] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:22.670470 23650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54cbb7e06ba404b91d84809d3aa8548" candidate_uuid: "b655449a388a41e3a606c6ea794825ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01988c2c817947859340a730b7f1247d"
I20260709 13:11:22.671060 23650 raft_consensus.cc:3060] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.687271 23650 raft_consensus.cc:2468] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b655449a388a41e3a606c6ea794825ad in term 10.
W20260709 13:11:22.688071 23621 consensus_peers.cc:597] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:22.690033 23045 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.703734 23045 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01988c2c817947859340a730b7f1247d, b655449a388a41e3a606c6ea794825ad; no voters: 
I20260709 13:11:22.713570 28692 raft_consensus.cc:2804] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:22.714051 28692 raft_consensus.cc:697] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Becoming Leader. State: Replica: b655449a388a41e3a606c6ea794825ad, State: Running, Role: LEADER
I20260709 13:11:22.714905 28692 consensus_queue.cc:237] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:22.712025 23046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:39171, user_credentials={real_user=slave}} blocked reactor thread for 44413.6us
W20260709 13:11:22.739675 23621 consensus_peers.cc:597] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:22.741637 23045 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:22.742182 23045 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:22.752410 28663 consensus_queue.cc:1048] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:22.765587 22827 catalog_manager.cc:5697] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad reported cstate change: term changed from 9 to 10, leader changed from 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194) to b655449a388a41e3a606c6ea794825ad (127.21.67.195). New cstate: current_term: 10 leader_uuid: "b655449a388a41e3a606c6ea794825ad" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.767768 23077 raft_consensus.cc:1275] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:11:22.774274 23046 leader_election.cc:336] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:22.777801 23046 leader_election.cc:304] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:22.778548 28692 raft_consensus.cc:2749] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.797295 28663 consensus_queue.cc:1048] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:22.848555 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:22.855340 23621 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:22.918509 23046 consensus_peers.cc:597] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:22.920739 23046 consensus_peers.cc:597] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:23.024991 23621 consensus_peers.cc:597] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.058350 23077 raft_consensus.cc:1275] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:23.061437 28663 consensus_queue.cc:1048] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:23.174921 23045 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.178138 23620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45219, user_credentials={real_user=slave}} blocked reactor thread for 68102.3us
W20260709 13:11:23.178591 21775 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23027)
W20260709 13:11:23.193118 23046 consensus_peers.cc:597] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:23.198124 23046 consensus_peers.cc:597] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:23.206619 23077 raft_consensus.cc:1275] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Refusing update from remote peer 01988c2c817947859340a730b7f1247d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:23.208477 28716 consensus_queue.cc:1048] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:23.212937 23621 consensus_peers.cc:597] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:23.226156 23622 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:23.230034 23621 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.231297 23621 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.251780 23045 consensus_peers.cc:597] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:23.278559 23655 raft_consensus.cc:1275] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Refusing update from remote peer b655449a388a41e3a606c6ea794825ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:23.279892 28692 consensus_queue.cc:1048] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:23.294353 23622 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:23.311455 23621 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.321224 23045 consensus_peers.cc:597] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:23.368593 23621 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.441210 23045 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.462821 23621 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.483771 23621 consensus_peers.cc:597] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.494683 23045 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.508651 23622 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:23.511376 28713 raft_consensus.cc:493] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:23.512024 28713 raft_consensus.cc:515] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:23.517096 23622 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:23.516846 28713 leader_election.cc:290] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:23.535806 23621 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.537003 23621 consensus_peers.cc:597] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.537544 23621 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.555068 23622 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:23.555828 23621 leader_election.cc:336] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:23.556349 23621 leader_election.cc:304] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:11:23.562197 23046 consensus_peers.cc:597] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:23.563644 28698 raft_consensus.cc:2749] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:23.596316 23621 consensus_peers.cc:597] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.596823 23622 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:23.661999 23045 consensus_peers.cc:597] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.669119 23622 consensus_peers.cc:597] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:23.689575 23045 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.692983 23621 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.698501 23045 consensus_peers.cc:597] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.701800 23621 consensus_peers.cc:597] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.715893 23621 consensus_peers.cc:597] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.718045 23621 consensus_peers.cc:597] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.731199 23045 consensus_peers.cc:597] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.749845 23622 consensus_peers.cc:597] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:23.789805 23046 consensus_peers.cc:597] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:23.795150 28688 raft_consensus.cc:493] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:11:23.799782 23045 consensus_peers.cc:597] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:23.803869 23621 consensus_peers.cc:597] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:23.807857 28688 raft_consensus.cc:515] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:23.813715 28713 raft_consensus.cc:493] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:23.814203 28713 raft_consensus.cc:515] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:23.820070 23622 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:23.821084 28713 leader_election.cc:290] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:23.825776 23621 leader_election.cc:336] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:23.836196 23621 leader_election.cc:304] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:23.839357 28698 raft_consensus.cc:2749] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:23.836941 23045 consensus_peers.cc:597] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:23.837787 28688 leader_election.cc:290] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:23.847066 23046 consensus_peers.cc:597] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:23.858237 23046 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:23.859989 23045 leader_election.cc:336] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:23.878063 23045 leader_election.cc:304] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:23.881036 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
I20260709 13:11:23.882447 28692 raft_consensus.cc:2749] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:23.884699 23622 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:23.885563 23046 consensus_peers.cc:597] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:23.924249 23622 consensus_peers.cc:597] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:23.935098 28692 raft_consensus.cc:493] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:23.935819 28692 raft_consensus.cc:515] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:23.938369 28692 leader_election.cc:290] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:23.948410 23046 leader_election.cc:336] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:23.951097 23045 leader_election.cc:336] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:23.952092 23045 leader_election.cc:304] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:23.955236 28692 raft_consensus.cc:2749] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:23.956415 28692 raft_consensus.cc:493] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:23.956951 28692 raft_consensus.cc:515] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:23.959263 28692 leader_election.cc:290] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:23.971200 23046 leader_election.cc:336] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:23.975504 23045 leader_election.cc:336] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:23.976063 23621 consensus_peers.cc:597] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:23.978729 23045 leader_election.cc:304] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:23.979537 28692 raft_consensus.cc:2749] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:23.987370 28692 raft_consensus.cc:493] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:23.987901 28692 raft_consensus.cc:515] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:23.990109 28692 leader_election.cc:290] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:24.001184 23046 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:24.016845 23622 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:24.024461 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
W20260709 13:11:24.026005 23045 leader_election.cc:336] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:24.027063 23045 leader_election.cc:304] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:24.027815 28688 raft_consensus.cc:2749] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.033041 28688 raft_consensus.cc:493] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:24.033484 28688 raft_consensus.cc:515] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
I20260709 13:11:24.035473 28688 leader_election.cc:290] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:24.044531 23046 leader_election.cc:336] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:24.046249 28688 raft_consensus.cc:493] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:24.046754 28688 raft_consensus.cc:515] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } }
W20260709 13:11:24.058981 23045 leader_election.cc:336] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:24.059633 23045 leader_election.cc:304] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:24.061237 28688 leader_election.cc:290] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:24.061064 28692 raft_consensus.cc:2749] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:24.068899 23046 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:24.069449 23046 consensus_peers.cc:597] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:24.088966 23620 consensus_peers.cc:597] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.100663 23045 leader_election.cc:336] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:24.101135 23045 leader_election.cc:304] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b655449a388a41e3a606c6ea794825ad; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:24.102941 28719 raft_consensus.cc:2749] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:24.115382 23620 consensus_peers.cc:597] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.123683 23622 consensus_peers.cc:597] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:24.137959 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:24.142303 21775 tablet_replica.cc:333] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.143213 21775 raft_consensus.cc:2243] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:11:24.144891 23622 consensus_peers.cc:597] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:24.145797 21775 raft_consensus.cc:2272] T 58c95f8b8069443eb62239e90ed53fa1 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:24.150274 23620 consensus_peers.cc:597] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.150553 21775 tablet_replica.cc:333] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.151539 21775 raft_consensus.cc:2243] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.152097 21775 raft_consensus.cc:2272] T a934a76e20344681bde221224fb9da0d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:24.156816 23620 consensus_peers.cc:597] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.160118 21775 tablet_replica.cc:333] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.161036 21775 raft_consensus.cc:2243] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.161608 21775 raft_consensus.cc:2272] T 6238b133cf6c4b948cf771c94b860716 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:24.163401 23620 consensus_peers.cc:597] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.164162 21775 tablet_replica.cc:333] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.164992 21775 raft_consensus.cc:2243] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.165582 21775 raft_consensus.cc:2272] T 2aadad04f3914b6998492885aaba04f6 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.168118 21775 tablet_replica.cc:333] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.173911 21775 raft_consensus.cc:2243] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.175077 21775 raft_consensus.cc:2272] T 8e8b5f462dc44c7d96f09188ade5c13d P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:24.175297 23620 consensus_peers.cc:597] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.177699 21775 tablet_replica.cc:333] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.178498 21775 raft_consensus.cc:2243] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.179456 21775 raft_consensus.cc:2272] T 8a155859ea9d41f4a7ccad8246c9c2ba P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.181928 21775 tablet_replica.cc:333] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.182667 21775 raft_consensus.cc:2243] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.183645 21775 raft_consensus.cc:2272] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.186057 21775 tablet_replica.cc:333] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.186846 21775 raft_consensus.cc:2243] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.188578 21775 raft_consensus.cc:2272] T 22342f9fc8d5439e9dc7755716c74fdb P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.191131 21775 tablet_replica.cc:333] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.191890 21775 raft_consensus.cc:2243] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.192504 21775 raft_consensus.cc:2272] T 09c7979afa3c4fcb83838f29edec3b67 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.193053 28698 raft_consensus.cc:493] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
W20260709 13:11:24.193692 23620 consensus_peers.cc:597] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.193543 28698 raft_consensus.cc:515] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:24.197283 21775 tablet_replica.cc:333] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.198493 21775 raft_consensus.cc:2243] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.199509 21775 raft_consensus.cc:2272] T 6c18ae3a17d947e8b70820e473626cb8 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.201948 21775 tablet_replica.cc:333] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.202685 21775 raft_consensus.cc:2243] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:24.202955 23622 leader_election.cc:336] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:24.203209 21775 raft_consensus.cc:2272] T 2534f3909dce4851918d5cc9a252f085 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.204241 28698 leader_election.cc:290] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
I20260709 13:11:24.206056 21775 tablet_replica.cc:333] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.207053 21775 raft_consensus.cc:2243] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.207722 21775 raft_consensus.cc:2272] T d86fa0480a7543048d2dc4f8046cd314 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.210194 21775 tablet_replica.cc:333] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.210961 21775 raft_consensus.cc:2243] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.211975 21775 raft_consensus.cc:2272] T adf5adaae5184191bdaff064d051da2a P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.214558 21775 tablet_replica.cc:333] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
W20260709 13:11:24.214569 23621 leader_election.cc:336] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:24.215181 23621 leader_election.cc:304] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
I20260709 13:11:24.215371 21775 raft_consensus.cc:2243] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.215917 28698 raft_consensus.cc:2749] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.216517 21775 raft_consensus.cc:2272] T 952ed8a46c5e4f158f63440eb6fbef0a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.219071 21775 tablet_replica.cc:333] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.219838 21775 raft_consensus.cc:2243] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.220436 21775 raft_consensus.cc:2272] T 37e2e961b20a4588ba99edcaeaaf578c P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.222815 21775 tablet_replica.cc:333] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.223534 21775 raft_consensus.cc:2243] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.224450 21775 raft_consensus.cc:2272] T da207091d69d47c2a67b181645327e1c P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.226794 21775 tablet_replica.cc:333] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.227487 21775 raft_consensus.cc:2243] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.228067 21775 raft_consensus.cc:2272] T 23b2c8978a514c01ba48a8c4a08a7570 P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.230196 21775 tablet_replica.cc:333] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.230885 21775 raft_consensus.cc:2243] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.231457 21775 raft_consensus.cc:2272] T 8f3bed822a364ea9afe4d449542afc6b P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.233888 21775 tablet_replica.cc:333] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.234639 21775 raft_consensus.cc:2243] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.235126 21775 raft_consensus.cc:2272] T f9d4f6ae66214bcb808947c251df9862 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.237936 21775 tablet_replica.cc:333] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.238776 21775 raft_consensus.cc:2243] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.239871 21775 raft_consensus.cc:2272] T f09dae9312b04b4c8d390ab7d430e7cb P b655449a388a41e3a606c6ea794825ad [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.242245 21775 tablet_replica.cc:333] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.242944 21775 raft_consensus.cc:2243] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.244009 21775 raft_consensus.cc:2272] T 1a642095ff8a4146b8e977c3af22c826 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.246481 21775 tablet_replica.cc:333] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.247165 21775 raft_consensus.cc:2243] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.247795 21775 raft_consensus.cc:2272] T 387a947805334b78b3ac130dee5e4d40 P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.250196 21775 tablet_replica.cc:333] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.250950 21775 raft_consensus.cc:2243] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.251453 21775 raft_consensus.cc:2272] T 72f4ca03b8704b4ca2ad66da9add8692 P b655449a388a41e3a606c6ea794825ad [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.253670 21775 tablet_replica.cc:333] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.254334 21775 raft_consensus.cc:2243] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.255425 21775 raft_consensus.cc:2272] T b8c270d6f9de4942999edb2e7e999066 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.257766 21775 tablet_replica.cc:333] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.258469 21775 raft_consensus.cc:2243] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.258917 21775 raft_consensus.cc:2272] T defec66b69804f8c85671fbdd904172d P b655449a388a41e3a606c6ea794825ad [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.260977 21775 tablet_replica.cc:333] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.261689 21775 raft_consensus.cc:2243] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.262871 21775 raft_consensus.cc:2272] T ca18e836a5464ec5b09378b03ae8b23f P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.265254 21775 tablet_replica.cc:333] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.265940 21775 raft_consensus.cc:2243] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.266458 21775 raft_consensus.cc:2272] T ee9d7188ba094ea3b277000bf9f3a73e P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:24.266796 23620 consensus_peers.cc:597] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.268654 21775 tablet_replica.cc:333] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.269459 21775 raft_consensus.cc:2243] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:24.270920 23622 consensus_peers.cc:597] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:24.271538 21775 raft_consensus.cc:2272] T d9dd0ac5baf440fc96bcfc581bb5d2de P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.273890 21775 tablet_replica.cc:333] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.274642 21775 raft_consensus.cc:2243] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.275462 21775 raft_consensus.cc:2272] T 5adc1058fd2948e382bcd0ee2213ab3a P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.277822 21775 tablet_replica.cc:333] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.278558 21775 raft_consensus.cc:2243] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.279503 21775 raft_consensus.cc:2272] T 19265c3b4d3344e492485458bb4cc867 P b655449a388a41e3a606c6ea794825ad [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.282584 21775 tablet_replica.cc:333] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.283310 21775 raft_consensus.cc:2243] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.283870 21775 raft_consensus.cc:2272] T e257e4274a884c2b87551c41d6072956 P b655449a388a41e3a606c6ea794825ad [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.286648 21775 tablet_replica.cc:333] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.290998 21775 raft_consensus.cc:2243] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.291550 21775 raft_consensus.cc:2272] T a2c9f6da39cd452dbbc2fe4221c4b7ee P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.293960 21775 tablet_replica.cc:333] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.294682 21775 raft_consensus.cc:2243] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.295673 21775 raft_consensus.cc:2272] T 003d4c22ec774af79682d96196a7e8b7 P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.298070 21775 tablet_replica.cc:333] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.298723 21775 raft_consensus.cc:2243] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.299360 21775 raft_consensus.cc:2272] T a0fd26ed0b904e01959f5f0d30437e69 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.301716 21775 tablet_replica.cc:333] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.302369 21775 raft_consensus.cc:2243] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.302875 21775 raft_consensus.cc:2272] T 5bf6397d6bc54a22915e0146962b443d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.305042 21775 tablet_replica.cc:333] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.305682 21775 raft_consensus.cc:2243] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.306635 21775 raft_consensus.cc:2272] T f56c90b2fb06459db835049dbf5a060d P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.309098 21775 tablet_replica.cc:333] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.309945 21775 raft_consensus.cc:2243] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.310546 21775 raft_consensus.cc:2272] T 2806bd6497384caf84700ae1cb863e9b P b655449a388a41e3a606c6ea794825ad [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.313024 21775 tablet_replica.cc:333] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.313695 21775 raft_consensus.cc:2243] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.314307 21775 raft_consensus.cc:2272] T 0633fbe8ee1c4284a67d72b00a0285a0 P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.316869 21775 tablet_replica.cc:333] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.317574 21775 raft_consensus.cc:2243] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.318564 21775 raft_consensus.cc:2272] T f5db53771823404097dd71493c3b242b P b655449a388a41e3a606c6ea794825ad [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.320940 21775 tablet_replica.cc:333] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.321586 21775 raft_consensus.cc:2243] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.322569 21775 raft_consensus.cc:2272] T 492dd607be6348c79999243a8383806d P b655449a388a41e3a606c6ea794825ad [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.324960 21775 tablet_replica.cc:333] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.325616 21775 raft_consensus.cc:2243] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.326833 21775 raft_consensus.cc:2272] T e54cbb7e06ba404b91d84809d3aa8548 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.329314 21775 tablet_replica.cc:333] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.329934 21775 raft_consensus.cc:2243] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.330865 21775 raft_consensus.cc:2272] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P b655449a388a41e3a606c6ea794825ad [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.333166 21775 tablet_replica.cc:333] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.333801 21775 raft_consensus.cc:2243] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.335071 21775 raft_consensus.cc:2272] T 8c7d0f07529640fcbd96e1a627491d86 P b655449a388a41e3a606c6ea794825ad [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.337632 21775 tablet_replica.cc:333] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.338223 21775 raft_consensus.cc:2243] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:24.339319 21775 raft_consensus.cc:2272] T e45d03aff8ab48f6bc531f18ca6d386c P b655449a388a41e3a606c6ea794825ad [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.341675 21775 tablet_replica.cc:333] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad: stopping tablet replica
I20260709 13:11:24.342239 21775 raft_consensus.cc:2243] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:24.342919 21775 raft_consensus.cc:2272] T 9c57d9be04024fee96aa769711f72d7c P b655449a388a41e3a606c6ea794825ad [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:24.348057 28698 raft_consensus.cc:493] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 216ff6323e434e399d196d8ba262c8f3)
I20260709 13:11:24.348608 28698 raft_consensus.cc:515] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:24.351212 28698 leader_election.cc:290] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:24.373894 23621 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:24.380404 23620 consensus_peers.cc:597] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.391021 23622 leader_election.cc:336] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:24.392887 23622 leader_election.cc:304] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, 216ff6323e434e399d196d8ba262c8f3
W20260709 13:11:24.386529 23620 consensus_peers.cc:597] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.396792 23620 consensus_peers.cc:597] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.397408 28713 raft_consensus.cc:2749] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:24.403517 23620 consensus_peers.cc:597] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.414330 23620 consensus_peers.cc:597] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.432126 23620 consensus_peers.cc:597] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.550249 23620 consensus_peers.cc:597] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d -> Peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Couldn't send request to peer b655449a388a41e3a606c6ea794825ad. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.688877 23621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:39749, user_credentials={real_user=slave}} blocked reactor thread for 107223us
W20260709 13:11:24.960964 23622 consensus_peers.cc:597] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:25.014523 23622 consensus_peers.cc:597] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:25.121084 28722 raft_consensus.cc:493] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.121639 28722 raft_consensus.cc:515] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } attrs { promote: false } }
I20260709 13:11:25.124554 28722 leader_election.cc:290] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749)
W20260709 13:11:25.127667 23620 leader_election.cc:336] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
W20260709 13:11:25.129412 23621 leader_election.cc:336] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:25.129873 23621 leader_election.cc:304] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.131551 28722 raft_consensus.cc:2749] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:25.164466 23621 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:25.165712 28722 raft_consensus.cc:493] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.166312 28722 raft_consensus.cc:515] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } attrs { replace: true } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:25.171988 23622 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:25.178407 23620 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
I20260709 13:11:25.180725 23620 leader_election.cc:304] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.182031 28698 raft_consensus.cc:2749] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:25.185992 28698 raft_consensus.cc:493] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.186422 28698 raft_consensus.cc:515] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
W20260709 13:11:25.187835 23621 leader_election.cc:336] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:25.188364 28698 leader_election.cc:290] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:25.188862 28722 leader_election.cc:290] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:25.192198 23621 consensus_peers.cc:597] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:25.193830 23622 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:25.196449 23620 leader_election.cc:336] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
I20260709 13:11:25.196834 23620 leader_election.cc:304] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.197506 28722 raft_consensus.cc:2749] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:25.264281 28722 raft_consensus.cc:493] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.264803 28722 raft_consensus.cc:515] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:25.266810 28722 leader_election.cc:290] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:25.270910 23622 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:25.271893 23620 leader_election.cc:336] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
I20260709 13:11:25.272284 23620 leader_election.cc:304] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.272934 28722 raft_consensus.cc:2749] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:25.284976 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:11:25.290591 28698 raft_consensus.cc:493] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.291119 28698 raft_consensus.cc:515] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:25.293253 28698 leader_election.cc:290] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:25.298858 23621 leader_election.cc:336] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:25.303544 23620 leader_election.cc:336] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
I20260709 13:11:25.304224 23620 leader_election.cc:304] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.306176 28698 raft_consensus.cc:2749] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:25.342669 28698 raft_consensus.cc:493] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.343348 28698 raft_consensus.cc:515] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:25.347692 28698 leader_election.cc:290] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
W20260709 13:11:25.351104 23622 leader_election.cc:336] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:25.352808 23620 leader_election.cc:336] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
I20260709 13:11:25.353552 23620 leader_election.cc:304] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.354578 28698 raft_consensus.cc:2749] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:25.385320 23621 consensus_peers.cc:597] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d -> Peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Couldn't send request to peer 216ff6323e434e399d196d8ba262c8f3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:25.397148 28698 raft_consensus.cc:493] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.397675 28722 raft_consensus.cc:493] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.397845 28698 raft_consensus.cc:515] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:25.398242 28722 raft_consensus.cc:515] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:25.400338 28698 leader_election.cc:290] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:25.400379 28722 leader_election.cc:290] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:25.397854 21775 tablet_server.cc:179] TabletServer@127.21.67.196:0 shutting down...
W20260709 13:11:25.405052 23621 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
W20260709 13:11:25.409420 23622 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
W20260709 13:11:25.416710 23620 leader_election.cc:336] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
I20260709 13:11:25.417084 23620 leader_election.cc:304] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.417666 28698 raft_consensus.cc:2749] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:25.417834 23620 leader_election.cc:336] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
I20260709 13:11:25.418298 23620 leader_election.cc:304] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.418864 28698 raft_consensus.cc:2749] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:25.456514 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:25.457460 21775 tablet_replica.cc:333] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.458317 21775 raft_consensus.cc:2243] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.459391 21775 raft_consensus.cc:2272] T 5adc1058fd2948e382bcd0ee2213ab3a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.461983 21775 tablet_replica.cc:333] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.462728 21775 raft_consensus.cc:2243] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.463896 21775 raft_consensus.cc:2272] T 590119d9a7e74f099c0a28550f4fb3f5 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.465137 28698 raft_consensus.cc:493] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.465553 28698 raft_consensus.cc:515] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0db2f61e34a24096a5baf0de9a32d4f7" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 39171 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:25.466406 21775 tablet_replica.cc:333] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.467250 21775 raft_consensus.cc:2243] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.468226 21775 raft_consensus.cc:2272] T a2c9f6da39cd452dbbc2fe4221c4b7ee P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.469415 28698 leader_election.cc:290] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:25.470883 21775 tablet_replica.cc:333] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
W20260709 13:11:25.471791 23620 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
W20260709 13:11:25.472873 23622 leader_election.cc:336] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111)
I20260709 13:11:25.473244 23622 leader_election.cc:304] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 0db2f61e34a24096a5baf0de9a32d4f7, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.473310 21775 raft_consensus.cc:2243] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.474514 21775 raft_consensus.cc:2272] T 7c435cd2efc84579b5b18dbaa04ee538 P 01988c2c817947859340a730b7f1247d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.474710 28722 raft_consensus.cc:2749] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:25.477218 21775 tablet_replica.cc:333] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.478148 21775 raft_consensus.cc:2243] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.478892 21775 raft_consensus.cc:2272] T f5db53771823404097dd71493c3b242b P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:25.479875 23622 consensus_peers.cc:597] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d -> Peer 0db2f61e34a24096a5baf0de9a32d4f7 (127.21.67.193:39171): Couldn't send request to peer 0db2f61e34a24096a5baf0de9a32d4f7. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:39171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:11:25.481568 21775 tablet_replica.cc:333] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.482366 21775 raft_consensus.cc:2243] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.483705 21775 raft_consensus.cc:2272] T 23b2c8978a514c01ba48a8c4a08a7570 P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.485169 28698 raft_consensus.cc:493] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b655449a388a41e3a606c6ea794825ad)
I20260709 13:11:25.485975 28698 raft_consensus.cc:515] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "216ff6323e434e399d196d8ba262c8f3" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 39749 } } peers { permanent_uuid: "b655449a388a41e3a606c6ea794825ad" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45219 } } peers { permanent_uuid: "01988c2c817947859340a730b7f1247d" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 35811 } attrs { promote: false } }
I20260709 13:11:25.487425 21775 tablet_replica.cc:333] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.489853 21775 raft_consensus.cc:2243] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.491926 28698 leader_election.cc:290] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749), b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219)
I20260709 13:11:25.491937 21775 raft_consensus.cc:2272] T d9dd0ac5baf440fc96bcfc581bb5d2de P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:25.494561 23620 leader_election.cc:336] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b655449a388a41e3a606c6ea794825ad (127.21.67.195:45219): Network error: Client connection negotiation failed: client connection to 127.21.67.195:45219: connect: Connection refused (error 111)
W20260709 13:11:25.497032 23621 leader_election.cc:336] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 216ff6323e434e399d196d8ba262c8f3 (127.21.67.194:39749): Network error: Client connection negotiation failed: client connection to 127.21.67.194:39749: connect: Connection refused (error 111)
I20260709 13:11:25.497395 23621 leader_election.cc:304] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01988c2c817947859340a730b7f1247d; no voters: 216ff6323e434e399d196d8ba262c8f3, b655449a388a41e3a606c6ea794825ad
I20260709 13:11:25.497524 21775 tablet_replica.cc:333] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.497992 28698 raft_consensus.cc:2749] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:25.498378 21775 raft_consensus.cc:2243] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.499176 21775 raft_consensus.cc:2272] T 0cccb8c9157c4c8f9c0a83fbb86bfdc3 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.501662 21775 tablet_replica.cc:333] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.502393 21775 raft_consensus.cc:2243] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.503286 21775 raft_consensus.cc:2272] T 09c7979afa3c4fcb83838f29edec3b67 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.505663 21775 tablet_replica.cc:333] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.506410 21775 raft_consensus.cc:2243] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.507382 21775 raft_consensus.cc:2272] T 65ec39fe8fb84cf39e1a859ea7b735d1 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.510013 21775 tablet_replica.cc:333] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.510751 21775 raft_consensus.cc:2243] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.511446 21775 raft_consensus.cc:2272] T 22342f9fc8d5439e9dc7755716c74fdb P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.513914 21775 tablet_replica.cc:333] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.514638 21775 raft_consensus.cc:2243] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.515185 21775 raft_consensus.cc:2272] T 94bcbf412cf54b0fa378f2ce70dec99f P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.517691 21775 tablet_replica.cc:333] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.518371 21775 raft_consensus.cc:2243] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.518878 21775 raft_consensus.cc:2272] T f56c90b2fb06459db835049dbf5a060d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.521234 21775 tablet_replica.cc:333] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.521899 21775 raft_consensus.cc:2243] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.522404 21775 raft_consensus.cc:2272] T 492dd607be6348c79999243a8383806d P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.524845 21775 tablet_replica.cc:333] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.525591 21775 raft_consensus.cc:2243] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.526084 21775 raft_consensus.cc:2272] T e54cbb7e06ba404b91d84809d3aa8548 P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.528505 21775 tablet_replica.cc:333] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.529189 21775 raft_consensus.cc:2243] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.530084 21775 raft_consensus.cc:2272] T 8c7d0f07529640fcbd96e1a627491d86 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.532364 21775 tablet_replica.cc:333] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.533062 21775 raft_consensus.cc:2243] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.533583 21775 raft_consensus.cc:2272] T 58c95f8b8069443eb62239e90ed53fa1 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.535923 21775 tablet_replica.cc:333] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.536580 21775 raft_consensus.cc:2243] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.537201 21775 raft_consensus.cc:2272] T 8a155859ea9d41f4a7ccad8246c9c2ba P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.539465 21775 tablet_replica.cc:333] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.540160 21775 raft_consensus.cc:2243] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.540705 21775 raft_consensus.cc:2272] T 20adeb7c99154724bd868029eb5ed0df P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.542922 21775 tablet_replica.cc:333] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.543584 21775 raft_consensus.cc:2243] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.544209 21775 raft_consensus.cc:2272] T 6c18ae3a17d947e8b70820e473626cb8 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.546437 21775 tablet_replica.cc:333] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.547142 21775 raft_consensus.cc:2243] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.547829 21775 raft_consensus.cc:2272] T ca18e836a5464ec5b09378b03ae8b23f P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.550145 21775 tablet_replica.cc:333] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.550822 21775 raft_consensus.cc:2243] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.551841 21775 raft_consensus.cc:2272] T defec66b69804f8c85671fbdd904172d P 01988c2c817947859340a730b7f1247d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.554042 21775 tablet_replica.cc:333] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.554698 21775 raft_consensus.cc:2243] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.555644 21775 raft_consensus.cc:2272] T 0633fbe8ee1c4284a67d72b00a0285a0 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.557986 21775 tablet_replica.cc:333] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.558702 21775 raft_consensus.cc:2243] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.559615 21775 raft_consensus.cc:2272] T 71491ce9117b44a08c83b84589d0ba9d P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.561990 21775 tablet_replica.cc:333] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.562740 21775 raft_consensus.cc:2243] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.563622 21775 raft_consensus.cc:2272] T 682d24a2200c4222a401f9ab803af214 P 01988c2c817947859340a730b7f1247d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.565907 21775 tablet_replica.cc:333] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.566614 21775 raft_consensus.cc:2243] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.567529 21775 raft_consensus.cc:2272] T 387a947805334b78b3ac130dee5e4d40 P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.569836 21775 tablet_replica.cc:333] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.570549 21775 raft_consensus.cc:2243] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.571105 21775 raft_consensus.cc:2272] T 1a642095ff8a4146b8e977c3af22c826 P 01988c2c817947859340a730b7f1247d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.573493 21775 tablet_replica.cc:333] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.574187 21775 raft_consensus.cc:2243] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.574757 21775 raft_consensus.cc:2272] T ce98d2857d3f449c8d9052124b418f8c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.577099 21775 tablet_replica.cc:333] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.577773 21775 raft_consensus.cc:2243] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.578874 21775 raft_consensus.cc:2272] T 9dfb822e7cb640e68719af6e16591c4a P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.581300 21775 tablet_replica.cc:333] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.581962 21775 raft_consensus.cc:2243] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.582751 21775 raft_consensus.cc:2272] T a5f4021a98714bc6b65420cc163e3a91 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.585170 21775 tablet_replica.cc:333] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.585829 21775 raft_consensus.cc:2243] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.586719 21775 raft_consensus.cc:2272] T 8f3bed822a364ea9afe4d449542afc6b P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.589119 21775 tablet_replica.cc:333] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.589803 21775 raft_consensus.cc:2243] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.590764 21775 raft_consensus.cc:2272] T f9d4f6ae66214bcb808947c251df9862 P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.593083 21775 tablet_replica.cc:333] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.593739 21775 raft_consensus.cc:2243] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.594758 21775 raft_consensus.cc:2272] T eccda721d3ee4ac79479134d323b9640 P 01988c2c817947859340a730b7f1247d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.597116 21775 tablet_replica.cc:333] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.597754 21775 raft_consensus.cc:2243] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.598618 21775 raft_consensus.cc:2272] T 37e2e961b20a4588ba99edcaeaaf578c P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.600850 21775 tablet_replica.cc:333] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.601524 21775 raft_consensus.cc:2243] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.602406 21775 raft_consensus.cc:2272] T 2534f3909dce4851918d5cc9a252f085 P 01988c2c817947859340a730b7f1247d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.604806 21775 tablet_replica.cc:333] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.605443 21775 raft_consensus.cc:2243] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.606053 21775 raft_consensus.cc:2272] T 52e9d1a1bba44536a9f74a4b0a1ae1ff P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.608440 21775 tablet_replica.cc:333] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.609122 21775 raft_consensus.cc:2243] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.609970 21775 raft_consensus.cc:2272] T da207091d69d47c2a67b181645327e1c P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.612147 21775 tablet_replica.cc:333] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.612771 21775 raft_consensus.cc:2243] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.613291 21775 raft_consensus.cc:2272] T e45d03aff8ab48f6bc531f18ca6d386c P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.615530 21775 tablet_replica.cc:333] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.616191 21775 raft_consensus.cc:2243] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.617202 21775 raft_consensus.cc:2272] T f7518f17f1ae4b619ddf2d5e1eeb0c3d P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.619556 21775 tablet_replica.cc:333] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.620247 21775 raft_consensus.cc:2243] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.621131 21775 raft_consensus.cc:2272] T 6238b133cf6c4b948cf771c94b860716 P 01988c2c817947859340a730b7f1247d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.623328 21775 tablet_replica.cc:333] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.623966 21775 raft_consensus.cc:2243] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.624891 21775 raft_consensus.cc:2272] T d3222d52f8784a58a81fe1c534bbaf98 P 01988c2c817947859340a730b7f1247d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.627223 21775 tablet_replica.cc:333] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.627862 21775 raft_consensus.cc:2243] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:25.628791 21775 raft_consensus.cc:2272] T 5bf6397d6bc54a22915e0146962b443d P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.630918 21775 tablet_replica.cc:333] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.631517 21775 raft_consensus.cc:2243] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.632107 21775 raft_consensus.cc:2272] T adf5adaae5184191bdaff064d051da2a P 01988c2c817947859340a730b7f1247d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.634385 21775 tablet_replica.cc:333] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.634986 21775 raft_consensus.cc:2243] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.635473 21775 raft_consensus.cc:2272] T 952ed8a46c5e4f158f63440eb6fbef0a P 01988c2c817947859340a730b7f1247d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.637813 21775 tablet_replica.cc:333] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d: stopping tablet replica
I20260709 13:11:25.638343 21775 raft_consensus.cc:2243] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.638850 21775 raft_consensus.cc:2272] T 808909fe49ff4730b32151fb7a7b559e P 01988c2c817947859340a730b7f1247d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:25.645862 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcb60 after lost signal to thread 21778
W20260709 13:11:25.646728 23678 debug-util.cc:398] Leaking SignalData structure 0x7b0800154480 after lost signal to thread 22863
W20260709 13:11:25.647866 23678 debug-util.cc:398] Leaking SignalData structure 0x7b08004240a0 after lost signal to thread 23681
I20260709 13:11:26.577144 21775 tablet_server.cc:196] TabletServer@127.21.67.196:0 shutdown complete.
I20260709 13:11:26.650203 21775 master.cc:562] Master@127.21.67.254:36129 shutting down...
W20260709 13:11:26.682982 22877 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:11:26.683288 22877 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:11:26.683530 22877 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:11:26.685647 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:26.686137 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.686409 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P 84f66d81ef21415a8d9a0c01ca7125b0: stopping tablet replica
I20260709 13:11:26.798620 21775 master.cc:584] Master@127.21.67.254:36129 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (191105 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:11:26.891613 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:35781
I20260709 13:11:26.892762 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:26.898037 28725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:26.898118 28726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:26.901101 28728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:26.903759 21775 server_base.cc:1061] running on GCE node
I20260709 13:11:26.906914 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:26.907174 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:26.907370 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602686907352 us; error 0 us; skew 500 ppm
I20260709 13:11:26.908131 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:26.911378 21775 webserver.cc:533] Webserver started at http://127.21.67.254:36041/ using document root <none> and password file <none>
I20260709 13:11:26.912220 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:26.912461 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:26.912989 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:26.914834 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "5b5fde7f865343ec9838244d59ac14b1"
format_stamp: "Formatted at 2026-07-09 13:11:26 on dist-test-slave-zkvt"
I20260709 13:11:26.922638 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:26.927179 28733 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:26.928213 21775 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:26.928548 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "5b5fde7f865343ec9838244d59ac14b1"
format_stamp: "Formatted at 2026-07-09 13:11:26 on dist-test-slave-zkvt"
I20260709 13:11:26.928933 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:26.946434 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:26.947808 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:26.992982 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:35781
I20260709 13:11:26.993114 28784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:35781 every 8 connection(s)
I20260709 13:11:26.996757 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.006383 28785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1: Bootstrap starting.
I20260709 13:11:27.010996 28785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.014792 28785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1: No bootstrap required, opened a new log
I20260709 13:11:27.016846 28785 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b5fde7f865343ec9838244d59ac14b1" member_type: VOTER }
I20260709 13:11:27.017221 28785 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.017397 28785 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b5fde7f865343ec9838244d59ac14b1, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.017948 28785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b5fde7f865343ec9838244d59ac14b1" member_type: VOTER }
I20260709 13:11:27.018350 28785 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:27.018532 28785 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:27.018743 28785 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.024580 28785 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b5fde7f865343ec9838244d59ac14b1" member_type: VOTER }
I20260709 13:11:27.025357 28785 leader_election.cc:304] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b5fde7f865343ec9838244d59ac14b1; no voters: 
I20260709 13:11:27.027009 28785 leader_election.cc:290] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:27.027346 28788 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.029043 28788 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 1 LEADER]: Becoming Leader. State: Replica: 5b5fde7f865343ec9838244d59ac14b1, State: Running, Role: LEADER
I20260709 13:11:27.029878 28788 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b5fde7f865343ec9838244d59ac14b1" member_type: VOTER }
I20260709 13:11:27.030344 28785 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:27.035643 28790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b5fde7f865343ec9838244d59ac14b1. Latest consensus state: current_term: 1 leader_uuid: "5b5fde7f865343ec9838244d59ac14b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b5fde7f865343ec9838244d59ac14b1" member_type: VOTER } }
I20260709 13:11:27.036355 28790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:27.038290 28794 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:27.038205 28789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b5fde7f865343ec9838244d59ac14b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b5fde7f865343ec9838244d59ac14b1" member_type: VOTER } }
I20260709 13:11:27.039168 28789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:27.044705 28794 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:27.049602 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:27.053453 28794 catalog_manager.cc:1383] Generated new cluster ID: 6432887fdfd94d8e88f5547fe8a01345
I20260709 13:11:27.053727 28794 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:27.064332 28794 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:27.065518 28794 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:27.078783 28794 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1: Generated new TSK 0
I20260709 13:11:27.079360 28794 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:27.084088 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:27.089807 28806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:27.091249 28807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:27.092582 28809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:27.093300 21775 server_base.cc:1061] running on GCE node
I20260709 13:11:27.095242 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:27.095413 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:27.095534 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602687095524 us; error 0 us; skew 500 ppm
I20260709 13:11:27.096053 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:27.098126 21775 webserver.cc:533] Webserver started at http://127.21.67.193:41743/ using document root <none> and password file <none>
I20260709 13:11:27.098527 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:27.098671 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:27.098875 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:27.100013 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "c2d8ce5db69d488bac364452e3c87684"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.104213 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:27.107260 28814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.108016 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:27.108300 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "c2d8ce5db69d488bac364452e3c87684"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.108587 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:27.129410 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:27.165261 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:27.167061 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:27.169812 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:27.169981 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.170323 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:27.170486 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.212347 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:43757
I20260709 13:11:27.212569 28877 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:43757 every 8 connection(s)
I20260709 13:11:27.218694 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:27.227866 28882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:27.228283 28883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:27.231397 21775 server_base.cc:1061] running on GCE node
W20260709 13:11:27.231465 28886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:27.233906 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:27.234150 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:27.234338 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602687234315 us; error 0 us; skew 500 ppm
I20260709 13:11:27.234900 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:27.237300 28878 heartbeater.cc:344] Connected to a master server at 127.21.67.254:35781
I20260709 13:11:27.237673 28878 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:27.238045 21775 webserver.cc:533] Webserver started at http://127.21.67.194:46481/ using document root <none> and password file <none>
I20260709 13:11:27.238561 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:27.238552 28878 heartbeater.cc:507] Master 127.21.67.254:35781 requested a full tablet report, sending...
I20260709 13:11:27.239040 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:27.239387 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:27.241113 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.241261 28750 ts_manager.cc:194] Registered new tserver with Master: c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:27.243425 28750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43786
I20260709 13:11:27.246466 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:27.249959 28890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.250630 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:27.250891 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.251181 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:27.268850 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:27.269974 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:27.271323 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:27.273454 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:27.273675 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.273896 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:27.274056 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.312862 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:38231
I20260709 13:11:27.312961 28952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:38231 every 8 connection(s)
I20260709 13:11:27.317678 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:27.325032 28956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:27.326159 28957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:27.330372 28959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:27.331113 21775 server_base.cc:1061] running on GCE node
I20260709 13:11:27.332083 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:27.332378 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:27.332456 28953 heartbeater.cc:344] Connected to a master server at 127.21.67.254:35781
I20260709 13:11:27.332602 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602687332581 us; error 0 us; skew 500 ppm
I20260709 13:11:27.332913 28953 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:27.333439 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:27.333796 28953 heartbeater.cc:507] Master 127.21.67.254:35781 requested a full tablet report, sending...
I20260709 13:11:27.336021 28750 ts_manager.cc:194] Registered new tserver with Master: 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:27.336093 21775 webserver.cc:533] Webserver started at http://127.21.67.195:45577/ using document root <none> and password file <none>
I20260709 13:11:27.336701 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:27.336907 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:27.337183 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:27.337563 28750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43794
I20260709 13:11:27.338577 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "aceb6f6c95434708b96f7552ee379a8e"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.342765 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:27.345948 28964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.346668 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:11:27.346946 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "aceb6f6c95434708b96f7552ee379a8e"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.347237 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:27.362084 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:27.363232 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:27.364681 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:27.366739 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:27.366961 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.367197 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:27.367370 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.405897 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:38499
I20260709 13:11:27.405992 29026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:38499 every 8 connection(s)
I20260709 13:11:27.410938 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:27.417368 29030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:27.417990 29031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:27.420815 29033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:27.420966 21775 server_base.cc:1061] running on GCE node
I20260709 13:11:27.422144 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:27.422408 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:27.422596 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602687422562 us; error 0 us; skew 500 ppm
I20260709 13:11:27.423087 29027 heartbeater.cc:344] Connected to a master server at 127.21.67.254:35781
I20260709 13:11:27.423274 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:27.423478 29027 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:27.424412 29027 heartbeater.cc:507] Master 127.21.67.254:35781 requested a full tablet report, sending...
I20260709 13:11:27.426249 21775 webserver.cc:533] Webserver started at http://127.21.67.196:36425/ using document root <none> and password file <none>
I20260709 13:11:27.426699 28750 ts_manager.cc:194] Registered new tserver with Master: aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:27.426905 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:27.427183 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:27.427491 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:27.428520 28750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43798
I20260709 13:11:27.429119 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-3-root/instance:
uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.433727 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:27.437131 29038 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.437844 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:27.438131 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-3-root
uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:27.438401 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:27.453785 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:27.454922 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:27.456403 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:27.458524 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:27.458742 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.458976 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:27.459154 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:27.502247 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.196:39417
I20260709 13:11:27.502344 29100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.196:39417 every 8 connection(s)
I20260709 13:11:27.516088 29101 heartbeater.cc:344] Connected to a master server at 127.21.67.254:35781
I20260709 13:11:27.516443 29101 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:27.517220 29101 heartbeater.cc:507] Master 127.21.67.254:35781 requested a full tablet report, sending...
I20260709 13:11:27.518929 28750 ts_manager.cc:194] Registered new tserver with Master: 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:27.519029 21775 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013484576s
I20260709 13:11:27.520323 28750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43806
I20260709 13:11:27.544869 28750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43820:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:11:27.796175 28843 tablet_service.cc:1511] Processing CreateTablet for tablet 31bd89e5e6ee4b6e92d1ad1ea58721bb (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:27.797839 28843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31bd89e5e6ee4b6e92d1ad1ea58721bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.797900 28842 tablet_service.cc:1511] Processing CreateTablet for tablet a2f04d827ff541d9ad5feb028f6fec84 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:27.799407 28842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f04d827ff541d9ad5feb028f6fec84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.801014 29066 tablet_service.cc:1511] Processing CreateTablet for tablet a2f04d827ff541d9ad5feb028f6fec84 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:27.803610 29065 tablet_service.cc:1511] Processing CreateTablet for tablet cfe3bfc02d2a4c048cdf83ee4991fa10 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:27.806030 29064 tablet_service.cc:1511] Processing CreateTablet for tablet f1ead15c3afd4bffac3533ab972efba4 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:27.808779 29062 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd18196206443bb8d02853f289677a9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:27.811092 28841 tablet_service.cc:1511] Processing CreateTablet for tablet cfe3bfc02d2a4c048cdf83ee4991fa10 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:27.812539 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3bfc02d2a4c048cdf83ee4991fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.814157 28916 tablet_service.cc:1511] Processing CreateTablet for tablet f1ead15c3afd4bffac3533ab972efba4 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:27.815481 28916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ead15c3afd4bffac3533ab972efba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.816895 28840 tablet_service.cc:1511] Processing CreateTablet for tablet 5954e889e23845479415928960eb44ab (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:27.819739 29066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f04d827ff541d9ad5feb028f6fec84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.820725 28918 tablet_service.cc:1511] Processing CreateTablet for tablet 31bd89e5e6ee4b6e92d1ad1ea58721bb (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:27.821884 28988 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd18196206443bb8d02853f289677a9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:27.823277 28988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd18196206443bb8d02853f289677a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.823004 28987 tablet_service.cc:1511] Processing CreateTablet for tablet 6d34c5f0983b472d988e26619d914252 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:27.823772 29064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ead15c3afd4bffac3533ab972efba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.824340 28987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d34c5f0983b472d988e26619d914252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.824819 28986 tablet_service.cc:1511] Processing CreateTablet for tablet f6e35b460c6a457091d81b9da6ad5c56 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:27.826076 28986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e35b460c6a457091d81b9da6ad5c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.826648 29065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3bfc02d2a4c048cdf83ee4991fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.827847 28838 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd18196206443bb8d02853f289677a9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:27.829286 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd18196206443bb8d02853f289677a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.829692 28912 tablet_service.cc:1511] Processing CreateTablet for tablet f6e35b460c6a457091d81b9da6ad5c56 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:27.831159 29061 tablet_service.cc:1511] Processing CreateTablet for tablet 6d34c5f0983b472d988e26619d914252 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:27.832710 29061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d34c5f0983b472d988e26619d914252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.833141 28836 tablet_service.cc:1511] Processing CreateTablet for tablet e1b93b33daae4eadbaab3085ddf2e1da (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:27.834470 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b93b33daae4eadbaab3085ddf2e1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.834690 28989 tablet_service.cc:1511] Processing CreateTablet for tablet 5954e889e23845479415928960eb44ab (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:27.820739 28991 tablet_service.cc:1511] Processing CreateTablet for tablet cfe3bfc02d2a4c048cdf83ee4991fa10 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:27.836030 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5954e889e23845479415928960eb44ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.836685 28991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3bfc02d2a4c048cdf83ee4991fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.832707 29063 tablet_service.cc:1511] Processing CreateTablet for tablet b8550ef17e8a41acbcdfe5eab4042fc2 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:27.838846 29063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8550ef17e8a41acbcdfe5eab4042fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.838657 28914 tablet_service.cc:1511] Processing CreateTablet for tablet b8550ef17e8a41acbcdfe5eab4042fc2 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:27.818693 28992 tablet_service.cc:1511] Processing CreateTablet for tablet 31bd89e5e6ee4b6e92d1ad1ea58721bb (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:27.840797 28992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31bd89e5e6ee4b6e92d1ad1ea58721bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.840973 28913 tablet_service.cc:1511] Processing CreateTablet for tablet 6d34c5f0983b472d988e26619d914252 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:27.827997 28839 tablet_service.cc:1511] Processing CreateTablet for tablet b8550ef17e8a41acbcdfe5eab4042fc2 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:27.842427 28839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8550ef17e8a41acbcdfe5eab4042fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.843708 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd18196206443bb8d02853f289677a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.843376 28915 tablet_service.cc:1511] Processing CreateTablet for tablet 5954e889e23845479415928960eb44ab (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:27.848419 28837 tablet_service.cc:1511] Processing CreateTablet for tablet f6e35b460c6a457091d81b9da6ad5c56 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:27.850224 29058 tablet_service.cc:1511] Processing CreateTablet for tablet 73566428eabe4cb9aa1cb835c62e071e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:27.850612 28917 tablet_service.cc:1511] Processing CreateTablet for tablet a2f04d827ff541d9ad5feb028f6fec84 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:27.851594 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73566428eabe4cb9aa1cb835c62e071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.851946 28917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f04d827ff541d9ad5feb028f6fec84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.853749 29059 tablet_service.cc:1511] Processing CreateTablet for tablet cd251d5537f14f37a55ab6d63637d34a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:27.855195 29059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd251d5537f14f37a55ab6d63637d34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.861356 28985 tablet_service.cc:1511] Processing CreateTablet for tablet cd251d5537f14f37a55ab6d63637d34a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:27.862685 28985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd251d5537f14f37a55ab6d63637d34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.864787 28911 tablet_service.cc:1511] Processing CreateTablet for tablet e1b93b33daae4eadbaab3085ddf2e1da (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:27.866123 28911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b93b33daae4eadbaab3085ddf2e1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.868744 29060 tablet_service.cc:1511] Processing CreateTablet for tablet e1b93b33daae4eadbaab3085ddf2e1da (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:27.870131 29060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b93b33daae4eadbaab3085ddf2e1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.870056 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 3cfc847797b84ec4be004a36829f8488 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:27.871518 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cfc847797b84ec4be004a36829f8488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.872120 28990 tablet_service.cc:1511] Processing CreateTablet for tablet f1ead15c3afd4bffac3533ab972efba4 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:27.873425 28990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ead15c3afd4bffac3533ab972efba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.873744 28835 tablet_service.cc:1511] Processing CreateTablet for tablet cd251d5537f14f37a55ab6d63637d34a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:27.877604 28910 tablet_service.cc:1511] Processing CreateTablet for tablet 73566428eabe4cb9aa1cb835c62e071e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:27.878886 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73566428eabe4cb9aa1cb835c62e071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.889701 28984 tablet_service.cc:1511] Processing CreateTablet for tablet 73566428eabe4cb9aa1cb835c62e071e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:27.891075 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73566428eabe4cb9aa1cb835c62e071e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.897851 28834 tablet_service.cc:1511] Processing CreateTablet for tablet 01ac272a33ca49f2b3a823dba78768e5 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:27.899317 28983 tablet_service.cc:1511] Processing CreateTablet for tablet 01ac272a33ca49f2b3a823dba78768e5 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:27.900727 28983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ac272a33ca49f2b3a823dba78768e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.900846 28834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ac272a33ca49f2b3a823dba78768e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.899892 28909 tablet_service.cc:1511] Processing CreateTablet for tablet 01ac272a33ca49f2b3a823dba78768e5 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:27.905081 28909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ac272a33ca49f2b3a823dba78768e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.936599 28835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd251d5537f14f37a55ab6d63637d34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.944697 28912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e35b460c6a457091d81b9da6ad5c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.953543 28843 tablet_service.cc:1511] Processing CreateTablet for tablet 3cfc847797b84ec4be004a36829f8488 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:27.967427 28916 tablet_service.cc:1511] Processing CreateTablet for tablet 3cfc847797b84ec4be004a36829f8488 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:27.976423 29120 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:27.979858 28918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31bd89e5e6ee4b6e92d1ad1ea58721bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.980962 28914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8550ef17e8a41acbcdfe5eab4042fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.982191 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d34c5f0983b472d988e26619d914252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.983311 28840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5954e889e23845479415928960eb44ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.003873 29121 tablet_bootstrap.cc:492] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:28.030800 28843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cfc847797b84ec4be004a36829f8488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.034363 29058 tablet_service.cc:1511] Processing CreateTablet for tablet e7c6c665d7f64081a51c8c1b8167b26e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:28.039824 28916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cfc847797b84ec4be004a36829f8488. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:28.045468 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:28.047708 28984 tablet_service.cc:1511] Processing CreateTablet for tablet e7c6c665d7f64081a51c8c1b8167b26e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:28.052119 29121 tablet_bootstrap.cc:654] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.042188 29120 tablet_bootstrap.cc:654] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.055974 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c6c665d7f64081a51c8c1b8167b26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.060047 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5954e889e23845479415928960eb44ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.076020 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e35b460c6a457091d81b9da6ad5c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.069669 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c6c665d7f64081a51c8c1b8167b26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.083452 29123 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:28.089617 29123 tablet_bootstrap.cc:654] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.091032 28910 tablet_service.cc:1511] Processing CreateTablet for tablet bf65c49499e9410a82ebb36901c05a87 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:28.092746 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf65c49499e9410a82ebb36901c05a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.098863 29122 tablet_bootstrap.cc:492] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:28.147720 29064 tablet_service.cc:1511] Processing CreateTablet for tablet bf65c49499e9410a82ebb36901c05a87 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:28.149880 29064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf65c49499e9410a82ebb36901c05a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.087352 28839 tablet_service.cc:1511] Processing CreateTablet for tablet e7c6c665d7f64081a51c8c1b8167b26e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:28.153525 28839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c6c665d7f64081a51c8c1b8167b26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.170809 29122 tablet_bootstrap.cc:654] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:28.179889 28737 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 56100.4us
I20260709 13:11:28.182296 28986 tablet_service.cc:1511] Processing CreateTablet for tablet bf65c49499e9410a82ebb36901c05a87 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:28.183597 28986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf65c49499e9410a82ebb36901c05a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.183759 28913 tablet_service.cc:1511] Processing CreateTablet for tablet e1766cdfb35f400dbee45175e8278150 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:28.185537 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1766cdfb35f400dbee45175e8278150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.192674 28837 tablet_service.cc:1511] Processing CreateTablet for tablet e1766cdfb35f400dbee45175e8278150 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:28.193957 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1766cdfb35f400dbee45175e8278150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.197906 29121 tablet_bootstrap.cc:492] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:28.198452 29121 ts_tablet_manager.cc:1403] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.195s	user 0.014s	sys 0.008s
I20260709 13:11:28.201640 29121 raft_consensus.cc:359] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.202621 29121 raft_consensus.cc:385] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.202982 29121 raft_consensus.cc:740] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.204020 29121 consensus_queue.cc:260] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.205530 29123 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:28.205416 29058 tablet_service.cc:1511] Processing CreateTablet for tablet b1edbded562c47dcb0e8bf5320a0b28a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:28.206028 29123 ts_tablet_manager.cc:1403] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.123s	user 0.028s	sys 0.042s
I20260709 13:11:28.206751 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1edbded562c47dcb0e8bf5320a0b28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.208196 29120 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:28.208735 29120 ts_tablet_manager.cc:1403] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.233s	user 0.038s	sys 0.080s
I20260709 13:11:28.209198 29123 raft_consensus.cc:359] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.209932 29123 raft_consensus.cc:385] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.210304 29123 raft_consensus.cc:740] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.211110 29123 consensus_queue.cc:260] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.213804 29120 raft_consensus.cc:359] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:28.219681 29120 raft_consensus.cc:385] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.219182 29121 ts_tablet_manager.cc:1434] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:11:28.220669 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 32aa6e090fad4445aaffd93f96c470d6 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:28.221264 28953 heartbeater.cc:499] Master 127.21.67.254:35781 was elected leader, sending a full tablet report...
I20260709 13:11:28.221916 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32aa6e090fad4445aaffd93f96c470d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.227190 29062 tablet_service.cc:1511] Processing CreateTablet for tablet d67b0d4cd04d4ca4beaa3eb4072622a9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:28.228475 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67b0d4cd04d4ca4beaa3eb4072622a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.232761 28985 tablet_service.cc:1511] Processing CreateTablet for tablet e1766cdfb35f400dbee45175e8278150 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:28.233965 28985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1766cdfb35f400dbee45175e8278150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.240609 29121 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:28.220177 29120 raft_consensus.cc:740] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.246166 28878 heartbeater.cc:499] Master 127.21.67.254:35781 was elected leader, sending a full tablet report...
I20260709 13:11:28.246927 29123 ts_tablet_manager.cc:1434] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.009s
I20260709 13:11:28.245412 29120 consensus_queue.cc:260] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:28.248157 28838 tablet_service.cc:1511] Processing CreateTablet for tablet b1edbded562c47dcb0e8bf5320a0b28a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:28.249564 29027 heartbeater.cc:499] Master 127.21.67.254:35781 was elected leader, sending a full tablet report...
I20260709 13:11:28.251166 29122 tablet_bootstrap.cc:492] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:28.251641 29122 ts_tablet_manager.cc:1403] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.153s	user 0.003s	sys 0.009s
I20260709 13:11:28.254010 29123 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:28.254706 29122 raft_consensus.cc:359] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.258327 29121 tablet_bootstrap.cc:654] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.263770 29122 raft_consensus.cc:385] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.264163 29122 raft_consensus.cc:740] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.268466 28914 tablet_service.cc:1511] Processing CreateTablet for tablet b1edbded562c47dcb0e8bf5320a0b28a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:28.269766 28914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1edbded562c47dcb0e8bf5320a0b28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.269925 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1edbded562c47dcb0e8bf5320a0b28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.272274 29122 consensus_queue.cc:260] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.274224 28986 tablet_service.cc:1511] Processing CreateTablet for tablet 32aa6e090fad4445aaffd93f96c470d6 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:28.283706 29120 ts_tablet_manager.cc:1434] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.075s	user 0.012s	sys 0.007s
I20260709 13:11:28.283427 28836 tablet_service.cc:1511] Processing CreateTablet for tablet 32aa6e090fad4445aaffd93f96c470d6 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:28.284806 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32aa6e090fad4445aaffd93f96c470d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.285024 29120 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:28.294207 29123 tablet_bootstrap.cc:654] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.296974 28986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32aa6e090fad4445aaffd93f96c470d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.316547 29132 raft_consensus.cc:493] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.316742 29101 heartbeater.cc:499] Master 127.21.67.254:35781 was elected leader, sending a full tablet report...
W20260709 13:11:28.317529 28954 tablet.cc:2406] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:28.317235 29132 raft_consensus.cc:515] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.319881 28985 tablet_service.cc:1511] Processing CreateTablet for tablet d67b0d4cd04d4ca4beaa3eb4072622a9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:28.321022 29120 tablet_bootstrap.cc:654] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.321187 28985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67b0d4cd04d4ca4beaa3eb4072622a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.333272 29127 raft_consensus.cc:493] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.333655 28837 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9cd3f2da964526b25e30af018cd9ef (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:28.325742 28915 tablet_service.cc:1511] Processing CreateTablet for tablet d67b0d4cd04d4ca4beaa3eb4072622a9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:28.333945 29127 raft_consensus.cc:515] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.340303 29122 ts_tablet_manager.cc:1434] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.007s
I20260709 13:11:28.341480 29127 leader_election.cc:290] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:28.350121 29064 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa926f9b106492fa4f9170584cdc0d0 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:28.352779 29064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa926f9b106492fa4f9170584cdc0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.354801 29122 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:28.357311 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67b0d4cd04d4ca4beaa3eb4072622a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.338210 29132 leader_election.cc:290] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:28.365533 29121 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:28.366277 29121 ts_tablet_manager.cc:1403] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.025s
I20260709 13:11:28.367961 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9cd3f2da964526b25e30af018cd9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.370194 29121 raft_consensus.cc:359] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:28.371207 29121 raft_consensus.cc:385] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.371590 29121 raft_consensus.cc:740] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.376850 29121 consensus_queue.cc:260] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:28.379146 28836 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa926f9b106492fa4f9170584cdc0d0 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:28.380076 29121 ts_tablet_manager.cc:1434] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:11:28.396852 29121 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:28.389671 29058 tablet_service.cc:1511] Processing CreateTablet for tablet 63f1135e78c645c5abf8555c620907d9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:28.400203 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f1135e78c645c5abf8555c620907d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.403434 28839 tablet_service.cc:1511] Processing CreateTablet for tablet 12e40825a515491787d337419dfac76a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:28.385039 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 12e40825a515491787d337419dfac76a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:28.398098 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa926f9b106492fa4f9170584cdc0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.422468 28839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e40825a515491787d337419dfac76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.422685 29127 raft_consensus.cc:493] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.423353 29127 raft_consensus.cc:515] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:28.426322 29127 leader_election.cc:290] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:28.428871 28984 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9cd3f2da964526b25e30af018cd9ef (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:28.430152 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9cd3f2da964526b25e30af018cd9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.433012 28990 tablet_service.cc:1511] Processing CreateTablet for tablet 12e40825a515491787d337419dfac76a (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:28.434259 28990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e40825a515491787d337419dfac76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.441859 29121 tablet_bootstrap.cc:654] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.442245 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e40825a515491787d337419dfac76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.453825 28988 tablet_service.cc:1511] Processing CreateTablet for tablet 63f1135e78c645c5abf8555c620907d9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:28.456265 28918 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9cd3f2da964526b25e30af018cd9ef (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:28.457221 28988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f1135e78c645c5abf8555c620907d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.457468 28918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9cd3f2da964526b25e30af018cd9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.472991 29122 tablet_bootstrap.cc:654] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.485220 28912 tablet_service.cc:1511] Processing CreateTablet for tablet 63f1135e78c645c5abf8555c620907d9 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:28.485646 28913 tablet_service.cc:1511] Processing CreateTablet for tablet b8acd4f604914312a15bf2dcf21f7e21 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:28.486624 28912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f1135e78c645c5abf8555c620907d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.487645 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8acd4f604914312a15bf2dcf21f7e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.488255 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:28.489030 29076 raft_consensus.cc:2468] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:28.490535 28892 leader_election.cc:304] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:28.491406 29127 raft_consensus.cc:2804] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.491757 29127 raft_consensus.cc:493] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.492101 29127 raft_consensus.cc:3060] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.496958 28838 tablet_service.cc:1511] Processing CreateTablet for tablet b8acd4f604914312a15bf2dcf21f7e21 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:28.498250 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8acd4f604914312a15bf2dcf21f7e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.499400 29127 raft_consensus.cc:515] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.503475 29120 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:28.504074 29120 ts_tablet_manager.cc:1403] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.219s	user 0.039s	sys 0.063s
I20260709 13:11:28.507067 29120 raft_consensus.cc:359] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.507825 29120 raft_consensus.cc:385] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.516718 29120 raft_consensus.cc:740] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.516573 28914 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa926f9b106492fa4f9170584cdc0d0 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:28.517979 28914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa926f9b106492fa4f9170584cdc0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.508930 29123 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:28.518584 29123 ts_tablet_manager.cc:1403] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.265s	user 0.016s	sys 0.007s
I20260709 13:11:28.522117 28989 tablet_service.cc:1511] Processing CreateTablet for tablet b8acd4f604914312a15bf2dcf21f7e21 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:28.517656 29120 consensus_queue.cc:260] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.523418 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8acd4f604914312a15bf2dcf21f7e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.522223 29123 raft_consensus.cc:359] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:28.523909 29123 raft_consensus.cc:385] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.530253 29123 raft_consensus.cc:740] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.534801 29058 tablet_service.cc:1511] Processing CreateTablet for tablet ca028d51a9934f5f93f321e1f06fb783 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:28.531561 29123 consensus_queue.cc:260] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:28.537938 29127 leader_election.cc:290] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:28.539465 29123 ts_tablet_manager.cc:1434] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:11:28.552812 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:28.553457 29076 raft_consensus.cc:3060] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.554301 29123 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:28.557834 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca028d51a9934f5f93f321e1f06fb783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.561324 28837 tablet_service.cc:1511] Processing CreateTablet for tablet ca028d51a9934f5f93f321e1f06fb783 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:28.562639 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca028d51a9934f5f93f321e1f06fb783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.563634 29076 raft_consensus.cc:2468] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:28.568543 28912 tablet_service.cc:1511] Processing CreateTablet for tablet ca028d51a9934f5f93f321e1f06fb783 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:28.569768 28912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca028d51a9934f5f93f321e1f06fb783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.569936 29123 tablet_bootstrap.cc:654] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.570067 28892 leader_election.cc:304] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:28.571028 29127 raft_consensus.cc:2804] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.581904 29122 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:28.582435 29122 ts_tablet_manager.cc:1403] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.005s
I20260709 13:11:28.583155 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:28.584894 29042 leader_election.cc:343] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.585772 29122 raft_consensus.cc:359] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.586508 29122 raft_consensus.cc:385] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.586795 29122 raft_consensus.cc:740] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.586894 29064 tablet_service.cc:1511] Processing CreateTablet for tablet 22dcb234db264bc5be97cd38c312274b (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:28.587575 29122 consensus_queue.cc:260] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.589210 29064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dcb234db264bc5be97cd38c312274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.589721 29122 ts_tablet_manager.cc:1434] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:28.590641 29122 tablet_bootstrap.cc:492] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:28.594153 28839 tablet_service.cc:1511] Processing CreateTablet for tablet 22dcb234db264bc5be97cd38c312274b (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:28.595396 28839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dcb234db264bc5be97cd38c312274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.572440 29120 ts_tablet_manager.cc:1434] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.003s
I20260709 13:11:28.598189 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:28.598426 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:28.600832 29062 tablet_service.cc:1511] Processing CreateTablet for tablet d327b0d2f19b4bcb89a2d313b3f61582 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:28.594177 28918 tablet_service.cc:1511] Processing CreateTablet for tablet d327b0d2f19b4bcb89a2d313b3f61582 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:28.603348 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d327b0d2f19b4bcb89a2d313b3f61582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.605172 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:28.605935 29002 raft_consensus.cc:2468] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:28.607286 29120 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:28.604468 28989 tablet_service.cc:1511] Processing CreateTablet for tablet 22dcb234db264bc5be97cd38c312274b (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:28.600884 28843 tablet_service.cc:1511] Processing CreateTablet for tablet 05512d8f790140339c5f183c562dc66e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:28.611423 28843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05512d8f790140339c5f183c562dc66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.611323 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:28.610181 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:28.614193 28988 tablet_service.cc:1511] Processing CreateTablet for tablet d327b0d2f19b4bcb89a2d313b3f61582 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:28.615491 28988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d327b0d2f19b4bcb89a2d313b3f61582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.628149 28918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d327b0d2f19b4bcb89a2d313b3f61582. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:28.628648 28894 leader_election.cc:343] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.621357 28913 tablet_service.cc:1511] Processing CreateTablet for tablet 05512d8f790140339c5f183c562dc66e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:28.603485 29122 tablet_bootstrap.cc:654] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.632387 29120 tablet_bootstrap.cc:654] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.639312 29121 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:28.631773 29127 raft_consensus.cc:697] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:28.642403 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05512d8f790140339c5f183c562dc66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.643127 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dcb234db264bc5be97cd38c312274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.642968 29127 consensus_queue.cc:237] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:28.645328 28990 tablet_service.cc:1511] Processing CreateTablet for tablet 05512d8f790140339c5f183c562dc66e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:28.642644 28894 leader_election.cc:304] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:28.642552 29121 ts_tablet_manager.cc:1403] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.246s	user 0.014s	sys 0.009s
I20260709 13:11:28.646883 28990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05512d8f790140339c5f183c562dc66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.649032 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 78523bc7e80a431c8097160346435949 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:28.650353 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78523bc7e80a431c8097160346435949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.654071 29148 raft_consensus.cc:2804] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.654556 29148 raft_consensus.cc:493] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.662516 29128 raft_consensus.cc:493] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.663206 29128 raft_consensus.cc:515] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.652906 29121 raft_consensus.cc:359] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:28.671530 28837 tablet_service.cc:1511] Processing CreateTablet for tablet 78523bc7e80a431c8097160346435949 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:28.672107 29128 leader_election.cc:290] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:28.660022 29148 raft_consensus.cc:3060] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.678031 28894 leader_election.cc:343] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.679896 28914 tablet_service.cc:1511] Processing CreateTablet for tablet 78523bc7e80a431c8097160346435949 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:11:28.680271 28894 leader_election.cc:343] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.681237 28914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78523bc7e80a431c8097160346435949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.683743 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78523bc7e80a431c8097160346435949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.668686 29121 raft_consensus.cc:385] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.687846 29121 raft_consensus.cc:740] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.692107 29121 consensus_queue.cc:260] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:28.693671 28836 tablet_service.cc:1511] Processing CreateTablet for tablet 875112fc0fc4410eb1a079bb5771d060 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:28.694339 29121 ts_tablet_manager.cc:1434] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.001s
I20260709 13:11:28.694929 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875112fc0fc4410eb1a079bb5771d060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.695384 29121 tablet_bootstrap.cc:492] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:28.696151 29130 raft_consensus.cc:493] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.696611 29062 tablet_service.cc:1511] Processing CreateTablet for tablet 875112fc0fc4410eb1a079bb5771d060 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:28.696659 29130 raft_consensus.cc:515] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:28.697961 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875112fc0fc4410eb1a079bb5771d060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.717730 29130 leader_election.cc:290] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:28.720250 29123 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:28.720348 28912 tablet_service.cc:1511] Processing CreateTablet for tablet 4f85562ef38442c0b5fb6d5e97520765 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:28.722007 29123 ts_tablet_manager.cc:1403] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.007s
I20260709 13:11:28.722514 28912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f85562ef38442c0b5fb6d5e97520765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.722651 28915 tablet_service.cc:1511] Processing CreateTablet for tablet 999b5645c9a5429d89ef42071b72ff41 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:28.723955 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 999b5645c9a5429d89ef42071b72ff41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.725185 29123 raft_consensus.cc:359] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.725888 29123 raft_consensus.cc:385] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.726163 29123 raft_consensus.cc:740] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.726830 29123 consensus_queue.cc:260] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.737515 29123 ts_tablet_manager.cc:1434] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:11:28.739804 29064 tablet_service.cc:1511] Processing CreateTablet for tablet e0bb4f426f62474ea61c0ccd22e639f3 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:28.741207 29064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bb4f426f62474ea61c0ccd22e639f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.746465 28910 tablet_service.cc:1511] Processing CreateTablet for tablet e0bb4f426f62474ea61c0ccd22e639f3 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:28.747725 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bb4f426f62474ea61c0ccd22e639f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.748626 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 4f85562ef38442c0b5fb6d5e97520765 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:28.743132 29148 raft_consensus.cc:515] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:28.771386 29120 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:28.771956 29120 ts_tablet_manager.cc:1403] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.165s	user 0.017s	sys 0.002s
I20260709 13:11:28.773806 29042 leader_election.cc:304] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:28.774834 29132 raft_consensus.cc:2749] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.774957 29120 raft_consensus.cc:359] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:28.778342 29120 raft_consensus.cc:385] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.780759 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f85562ef38442c0b5fb6d5e97520765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.782523 29123 tablet_bootstrap.cc:492] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:28.782743 29120 raft_consensus.cc:740] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.791307 29058 tablet_service.cc:1511] Processing CreateTablet for tablet 8071ad308999465eb78a22785db01b62 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:28.808007 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:28.809019 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8071ad308999465eb78a22785db01b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.809651 28986 tablet_service.cc:1511] Processing CreateTablet for tablet 999b5645c9a5429d89ef42071b72ff41 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:28.799113 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:28.810648 29002 raft_consensus.cc:3060] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.810878 28986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 999b5645c9a5429d89ef42071b72ff41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.816021 29002 raft_consensus.cc:2468] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:28.817296 28894 leader_election.cc:304] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:28.818143 29127 raft_consensus.cc:2804] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.818627 29127 raft_consensus.cc:697] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:28.819414 29127 consensus_queue.cc:237] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:28.819921 29120 consensus_queue.cc:260] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:28.822099 29120 ts_tablet_manager.cc:1434] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 13:11:28.822255 29121 tablet_bootstrap.cc:654] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.823097 29120 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:28.799600 29148 leader_election.cc:290] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:28.803846 28749 catalog_manager.cc:5697] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.823268 28992 tablet_service.cc:1511] Processing CreateTablet for tablet d383bc02730e4f5fba0c090fd15c5977 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:28.824512 28992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d383bc02730e4f5fba0c090fd15c5977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.805009 28915 tablet_service.cc:1511] Processing CreateTablet for tablet d383bc02730e4f5fba0c090fd15c5977 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:28.805436 28989 tablet_service.cc:1511] Processing CreateTablet for tablet 875112fc0fc4410eb1a079bb5771d060 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:28.805788 29128 raft_consensus.cc:493] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.806613 28984 tablet_service.cc:1511] Processing CreateTablet for tablet 4f85562ef38442c0b5fb6d5e97520765 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:28.806934 28985 tablet_service.cc:1511] Processing CreateTablet for tablet 8071ad308999465eb78a22785db01b62 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:28.834511 29128 raft_consensus.cc:515] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.841270 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d383bc02730e4f5fba0c090fd15c5977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.841758 29128 leader_election.cc:290] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:28.835711 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875112fc0fc4410eb1a079bb5771d060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.843968 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f85562ef38442c0b5fb6d5e97520765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.845762 28985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8071ad308999465eb78a22785db01b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.836083 28843 tablet_service.cc:1511] Processing CreateTablet for tablet e0bb4f426f62474ea61c0ccd22e639f3 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:28.848515 28843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bb4f426f62474ea61c0ccd22e639f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.837604 28839 tablet_service.cc:1511] Processing CreateTablet for tablet 8071ad308999465eb78a22785db01b62 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:28.852617 28839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8071ad308999465eb78a22785db01b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.853715 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3bfc02d2a4c048cdf83ee4991fa10" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:28.853932 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:28.855830 29130 raft_consensus.cc:493] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.837976 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:28.837637 28837 tablet_service.cc:1511] Processing CreateTablet for tablet 999b5645c9a5429d89ef42071b72ff41 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:28.860426 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 999b5645c9a5429d89ef42071b72ff41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.838892 28852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
W20260709 13:11:28.861439 28816 leader_election.cc:343] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.856479 29130 raft_consensus.cc:515] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:28.861847 28910 tablet_service.cc:1511] Processing CreateTablet for tablet baf6422e395e4363ba3daf68501ad7b3 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:28.862459 28838 tablet_service.cc:1511] Processing CreateTablet for tablet baf6422e395e4363ba3daf68501ad7b3 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:28.863142 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf6422e395e4363ba3daf68501ad7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.863683 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf6422e395e4363ba3daf68501ad7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.863767 29130 leader_election.cc:290] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
W20260709 13:11:28.864521 28894 leader_election.cc:343] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:28.859200 28968 leader_election.cc:343] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.873979 29120 tablet_bootstrap.cc:654] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.877852 29123 tablet_bootstrap.cc:654] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.881389 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:28.882373 29063 tablet_service.cc:1511] Processing CreateTablet for tablet ea8542c2d49442dd8176393fb85f499e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:11:28.883311 28818 leader_election.cc:343] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.883682 29063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8542c2d49442dd8176393fb85f499e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.883810 28818 leader_election.cc:304] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:28.884698 29130 raft_consensus.cc:2749] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.885141 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
W20260709 13:11:28.887156 28818 leader_election.cc:343] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.908604 29057 tablet_service.cc:1511] Processing CreateTablet for tablet d383bc02730e4f5fba0c090fd15c5977 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:28.909981 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d383bc02730e4f5fba0c090fd15c5977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.912569 29066 tablet_service.cc:1511] Processing CreateTablet for tablet eb4e8cf7700c469ab85e6216b8225789 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:28.913913 29066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4e8cf7700c469ab85e6216b8225789. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:28.923007 28966 leader_election.cc:343] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:28.923787 28968 leader_election.cc:343] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:28.923785 28966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 89354.8us
I20260709 13:11:28.925467 28836 tablet_service.cc:1511] Processing CreateTablet for tablet ea8542c2d49442dd8176393fb85f499e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:28.925979 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3bfc02d2a4c048cdf83ee4991fa10" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:28.926693 29076 raft_consensus.cc:2468] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:28.926811 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8542c2d49442dd8176393fb85f499e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.926772 28968 leader_election.cc:304] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:28.927891 28841 tablet_service.cc:1511] Processing CreateTablet for tablet eb4e8cf7700c469ab85e6216b8225789 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:11:28.928186 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 62414.8us
I20260709 13:11:28.929260 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4e8cf7700c469ab85e6216b8225789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.927891 29128 raft_consensus.cc:2749] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.932307 28985 tablet_service.cc:1511] Processing CreateTablet for tablet eb4e8cf7700c469ab85e6216b8225789 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:28.933595 28985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4e8cf7700c469ab85e6216b8225789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.930954 28989 tablet_service.cc:1511] Processing CreateTablet for tablet baf6422e395e4363ba3daf68501ad7b3 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:28.935472 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf6422e395e4363ba3daf68501ad7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.937317 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:28.938023 28912 tablet_service.cc:1511] Processing CreateTablet for tablet fed5593d39e541d6b2eb401c3bc41f9c (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:11:28.940621 28818 leader_election.cc:343] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.941166 28912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed5593d39e541d6b2eb401c3bc41f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.941093 28818 leader_election.cc:304] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:28.942204 29130 raft_consensus.cc:2749] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.952953 28918 tablet_service.cc:1511] Processing CreateTablet for tablet ea8542c2d49442dd8176393fb85f499e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:28.929078 28966 leader_election.cc:304] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:28.957690 29060 tablet_service.cc:1511] Processing CreateTablet for tablet fed5593d39e541d6b2eb401c3bc41f9c (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:28.962522 29060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed5593d39e541d6b2eb401c3bc41f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.974825 29128 raft_consensus.cc:2804] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.976727 29128 raft_consensus.cc:493] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.977029 28913 tablet_service.cc:1511] Processing CreateTablet for tablet 635cf54d22ac4cdabf0f6db66801dbfc (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:28.977623 28835 tablet_service.cc:1511] Processing CreateTablet for tablet 635cf54d22ac4cdabf0f6db66801dbfc (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:28.978385 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635cf54d22ac4cdabf0f6db66801dbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.978932 28835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635cf54d22ac4cdabf0f6db66801dbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.977126 29128 raft_consensus.cc:3060] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.997864 29123 tablet_bootstrap.cc:492] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:28.998672 29123 ts_tablet_manager.cc:1403] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.222s	user 0.020s	sys 0.003s
I20260709 13:11:29.004047 28918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8542c2d49442dd8176393fb85f499e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.006876 29123 raft_consensus.cc:359] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.007746 29123 raft_consensus.cc:385] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.008119 29123 raft_consensus.cc:740] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.008882 29123 consensus_queue.cc:260] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.018361 29060 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4e7fd2f04240aa908640daf9fc53df (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:29.020117 29060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4e7fd2f04240aa908640daf9fc53df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:29.013876 28966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 84895.6us
I20260709 13:11:29.024721 28836 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4e7fd2f04240aa908640daf9fc53df (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:29.025732 28915 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4e7fd2f04240aa908640daf9fc53df (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:29.027796 28986 tablet_service.cc:1511] Processing CreateTablet for tablet fed5593d39e541d6b2eb401c3bc41f9c (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:29.028919 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4e7fd2f04240aa908640daf9fc53df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.029501 28986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed5593d39e541d6b2eb401c3bc41f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.029503 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4e7fd2f04240aa908640daf9fc53df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.043277 28992 tablet_service.cc:1511] Processing CreateTablet for tablet 635cf54d22ac4cdabf0f6db66801dbfc (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:29.044523 28992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635cf54d22ac4cdabf0f6db66801dbfc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:29.047968 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:29.049082 29121 tablet_bootstrap.cc:492] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:29.049412 29120 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:29.049597 29121 ts_tablet_manager.cc:1403] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.354s	user 0.014s	sys 0.015s
I20260709 13:11:29.049932 29120 ts_tablet_manager.cc:1403] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.227s	user 0.012s	sys 0.005s
I20260709 13:11:29.050549 28841 tablet_service.cc:1511] Processing CreateTablet for tablet 4571f43feac9476eac9fa165998239fa (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:29.051802 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571f43feac9476eac9fa165998239fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.052983 29120 raft_consensus.cc:359] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.053654 29121 raft_consensus.cc:359] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.054373 29121 raft_consensus.cc:385] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.054637 29121 raft_consensus.cc:740] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.037336 29063 tablet_service.cc:1511] Processing CreateTablet for tablet 4571f43feac9476eac9fa165998239fa (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:29.055593 29121 consensus_queue.cc:260] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.056495 29063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571f43feac9476eac9fa165998239fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.053690 29120 raft_consensus.cc:385] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.060209 29120 raft_consensus.cc:740] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.067229 28912 tablet_service.cc:1511] Processing CreateTablet for tablet 72f5cdde3e8541db925706bec3e9bdfe (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:29.068512 28912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f5cdde3e8541db925706bec3e9bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.069608 29123 ts_tablet_manager.cc:1434] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.014s
I20260709 13:11:29.069173 29120 consensus_queue.cc:260] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.075996 28988 tablet_service.cc:1511] Processing CreateTablet for tablet 4571f43feac9476eac9fa165998239fa (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:29.076395 28990 tablet_service.cc:1511] Processing CreateTablet for tablet 72f5cdde3e8541db925706bec3e9bdfe (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:29.077288 28988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571f43feac9476eac9fa165998239fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.077942 28990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f5cdde3e8541db925706bec3e9bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.086227 29121 ts_tablet_manager.cc:1434] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:11:29.087299 29121 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:29.096361 29062 tablet_service.cc:1511] Processing CreateTablet for tablet 72f5cdde3e8541db925706bec3e9bdfe (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:29.056490 29128 raft_consensus.cc:515] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.099858 28852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3bfc02d2a4c048cdf83ee4991fa10" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
W20260709 13:11:29.101248 28968 leader_election.cc:343] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.108908 29120 ts_tablet_manager.cc:1434] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.059s	user 0.002s	sys 0.007s
I20260709 13:11:29.109293 29128 leader_election.cc:290] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:29.113041 29123 tablet_bootstrap.cc:492] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:29.113675 28838 tablet_service.cc:1511] Processing CreateTablet for tablet f5265c21310c410993aea23cd9588704 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:29.115969 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3bfc02d2a4c048cdf83ee4991fa10" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:29.116773 29076 raft_consensus.cc:3060] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.117023 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5265c21310c410993aea23cd9588704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.120205 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f5cdde3e8541db925706bec3e9bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.121256 29120 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:29.128644 28913 tablet_service.cc:1511] Processing CreateTablet for tablet f5265c21310c410993aea23cd9588704 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:29.129885 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5265c21310c410993aea23cd9588704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.123283 28984 tablet_service.cc:1511] Processing CreateTablet for tablet f5265c21310c410993aea23cd9588704 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:29.132078 29076 raft_consensus.cc:2468] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:29.115938 29122 tablet_bootstrap.cc:492] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:29.133809 29122 ts_tablet_manager.cc:1403] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.543s	user 0.018s	sys 0.024s
I20260709 13:11:29.134220 28966 leader_election.cc:304] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:29.133875 29123 tablet_bootstrap.cc:654] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.137022 29122 raft_consensus.cc:359] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.137919 29122 raft_consensus.cc:385] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.138248 29122 raft_consensus.cc:740] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.139942 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5265c21310c410993aea23cd9588704. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:29.149166 28894 consensus_peers.cc:597] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:29.156019 29058 tablet_service.cc:1511] Processing CreateTablet for tablet b65a86245d1042e3b9c4cbea4a2aa661 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:29.157415 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65a86245d1042e3b9c4cbea4a2aa661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.158452 29127 raft_consensus.cc:493] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.158932 29127 raft_consensus.cc:515] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.161135 29127 leader_election.cc:290] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:29.163120 28852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b93b33daae4eadbaab3085ddf2e1da" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:29.164335 28852 raft_consensus.cc:2468] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:29.165199 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b93b33daae4eadbaab3085ddf2e1da" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:29.165693 28894 leader_election.cc:304] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
W20260709 13:11:29.166725 28892 leader_election.cc:343] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.168282 29127 raft_consensus.cc:2804] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:29.168744 29127 raft_consensus.cc:493] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.172860 29127 raft_consensus.cc:3060] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.139087 29122 consensus_queue.cc:260] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.179767 29128 raft_consensus.cc:2804] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:29.183915 29128 raft_consensus.cc:697] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:29.182623 29127 raft_consensus.cc:515] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.181548 29122 ts_tablet_manager.cc:1434] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:11:29.184942 29130 raft_consensus.cc:493] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.186872 29130 raft_consensus.cc:515] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.189015 29130 leader_election.cc:290] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:29.190526 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8550ef17e8a41acbcdfe5eab4042fc2" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:29.197489 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8550ef17e8a41acbcdfe5eab4042fc2" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:29.197750 28818 leader_election.cc:343] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.185097 29121 tablet_bootstrap.cc:654] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:29.200985 28816 leader_election.cc:343] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.201570 28816 leader_election.cc:304] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:29.202373 29127 leader_election.cc:290] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:29.202467 29130 raft_consensus.cc:2749] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:29.202101 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b93b33daae4eadbaab3085ddf2e1da" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:29.203532 28852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b93b33daae4eadbaab3085ddf2e1da" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
W20260709 13:11:29.204492 28892 leader_election.cc:343] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.204505 28852 raft_consensus.cc:3060] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.208806 28838 tablet_service.cc:1511] Processing CreateTablet for tablet b65a86245d1042e3b9c4cbea4a2aa661 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:29.210052 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65a86245d1042e3b9c4cbea4a2aa661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.219362 28913 tablet_service.cc:1511] Processing CreateTablet for tablet b65a86245d1042e3b9c4cbea4a2aa661 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:29.219810 29164 raft_consensus.cc:493] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.220808 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65a86245d1042e3b9c4cbea4a2aa661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.220916 28852 raft_consensus.cc:2468] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:29.220557 29164 raft_consensus.cc:515] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.221953 28894 leader_election.cc:304] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:29.228128 29164 leader_election.cc:290] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:29.236048 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d34c5f0983b472d988e26619d914252" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:29.241176 29120 tablet_bootstrap.cc:654] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.245390 29148 raft_consensus.cc:2804] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:29.243018 29122 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:29.260890 29128 consensus_queue.cc:237] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:29.265789 28966 leader_election.cc:343] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.254303 29127 consensus_queue.cc:1048] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:11:29.279500 29148 raft_consensus.cc:697] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:29.289688 29123 tablet_bootstrap.cc:492] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:29.290167 29123 ts_tablet_manager.cc:1403] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.210s	user 0.013s	sys 0.013s
I20260709 13:11:29.292475 29123 raft_consensus.cc:359] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.293002 29123 raft_consensus.cc:385] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.293256 29123 raft_consensus.cc:740] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.293896 29123 consensus_queue.cc:260] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.295749 29123 ts_tablet_manager.cc:1434] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
I20260709 13:11:29.308130 29123 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:29.311753 29148 consensus_queue.cc:237] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.316684 29122 tablet_bootstrap.cc:654] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.320356 29123 tablet_bootstrap.cc:654] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.340042 29121 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:29.340596 29121 ts_tablet_manager.cc:1403] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.253s	user 0.015s	sys 0.005s
I20260709 13:11:29.354374 29121 raft_consensus.cc:359] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.355374 29121 raft_consensus.cc:385] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.355793 29121 raft_consensus.cc:740] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.356724 29121 consensus_queue.cc:260] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.358124 29120 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:29.358803 29120 ts_tablet_manager.cc:1403] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.008s
I20260709 13:11:29.366595 29121 ts_tablet_manager.cc:1434] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:11:29.369549 29121 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:29.369216 29120 raft_consensus.cc:359] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.370041 29120 raft_consensus.cc:385] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.370388 29123 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:29.370450 29120 raft_consensus.cc:740] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.371167 29123 ts_tablet_manager.cc:1403] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.031s
I20260709 13:11:29.371562 29120 consensus_queue.cc:260] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.374173 29120 ts_tablet_manager.cc:1434] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:29.374224 29123 raft_consensus.cc:359] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.375041 29123 raft_consensus.cc:385] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.375344 29120 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:29.375334 29123 raft_consensus.cc:740] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.376288 29123 consensus_queue.cc:260] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.377907 29121 tablet_bootstrap.cc:654] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.378892 29123 ts_tablet_manager.cc:1434] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:11:29.379998 29123 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:29.383241 29120 tablet_bootstrap.cc:654] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.386009 29148 raft_consensus.cc:493] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.386355 29123 tablet_bootstrap.cc:654] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.386515 29148 raft_consensus.cc:515] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.389248 29148 leader_election.cc:290] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:29.392486 29121 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:29.392535 29120 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:29.393273 29120 ts_tablet_manager.cc:1403] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:11:29.393247 29121 ts_tablet_manager.cc:1403] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 13:11:29.396593 29120 raft_consensus.cc:359] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.398077 29122 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:29.398635 29122 ts_tablet_manager.cc:1403] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.025s
I20260709 13:11:29.398912 29120 raft_consensus.cc:385] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.399463 29120 raft_consensus.cc:740] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.400218 29120 consensus_queue.cc:260] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.398404 29121 raft_consensus.cc:359] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.401257 29121 raft_consensus.cc:385] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.401595 29121 raft_consensus.cc:740] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.401710 29122 raft_consensus.cc:359] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.402472 29122 raft_consensus.cc:385] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.402918 29122 raft_consensus.cc:740] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.403855 29122 consensus_queue.cc:260] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.402416 29121 consensus_queue.cc:260] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.406102 29122 ts_tablet_manager.cc:1434] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:29.407344 29121 ts_tablet_manager.cc:1434] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:11:29.408346 29122 tablet_bootstrap.cc:492] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:29.406575 29120 ts_tablet_manager.cc:1434] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:29.408346 29121 tablet_bootstrap.cc:492] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:29.410737 29123 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:29.415608 29123 ts_tablet_manager.cc:1403] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.010s
I20260709 13:11:29.418901 29123 raft_consensus.cc:359] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.430514 29123 raft_consensus.cc:385] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.430891 29123 raft_consensus.cc:740] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.431849 29123 consensus_queue.cc:260] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.428349 29120 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:29.435691 29122 tablet_bootstrap.cc:654] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.440613 29120 tablet_bootstrap.cc:654] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.445245 29123 ts_tablet_manager.cc:1434] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:11:29.446311 29123 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:29.453333 29123 tablet_bootstrap.cc:654] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.460668 29121 tablet_bootstrap.cc:654] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.463311 29123 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:29.464851 29123 ts_tablet_manager.cc:1403] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:11:29.466456 29120 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:29.466969 29120 ts_tablet_manager.cc:1403] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.005s
I20260709 13:11:29.467360 29122 tablet_bootstrap.cc:492] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:29.467897 29122 ts_tablet_manager.cc:1403] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.007s
I20260709 13:11:29.467962 29123 raft_consensus.cc:359] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.468798 29123 raft_consensus.cc:385] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.468891 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73566428eabe4cb9aa1cb835c62e071e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:29.469130 29123 raft_consensus.cc:740] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.469599 29076 raft_consensus.cc:2468] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:29.469939 29120 raft_consensus.cc:359] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.469997 29123 consensus_queue.cc:260] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.470808 29120 raft_consensus.cc:385] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.471098 29122 raft_consensus.cc:359] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.471474 29120 raft_consensus.cc:740] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.471985 29122 raft_consensus.cc:385] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.472400 29122 raft_consensus.cc:740] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.473672 28892 leader_election.cc:304] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:29.472534 29120 consensus_queue.cc:260] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.475304 29150 raft_consensus.cc:2804] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:29.475848 29150 raft_consensus.cc:493] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.476052 29120 ts_tablet_manager.cc:1434] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:11:29.476286 29150 raft_consensus.cc:3060] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.477258 29120 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:29.479872 29148 consensus_queue.cc:1048] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:29.473286 29122 consensus_queue.cc:260] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.485564 29122 ts_tablet_manager.cc:1434] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:11:29.486552 29122 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:29.490625 29150 raft_consensus.cc:515] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.472527 29123 ts_tablet_manager.cc:1434] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:11:29.492542 29123 tablet_bootstrap.cc:492] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:29.493136 29122 tablet_bootstrap.cc:654] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.496145 29120 tablet_bootstrap.cc:654] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.501096 29123 tablet_bootstrap.cc:654] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.503191 29150 leader_election.cc:290] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:29.503883 29121 tablet_bootstrap.cc:492] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:29.505925 29121 ts_tablet_manager.cc:1403] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.019s
I20260709 13:11:29.512820 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73566428eabe4cb9aa1cb835c62e071e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:29.513506 29076 raft_consensus.cc:3060] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.528551 29122 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:29.529080 29122 ts_tablet_manager.cc:1403] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.010s
I20260709 13:11:29.546435 29076 raft_consensus.cc:2468] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:29.546756 29120 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:29.547480 29120 ts_tablet_manager.cc:1403] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.004s
I20260709 13:11:29.547924 28892 leader_election.cc:304] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:29.548987 29150 raft_consensus.cc:2804] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:29.549467 29150 raft_consensus.cc:697] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:29.550225 29150 consensus_queue.cc:237] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.550797 29120 raft_consensus.cc:359] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.551457 29120 raft_consensus.cc:385] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.552086 29120 raft_consensus.cc:740] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.551959 29128 raft_consensus.cc:493] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.552981 29120 consensus_queue.cc:260] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.553397 29128 raft_consensus.cc:515] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.554514 29120 ts_tablet_manager.cc:1434] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:11:29.555985 29120 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:29.561249 29128 leader_election.cc:290] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:29.561825 29120 tablet_bootstrap.cc:654] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.563231 29121 raft_consensus.cc:359] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.563993 29121 raft_consensus.cc:385] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.564320 29121 raft_consensus.cc:740] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.565296 29121 consensus_queue.cc:260] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.556826 29122 raft_consensus.cc:359] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.567919 29122 raft_consensus.cc:385] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.568351 29122 raft_consensus.cc:740] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.570508 29121 ts_tablet_manager.cc:1434] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 13:11:29.571900 29121 tablet_bootstrap.cc:492] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:29.572255 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73566428eabe4cb9aa1cb835c62e071e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:29.573042 29000 raft_consensus.cc:3060] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.576042 29122 consensus_queue.cc:260] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.579003 29122 ts_tablet_manager.cc:1434] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:11:29.580314 29122 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:29.591893 29121 tablet_bootstrap.cc:654] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.596673 29122 tablet_bootstrap.cc:654] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.601462 29120 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:29.601384 29062 tablet_service.cc:1511] Processing CreateTablet for tablet 095c41dda35e41798dda1b4bdca1e55e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:29.602239 29120 ts_tablet_manager.cc:1403] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.016s
I20260709 13:11:29.603192 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095c41dda35e41798dda1b4bdca1e55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.607434 29121 tablet_bootstrap.cc:492] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:29.608058 29121 ts_tablet_manager.cc:1403] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.007s
I20260709 13:11:29.611771 29121 raft_consensus.cc:359] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.612663 29121 raft_consensus.cc:385] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.613005 29121 raft_consensus.cc:740] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.613865 29121 consensus_queue.cc:260] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.615598 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d34c5f0983b472d988e26619d914252" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:29.616460 29121 ts_tablet_manager.cc:1434] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:29.616416 28928 raft_consensus.cc:2468] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:29.617785 29121 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:29.620520 29120 raft_consensus.cc:359] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.621217 29150 raft_consensus.cc:493] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.621416 29120 raft_consensus.cc:385] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.621850 29120 raft_consensus.cc:740] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.621793 29150 raft_consensus.cc:515] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.622840 29120 consensus_queue.cc:260] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.624058 29150 leader_election.cc:290] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:29.625432 29120 ts_tablet_manager.cc:1434] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:11:29.626267 29122 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:29.626155 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:29.626753 29122 ts_tablet_manager.cc:1403] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.016s
W20260709 13:11:29.628325 28892 leader_election.cc:343] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.629673 29122 raft_consensus.cc:359] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.630028 28852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5954e889e23845479415928960eb44ab" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:29.630378 29122 raft_consensus.cc:385] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.630720 29122 raft_consensus.cc:740] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.631193 29121 tablet_bootstrap.cc:654] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.631400 28853 raft_consensus.cc:3060] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.626312 29120 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:29.631717 29122 consensus_queue.cc:260] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.633163 28999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:29.634171 29122 ts_tablet_manager.cc:1434] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
W20260709 13:11:29.634656 28894 leader_election.cc:343] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.635197 29122 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:29.635113 28894 leader_election.cc:304] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:29.637112 29167 raft_consensus.cc:2749] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:29.638953 29120 tablet_bootstrap.cc:654] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.640195 28841 tablet_service.cc:1511] Processing CreateTablet for tablet 095c41dda35e41798dda1b4bdca1e55e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:29.641487 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095c41dda35e41798dda1b4bdca1e55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.647997 29120 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:29.648588 29120 ts_tablet_manager.cc:1403] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 13:11:29.651259 28984 tablet_service.cc:1511] Processing CreateTablet for tablet 095c41dda35e41798dda1b4bdca1e55e (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:29.651925 29120 raft_consensus.cc:359] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.652866 29120 raft_consensus.cc:385] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.653226 29120 raft_consensus.cc:740] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.654137 29120 consensus_queue.cc:260] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.656764 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73566428eabe4cb9aa1cb835c62e071e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:29.657418 29121 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:29.658013 29121 ts_tablet_manager.cc:1403] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 13:11:29.660229 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5954e889e23845479415928960eb44ab" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:29.661487 29121 raft_consensus.cc:359] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.662456 29121 raft_consensus.cc:385] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.662798 29121 raft_consensus.cc:740] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.663990 29121 consensus_queue.cc:260] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.666915 29120 ts_tablet_manager.cc:1434] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:11:29.667305 28968 leader_election.cc:304] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:29.668361 29128 raft_consensus.cc:2804] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:29.668740 29128 raft_consensus.cc:493] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:29.668794 28968 leader_election.cc:343] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.669201 29128 raft_consensus.cc:3060] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.630698 28852 raft_consensus.cc:2468] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:29.671056 29121 ts_tablet_manager.cc:1434] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:11:29.672055 29121 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:29.676520 29120 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:29.676506 29128 raft_consensus.cc:515] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.679788 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d34c5f0983b472d988e26619d914252" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:29.680408 29075 raft_consensus.cc:3060] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.699493 28968 leader_election.cc:304] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:29.701081 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d34c5f0983b472d988e26619d914252" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:29.716130 28927 raft_consensus.cc:3060] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.652890 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095c41dda35e41798dda1b4bdca1e55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.729708 29000 raft_consensus.cc:2468] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:29.707086 29075 raft_consensus.cc:2468] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:29.710028 29122 tablet_bootstrap.cc:654] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.710150 28915 tablet_service.cc:1511] Processing CreateTablet for tablet ab59da765c8447b186cb5d144d71bab8 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:29.748418 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab59da765c8447b186cb5d144d71bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.751680 29164 raft_consensus.cc:2804] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:29.752135 29164 raft_consensus.cc:493] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.752491 29164 raft_consensus.cc:3060] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.756633 29127 consensus_queue.cc:1048] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:29.765136 29128 leader_election.cc:290] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:29.766835 29127 consensus_queue.cc:1048] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.774832 29122 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:29.775781 29122 ts_tablet_manager.cc:1403] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.141s	user 0.023s	sys 0.037s
I20260709 13:11:29.775892 28966 leader_election.cc:304] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:29.755299 29197 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.782354 29121 tablet_bootstrap.cc:654] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.783176 29128 raft_consensus.cc:2804] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:29.777602 28927 raft_consensus.cc:2468] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:29.784303 29128 raft_consensus.cc:697] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:29.785202 29128 consensus_queue.cc:237] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.787379 28851 raft_consensus.cc:3060] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.800444 29132 raft_consensus.cc:493] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.800992 29132 raft_consensus.cc:515] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.802407 29122 raft_consensus.cc:359] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.803297 29122 raft_consensus.cc:385] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.785719 29164 raft_consensus.cc:515] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.803601 29122 raft_consensus.cc:740] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.783911 29197 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.817713 29122 consensus_queue.cc:260] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.836292 29164 leader_election.cc:290] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:29.838866 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5954e889e23845479415928960eb44ab" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:29.839900 29128 consensus_queue.cc:1048] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:29.840708 28968 leader_election.cc:343] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.840919 29198 consensus_queue.cc:1048] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:29.851363 29203 raft_consensus.cc:493] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.855604 29200 raft_consensus.cc:493] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.846024 29132 leader_election.cc:290] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:29.856427 29200 raft_consensus.cc:515] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.866966 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5954e889e23845479415928960eb44ab" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:29.863268 29203 raft_consensus.cc:515] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.886272 29121 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:29.886781 29121 ts_tablet_manager.cc:1403] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.012s
I20260709 13:11:29.887179 28851 raft_consensus.cc:3060] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.893985 29121 raft_consensus.cc:359] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.894670 29121 raft_consensus.cc:385] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.894915 29121 raft_consensus.cc:740] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.895574 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b93b33daae4eadbaab3085ddf2e1da" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:29.897197 29074 raft_consensus.cc:3060] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.895632 29121 consensus_queue.cc:260] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.903730 29121 ts_tablet_manager.cc:1434] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:11:29.904884 29121 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:29.889055 29132 raft_consensus.cc:493] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.917012 28851 raft_consensus.cc:2468] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:29.917444 29123 tablet_bootstrap.cc:492] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:29.917886 29123 ts_tablet_manager.cc:1403] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.426s	user 0.027s	sys 0.010s
I20260709 13:11:29.918506 28968 leader_election.cc:304] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:29.919756 29121 tablet_bootstrap.cc:654] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.908826 29132 raft_consensus.cc:515] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.912827 29164 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.929220 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:29.930089 29000 raft_consensus.cc:2468] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:29.932825 29042 leader_election.cc:304] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:29.933296 29200 leader_election.cc:290] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:29.933988 29211 raft_consensus.cc:2804] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:29.934391 29211 raft_consensus.cc:493] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.934773 29211 raft_consensus.cc:3060] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.919648 29198 raft_consensus.cc:2804] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:29.929759 29164 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.936479 29120 tablet_bootstrap.cc:700] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Time spent opening tablet: real 0.254s	user 0.000s	sys 0.004s
I20260709 13:11:29.935598 29198 raft_consensus.cc:697] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:29.943374 29120 tablet_bootstrap.cc:654] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.936870 29132 leader_election.cc:290] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:29.947674 29123 raft_consensus.cc:359] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:29.948719 29123 raft_consensus.cc:385] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.948999 29123 raft_consensus.cc:740] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.948469 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:29.955570 29210 raft_consensus.cc:493] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.956276 29206 log.cc:927] Time spent T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Append to log took a long time: real 0.094s	user 0.004s	sys 0.000s
I20260709 13:11:29.952199 29204 raft_consensus.cc:493] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.968271 29164 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:29.968106 29204 raft_consensus.cc:515] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:29.948529 29197 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:29.950799 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:29.968722 29062 tablet_service.cc:1511] Processing CreateTablet for tablet ab59da765c8447b186cb5d144d71bab8 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:29.969381 29000 raft_consensus.cc:2468] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:29.969981 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab59da765c8447b186cb5d144d71bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.970397 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:29.970721 28818 leader_election.cc:304] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:29.972208 29197 raft_consensus.cc:2804] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:29.972398 28966 leader_election.cc:343] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:29.954488 28750 catalog_manager.cc:5697] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.960870 29198 consensus_queue.cc:237] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.964699 29210 raft_consensus.cc:515] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.976243 29148 raft_consensus.cc:493] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.975508 28749 catalog_manager.cc:5697] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.976766 29148 raft_consensus.cc:515] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.978163 29210 leader_election.cc:290] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:29.978945 29148 leader_election.cc:290] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:29.966468 28989 tablet_service.cc:1511] Processing CreateTablet for tablet ab59da765c8447b186cb5d144d71bab8 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:29.980515 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8550ef17e8a41acbcdfe5eab4042fc2" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:29.980842 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab59da765c8447b186cb5d144d71bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:29.981158 28927 raft_consensus.cc:2468] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:29.983139 29042 leader_election.cc:304] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:29.960302 29127 raft_consensus.cc:493] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.983960 29127 raft_consensus.cc:515] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:29.984627 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:29.985291 29076 raft_consensus.cc:2468] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:29.986447 29210 raft_consensus.cc:2804] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:29.987097 29210 raft_consensus.cc:493] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.978396 28749 catalog_manager.cc:5697] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.986498 29127 leader_election.cc:290] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:29.948853 29130 raft_consensus.cc:493] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:11:29.987857 28892 leader_election.cc:304] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:29.988195 29130 raft_consensus.cc:515] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:29.972604 29197 raft_consensus.cc:493] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.990001 29197 raft_consensus.cc:3060] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.993522 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:29.994230 29130 leader_election.cc:290] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:29.987524 29210 raft_consensus.cc:3060] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.962004 29123 consensus_queue.cc:260] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:30.002316 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:30.003348 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:29.990796 28749 catalog_manager.cc:5697] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:30.004671 28968 leader_election.cc:343] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.003890 29204 leader_election.cc:290] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.008323 28818 leader_election.cc:304] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:30.009502 28915 tablet_service.cc:1511] Processing CreateTablet for tablet 70244d272ca8458a91edd4e2388bcbe0 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:30.009869 29130 raft_consensus.cc:2749] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:30.009541 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:30.011682 28892 leader_election.cc:343] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.012180 28986 tablet_service.cc:1511] Processing CreateTablet for tablet 70244d272ca8458a91edd4e2388bcbe0 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:30.012887 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70244d272ca8458a91edd4e2388bcbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.013582 28986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70244d272ca8458a91edd4e2388bcbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.014537 29127 raft_consensus.cc:2804] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.014951 29127 raft_consensus.cc:493] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.015295 29127 raft_consensus.cc:3060] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.015372 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:30.023491 29148 consensus_queue.cc:1048] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:30.025974 29203 leader_election.cc:290] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:30.027484 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:29.967571 29211 raft_consensus.cc:515] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.026207 28841 tablet_service.cc:1511] Processing CreateTablet for tablet 70244d272ca8458a91edd4e2388bcbe0 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:30.029121 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70244d272ca8458a91edd4e2388bcbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.033540 29122 ts_tablet_manager.cc:1434] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.254s	user 0.025s	sys 0.026s
I20260709 13:11:30.034014 29121 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:30.034472 29122 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:30.035540 29123 ts_tablet_manager.cc:1434] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.002s
I20260709 13:11:30.036305 29123 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:30.034466 29121 ts_tablet_manager.cc:1403] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.004s
I20260709 13:11:30.001612 29002 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:30.037148 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:30.040205 29148 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.042999 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.043640 28850 raft_consensus.cc:2468] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:30.043159 29060 tablet_service.cc:1511] Processing CreateTablet for tablet abe7b1ea920e462e8b046d5d41f6bd8c (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:30.033190 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:30.044622 29000 raft_consensus.cc:3060] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.045034 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.045651 28850 raft_consensus.cc:2468] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:30.046923 29122 tablet_bootstrap.cc:654] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.046705 28913 tablet_service.cc:1511] Processing CreateTablet for tablet abe7b1ea920e462e8b046d5d41f6bd8c (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:30.047962 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe7b1ea920e462e8b046d5d41f6bd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.050364 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.050967 28850 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:30.051752 29148 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
W20260709 13:11:30.052654 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:30.052990 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.053604 28850 raft_consensus.cc:2468] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:30.055719 28894 leader_election.cc:304] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:30.057027 29167 raft_consensus.cc:2804] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.057411 29167 raft_consensus.cc:493] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.057761 29167 raft_consensus.cc:3060] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.058050 29197 raft_consensus.cc:515] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.060608 28968 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:30.060724 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
W20260709 13:11:30.061003 28816 leader_election.cc:343] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.062987 29204 raft_consensus.cc:2804] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.062891 28838 tablet_service.cc:1511] Processing CreateTablet for tablet abe7b1ea920e462e8b046d5d41f6bd8c (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:30.063432 29204 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.063829 29204 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.064136 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe7b1ea920e462e8b046d5d41f6bd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.068085 28968 leader_election.cc:304] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:30.068315 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.068921 29128 raft_consensus.cc:2804] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.069334 29128 raft_consensus.cc:493] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:30.069630 28894 leader_election.cc:343] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.069705 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:30.069655 29128 raft_consensus.cc:3060] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:30.071246 28894 leader_election.cc:343] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.071758 28894 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.072557 29150 raft_consensus.cc:2749] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.075860 29000 raft_consensus.cc:2468] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:30.076696 29074 raft_consensus.cc:2393] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 1: Already voted for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in this term.
I20260709 13:11:30.077487 29211 leader_election.cc:290] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.077364 29042 leader_election.cc:304] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:30.078464 29203 raft_consensus.cc:2804] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:30.078842 28818 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:30.079111 29203 raft_consensus.cc:697] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:30.079707 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b93b33daae4eadbaab3085ddf2e1da" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.079981 29130 raft_consensus.cc:2804] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.080459 29130 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.080806 29130 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.081547 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.082325 28850 raft_consensus.cc:2393] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:30.079968 29203 consensus_queue.cc:237] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.084168 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8550ef17e8a41acbcdfe5eab4042fc2" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.084810 28853 raft_consensus.cc:2468] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:30.084360 29060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe7b1ea920e462e8b046d5d41f6bd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.086011 29197 leader_election.cc:290] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:30.088872 29167 raft_consensus.cc:515] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.089524 29148 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:30.089403 29130 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.077353 29128 raft_consensus.cc:515] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.115985 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.120400 28853 raft_consensus.cc:2468] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:30.120916 29121 raft_consensus.cc:359] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.121691 29121 raft_consensus.cc:385] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.122010 29121 raft_consensus.cc:740] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.122411 29058 tablet_service.cc:1511] Processing CreateTablet for tablet 56d98016c79645be808873970bf26945 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:30.124190 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d98016c79645be808873970bf26945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.125051 29123 tablet_bootstrap.cc:654] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.130328 29204 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.131906 29121 consensus_queue.cc:260] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.143642 29121 ts_tablet_manager.cc:1434] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.000s
I20260709 13:11:30.145785 29122 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:30.146286 29122 ts_tablet_manager.cc:1403] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.008s
I20260709 13:11:30.147904 29002 raft_consensus.cc:3060] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.148097 29042 leader_election.cc:304] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.148772 29120 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:30.149227 29120 ts_tablet_manager.cc:1403] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.473s	user 0.009s	sys 0.021s
I20260709 13:11:30.153167 29120 raft_consensus.cc:359] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.153785 29120 raft_consensus.cc:385] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.154000 28984 tablet_service.cc:1511] Processing CreateTablet for tablet 56d98016c79645be808873970bf26945 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:30.155299 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d98016c79645be808873970bf26945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.154037 29120 raft_consensus.cc:740] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.155314 29122 raft_consensus.cc:359] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.157527 29122 raft_consensus.cc:385] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.157770 29122 raft_consensus.cc:740] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.159348 29120 consensus_queue.cc:260] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.160574 29122 consensus_queue.cc:260] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.163184 29167 leader_election.cc:290] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.163758 28913 tablet_service.cc:1511] Processing CreateTablet for tablet 305b8e0e7bf241b881fcd9238c779010 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:30.164917 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b8e0e7bf241b881fcd9238c779010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.174255 29167 raft_consensus.cc:493] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.174382 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:30.174775 29122 ts_tablet_manager.cc:1434] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:11:30.174796 29167 raft_consensus.cc:515] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
W20260709 13:11:30.176939 28966 leader_election.cc:343] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.177130 29204 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.178786 29128 leader_election.cc:290] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.154016 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:30.180500 28853 raft_consensus.cc:2393] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:30.181124 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:30.179551 29063 tablet_service.cc:1511] Processing CreateTablet for tablet 305b8e0e7bf241b881fcd9238c779010 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:30.183954 29063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b8e0e7bf241b881fcd9238c779010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.184065 29148 consensus_queue.cc:1048] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:30.185925 28968 leader_election.cc:343] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.190254 28990 tablet_service.cc:1511] Processing CreateTablet for tablet 305b8e0e7bf241b881fcd9238c779010 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:30.192695 29130 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:30.193073 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:30.193871 29075 raft_consensus.cc:3060] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.199151 29148 consensus_queue.cc:1048] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:30.199872 28990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b8e0e7bf241b881fcd9238c779010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.202843 29121 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:30.212809 29122 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:30.221303 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:30.222086 29000 raft_consensus.cc:2393] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:30.222116 29210 raft_consensus.cc:515] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.227559 29120 ts_tablet_manager.cc:1434] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:11:30.228356 29215 raft_consensus.cc:2749] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.228274 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:30.228889 29120 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:30.229014 28853 raft_consensus.cc:3060] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.236297 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:30.237112 28850 raft_consensus.cc:2393] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:30.238292 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:30.238795 28850 raft_consensus.cc:3060] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.241510 28841 tablet_service.cc:1511] Processing CreateTablet for tablet 56d98016c79645be808873970bf26945 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:30.254563 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d98016c79645be808873970bf26945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.260268 29123 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:30.261462 29123 ts_tablet_manager.cc:1403] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.225s	user 0.020s	sys 0.009s
I20260709 13:11:30.262079 28968 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.265285 28915 tablet_service.cc:1511] Processing CreateTablet for tablet c8c8976eac9c455aa167b1de76150656 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:30.266521 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c8976eac9c455aa167b1de76150656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.241420 28838 tablet_service.cc:1511] Processing CreateTablet for tablet c8c8976eac9c455aa167b1de76150656 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:30.268550 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c8976eac9c455aa167b1de76150656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.269742 28988 tablet_service.cc:1511] Processing CreateTablet for tablet c8c8976eac9c455aa167b1de76150656 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:30.270991 28988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c8976eac9c455aa167b1de76150656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.271759 29128 consensus_queue.cc:1048] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:30.273689 29128 raft_consensus.cc:2749] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.274780 29120 tablet_bootstrap.cc:654] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.280745 29127 raft_consensus.cc:515] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.281912 28928 raft_consensus.cc:2393] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in this term.
I20260709 13:11:30.282881 29127 leader_election.cc:290] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.301069 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd251d5537f14f37a55ab6d63637d34a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:30.301632 29167 leader_election.cc:290] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:30.306046 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:30.306653 29071 raft_consensus.cc:3060] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.306486 29204 consensus_queue.cc:1048] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:30.313651 29071 raft_consensus.cc:2468] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:30.314934 28892 leader_election.cc:304] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:30.320492 29058 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1ac826ae3d4a50b9a1fdec1e9a2e69 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:30.321429 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1ac826ae3d4a50b9a1fdec1e9a2e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.283877 28853 raft_consensus.cc:2468] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:30.298410 29210 leader_election.cc:290] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:30.343776 29122 tablet_bootstrap.cc:654] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.296236 29075 raft_consensus.cc:2468] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:30.359166 29225 raft_consensus.cc:2804] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:30.352635 29042 leader_election.cc:304] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:30.387696 28852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f04d827ff541d9ad5feb028f6fec84" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:30.388406 28852 raft_consensus.cc:3060] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.385944 29210 raft_consensus.cc:2764] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:30.379714 29225 raft_consensus.cc:697] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:30.390298 28838 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1ac826ae3d4a50b9a1fdec1e9a2e69 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:11:30.391808 29163 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:11:30.393234 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1ac826ae3d4a50b9a1fdec1e9a2e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.384416 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:30.397953 29121 tablet_bootstrap.cc:654] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.387635 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:30.401820 29227 log.cc:927] Time spent T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e: Append to log took a long time: real 0.065s	user 0.004s	sys 0.000s
I20260709 13:11:30.384219 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.389420 28892 leader_election.cc:304] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:30.404201 29225 consensus_queue.cc:237] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.405274 29062 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4840a88b2d49ce845b056aa75275ae (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:30.400760 28816 leader_election.cc:304] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:30.406163 28850 raft_consensus.cc:2468] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:30.421725 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4840a88b2d49ce845b056aa75275ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.422138 29167 raft_consensus.cc:2804] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:30.426995 29130 raft_consensus.cc:2749] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.432812 29167 raft_consensus.cc:697] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
W20260709 13:11:30.433841 28968 consensus_peers.cc:597] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.433732 29167 consensus_queue.cc:237] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.435155 29123 raft_consensus.cc:359] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.436862 29123 raft_consensus.cc:385] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.437143 29123 raft_consensus.cc:740] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.437783 29123 consensus_queue.cc:260] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.439034 29060 tablet_service.cc:1511] Processing CreateTablet for tablet e7a49b8cb161469c804c3693d6642483 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:30.439781 29123 ts_tablet_manager.cc:1434] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.178s	user 0.004s	sys 0.003s
I20260709 13:11:30.440718 29123 tablet_bootstrap.cc:492] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:30.444217 29060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a49b8cb161469c804c3693d6642483. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:30.445536 28894 leader_election.cc:343] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.446810 28913 tablet_service.cc:1511] Processing CreateTablet for tablet e7a49b8cb161469c804c3693d6642483 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:30.448153 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a49b8cb161469c804c3693d6642483. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:30.449681 28816 leader_election.cc:343] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.454761 28838 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4840a88b2d49ce845b056aa75275ae (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:30.455947 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4840a88b2d49ce845b056aa75275ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.450034 28968 leader_election.cc:304] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:30.460394 28915 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1ac826ae3d4a50b9a1fdec1e9a2e69 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:30.461520 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1ac826ae3d4a50b9a1fdec1e9a2e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.464576 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8550ef17e8a41acbcdfe5eab4042fc2" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
W20260709 13:11:30.464656 28894 leader_election.cc:343] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.465683 28894 leader_election.cc:304] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.465329 28850 raft_consensus.cc:3060] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.450129 28816 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:30.472359 29130 raft_consensus.cc:2749] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.472558 28988 tablet_service.cc:1511] Processing CreateTablet for tablet e7a49b8cb161469c804c3693d6642483 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:11:30.502216 28737 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 44854.5us
I20260709 13:11:30.458951 28990 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4840a88b2d49ce845b056aa75275ae (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:30.475600 28850 raft_consensus.cc:2468] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:30.504994 28990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4840a88b2d49ce845b056aa75275ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.505317 29042 leader_election.cc:304] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:30.506143 29210 raft_consensus.cc:2804] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:30.506603 29210 raft_consensus.cc:697] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:30.474846 29198 raft_consensus.cc:2804] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:30.507340 29210 consensus_queue.cc:237] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.508143 29198 raft_consensus.cc:697] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:30.508986 29198 consensus_queue.cc:237] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.488859 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8550ef17e8a41acbcdfe5eab4042fc2" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:30.511282 28927 raft_consensus.cc:3060] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.514653 28988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a49b8cb161469c804c3693d6642483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.500476 29123 tablet_bootstrap.cc:654] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.473181 29225 raft_consensus.cc:2749] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.484860 29120 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:30.528472 29120 ts_tablet_manager.cc:1403] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.300s	user 0.018s	sys 0.002s
I20260709 13:11:30.538280 29164 consensus_queue.cc:1048] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:30.527375 28852 raft_consensus.cc:2468] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:30.550428 29164 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.556972 29130 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.569005 29130 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.571126 29130 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:30.572178 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:30.572208 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:30.573491 28928 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:30.574748 28818 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:30.575595 29130 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.576020 29130 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.567054 29122 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:30.579339 29122 ts_tablet_manager.cc:1403] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.371s	user 0.022s	sys 0.061s
I20260709 13:11:30.582865 29122 raft_consensus.cc:359] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.583534 29122 raft_consensus.cc:385] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.583880 29122 raft_consensus.cc:740] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.583263 29120 raft_consensus.cc:359] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.584376 29121 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:30.584451 29120 raft_consensus.cc:385] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.584816 29122 consensus_queue.cc:260] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.584885 29120 raft_consensus.cc:740] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.586340 29121 ts_tablet_manager.cc:1403] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.384s	user 0.011s	sys 0.015s
I20260709 13:11:30.587321 29062 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9f352e256845538a894cae38c64fa8 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:30.593569 28984 tablet_service.cc:1511] Processing CreateTablet for tablet b955d423ccbf49f092ae423e2778518b (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:30.593624 28989 tablet_service.cc:1511] Processing CreateTablet for tablet 3867b16885df491794bbf87eb1e86929 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:30.595095 28915 tablet_service.cc:1511] Processing CreateTablet for tablet 3867b16885df491794bbf87eb1e86929 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:30.596858 29120 consensus_queue.cc:260] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.603053 28913 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9f352e256845538a894cae38c64fa8 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:30.603519 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3867b16885df491794bbf87eb1e86929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.577883 29130 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.606171 29120 ts_tablet_manager.cc:1434] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
I20260709 13:11:30.611840 28927 raft_consensus.cc:2468] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:30.601784 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9f352e256845538a894cae38c64fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.599138 28838 tablet_service.cc:1511] Processing CreateTablet for tablet 3867b16885df491794bbf87eb1e86929 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:30.608668 29060 tablet_service.cc:1511] Processing CreateTablet for tablet b955d423ccbf49f092ae423e2778518b (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:30.619922 29060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b955d423ccbf49f092ae423e2778518b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.620352 29130 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.609309 28841 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9f352e256845538a894cae38c64fa8 (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:30.615592 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9f352e256845538a894cae38c64fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.622957 29210 consensus_queue.cc:1048] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:30.625818 28747 catalog_manager.cc:5697] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 1 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.612437 29120 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:30.612462 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b955d423ccbf49f092ae423e2778518b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.601809 29122 ts_tablet_manager.cc:1434] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:11:30.564440 29164 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.615234 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3867b16885df491794bbf87eb1e86929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.630030 29122 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:30.636214 28836 tablet_service.cc:1511] Processing CreateTablet for tablet b955d423ccbf49f092ae423e2778518b (DEFAULT_TABLE table=test-workload [id=fb22e6e82e8942d9b129f7488ab8a758]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:30.636938 29001 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:30.637909 29164 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:30.637269 28747 catalog_manager.cc:5697] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } }
I20260709 13:11:30.639930 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3867b16885df491794bbf87eb1e86929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.639989 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.640851 29123 tablet_bootstrap.cc:492] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:30.640980 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:30.643471 29123 ts_tablet_manager.cc:1403] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.203s	user 0.012s	sys 0.012s
I20260709 13:11:30.644980 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9f352e256845538a894cae38c64fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.645030 28853 raft_consensus.cc:2393] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:30.647469 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b955d423ccbf49f092ae423e2778518b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.649616 29123 raft_consensus.cc:359] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:30.650491 29123 raft_consensus.cc:385] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.650810 29123 raft_consensus.cc:740] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.651502 29123 consensus_queue.cc:260] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:30.654481 29121 raft_consensus.cc:359] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.654898 29123 ts_tablet_manager.cc:1434] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:11:30.655158 29121 raft_consensus.cc:385] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.655864 29123 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:30.655488 29121 raft_consensus.cc:740] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.646667 28927 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:30.661079 28968 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.661887 29198 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.662271 29198 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.662606 29198 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.668259 28750 catalog_manager.cc:5697] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.669416 28750 catalog_manager.cc:5697] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.657646 29121 consensus_queue.cc:260] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.673062 29121 ts_tablet_manager.cc:1434] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.002s
I20260709 13:11:30.673892 29121 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
W20260709 13:11:30.683851 29023 debug-util.cc:398] Leaking SignalData structure 0x7b0800271fc0 after lost signal to thread 21778
W20260709 13:11:30.684954 29023 debug-util.cc:398] Leaking SignalData structure 0x7b080025ac80 after lost signal to thread 28784
W20260709 13:11:30.687186 29023 debug-util.cc:398] Leaking SignalData structure 0x7b08000c11c0 after lost signal to thread 28952
I20260709 13:11:30.688714 29122 tablet_bootstrap.cc:654] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.689730 29123 tablet_bootstrap.cc:654] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:30.692261 29023 debug-util.cc:398] Leaking SignalData structure 0x7b0800372740 after lost signal to thread 29026
W20260709 13:11:30.693612 29023 debug-util.cc:398] Leaking SignalData structure 0x7b080016ebe0 after lost signal to thread 29100
I20260709 13:11:30.693437 28748 catalog_manager.cc:5697] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 1 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.697576 29198 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.699826 29121 tablet_bootstrap.cc:654] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.700276 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:30.701045 28853 raft_consensus.cc:2393] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:30.701417 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:30.701934 28927 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.705197 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:30.705948 29001 raft_consensus.cc:2393] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:30.706830 29120 tablet_bootstrap.cc:654] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.707242 29130 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:30.710812 29198 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:30.711022 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:30.731601 28968 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.744498 28927 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:30.745784 28818 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:30.734386 29198 raft_consensus.cc:2749] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.747622 29130 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:30.752409 29130 raft_consensus.cc:697] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:30.753221 29130 consensus_queue.cc:237] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.756156 28747 catalog_manager.cc:5697] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } }
I20260709 13:11:30.757012 29203 consensus_queue.cc:1048] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:30.765799 29148 raft_consensus.cc:493] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.766381 29148 raft_consensus.cc:515] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.766642 29198 raft_consensus.cc:493] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.767210 29198 raft_consensus.cc:515] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:30.768632 29148 leader_election.cc:290] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.776367 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:30.777752 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.778571 28850 raft_consensus.cc:2393] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f69f6a7e69e4093b7779d80aab42eb4 in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:30.779433 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:30.780102 28927 raft_consensus.cc:2468] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:30.781657 29198 leader_election.cc:290] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:30.781606 28968 leader_election.cc:304] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:30.782259 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:30.782785 29164 raft_consensus.cc:2804] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.783162 29164 raft_consensus.cc:493] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.783510 29164 raft_consensus.cc:3060] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:30.783859 28966 leader_election.cc:343] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.787372 28894 leader_election.cc:304] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.787250 28749 catalog_manager.cc:5697] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.788892 29167 raft_consensus.cc:3060] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.792052 29164 raft_consensus.cc:515] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:30.794047 29164 leader_election.cc:290] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:30.799183 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:30.799808 28927 raft_consensus.cc:3060] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.803854 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:30.805747 28966 leader_election.cc:343] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:30.808947 29120 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:30.809108 29123 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:30.809597 29120 ts_tablet_manager.cc:1403] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.197s	user 0.020s	sys 0.036s
I20260709 13:11:30.809621 29123 ts_tablet_manager.cc:1403] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.000s
I20260709 13:11:30.810745 28927 raft_consensus.cc:2468] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:30.811975 28968 leader_election.cc:304] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:30.812510 29123 raft_consensus.cc:359] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.812827 29204 raft_consensus.cc:2804] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:30.813162 29123 raft_consensus.cc:385] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.813357 29204 raft_consensus.cc:697] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:30.813511 29123 raft_consensus.cc:740] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.783473 29121 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:30.814435 29121 ts_tablet_manager.cc:1403] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.009s
I20260709 13:11:30.814284 29204 consensus_queue.cc:237] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:30.814344 29123 consensus_queue.cc:260] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.813279 29167 raft_consensus.cc:2749] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.818411 29121 raft_consensus.cc:359] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.819257 29123 ts_tablet_manager.cc:1434] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:30.819221 29121 raft_consensus.cc:385] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.819846 29121 raft_consensus.cc:740] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.820613 29123 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:30.820910 29121 consensus_queue.cc:260] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.826900 29123 tablet_bootstrap.cc:654] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.827616 29121 ts_tablet_manager.cc:1434] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:11:30.827492 28750 catalog_manager.cc:5697] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.831357 29121 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:30.835076 29167 raft_consensus.cc:493] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.835580 29167 raft_consensus.cc:515] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.837658 29167 leader_election.cc:290] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:30.840009 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5954e889e23845479415928960eb44ab" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:30.839993 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5954e889e23845479415928960eb44ab" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.847754 29167 consensus_queue.cc:1048] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:30.848225 28894 leader_election.cc:304] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.839232 29120 raft_consensus.cc:359] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.851402 29120 raft_consensus.cc:385] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.851758 29120 raft_consensus.cc:740] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.852423 29167 raft_consensus.cc:2749] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.852634 29120 consensus_queue.cc:260] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.862907 29121 tablet_bootstrap.cc:654] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.864107 29120 ts_tablet_manager.cc:1434] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:11:30.865043 29120 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:30.878518 29203 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.879228 29203 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.882025 29203 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.886416 29120 tablet_bootstrap.cc:654] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:30.887207 29167 consensus_queue.cc:1048] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:30.888932 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:30.888932 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.889920 28853 raft_consensus.cc:2393] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:30.889920 29001 raft_consensus.cc:2393] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:30.891896 29042 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:30.893301 29122 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:30.893702 29122 ts_tablet_manager.cc:1403] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.264s	user 0.021s	sys 0.020s
I20260709 13:11:30.892894 29210 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.910075 29122 raft_consensus.cc:359] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.910732 29122 raft_consensus.cc:385] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.911047 29122 raft_consensus.cc:740] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.920001 29122 consensus_queue.cc:260] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.930671 29127 consensus_queue.cc:1048] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:30.945374 29121 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:30.945986 29121 ts_tablet_manager.cc:1403] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.007s
I20260709 13:11:30.948225 29210 raft_consensus.cc:2749] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:30.950596 29123 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:30.951114 29123 ts_tablet_manager.cc:1403] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.014s
I20260709 13:11:30.953382 29210 consensus_queue.cc:1048] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:30.955122 29123 raft_consensus.cc:359] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.956579 29123 raft_consensus.cc:385] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.957324 29123 raft_consensus.cc:740] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.960383 29204 raft_consensus.cc:493] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.960255 29198 consensus_queue.cc:1048] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:30.961038 29204 raft_consensus.cc:515] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:30.963343 29204 leader_election.cc:290] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:30.960216 29123 consensus_queue.cc:260] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:30.964015 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c6c665d7f64081a51c8c1b8167b26e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:30.964711 29073 raft_consensus.cc:2468] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:30.965917 28966 leader_election.cc:304] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:30.965986 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c6c665d7f64081a51c8c1b8167b26e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:30.967080 28850 raft_consensus.cc:2468] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:30.968144 29204 raft_consensus.cc:2804] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:30.968536 29204 raft_consensus.cc:493] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.968884 29204 raft_consensus.cc:3060] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:30.974984 29122 ts_tablet_manager.cc:1434] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.003s
I20260709 13:11:30.956584 28749 catalog_manager.cc:5697] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.968550 29123 ts_tablet_manager.cc:1434] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:11:30.963234 29121 raft_consensus.cc:359] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.979302 29121 raft_consensus.cc:385] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:30.980782 29121 raft_consensus.cc:740] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.982000 29121 consensus_queue.cc:260] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:30.976119 29122 tablet_bootstrap.cc:492] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:30.982178 29203 consensus_queue.cc:1048] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:30.997155 29121 ts_tablet_manager.cc:1434] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:11:30.980306 29123 tablet_bootstrap.cc:492] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.001049 29225 consensus_queue.cc:1048] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.000613 29121 tablet_bootstrap.cc:492] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:30.991137 29204 raft_consensus.cc:515] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.008800 29198 consensus_queue.cc:1048] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.015024 29123 tablet_bootstrap.cc:654] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.026099 29130 raft_consensus.cc:493] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.026589 29130 raft_consensus.cc:515] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.028102 29204 leader_election.cc:290] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:31.038535 29120 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:31.038904 29120 ts_tablet_manager.cc:1403] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.003s
I20260709 13:11:31.028641 29130 leader_election.cc:290] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:31.040886 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c6c665d7f64081a51c8c1b8167b26e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:31.046734 28853 raft_consensus.cc:3060] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.041323 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:31.042783 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c6c665d7f64081a51c8c1b8167b26e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:31.044950 29225 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.060508 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:31.061174 28928 raft_consensus.cc:2468] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:31.059381 29074 raft_consensus.cc:3060] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.062494 28818 leader_election.cc:304] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.065933 29120 raft_consensus.cc:359] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.066421 29120 raft_consensus.cc:385] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.066646 29120 raft_consensus.cc:740] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.069681 29130 raft_consensus.cc:2804] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.070082 29130 raft_consensus.cc:493] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.070416 29130 raft_consensus.cc:3060] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.074633 29120 consensus_queue.cc:260] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.077540 29120 ts_tablet_manager.cc:1434] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.005s
I20260709 13:11:31.059199 29001 raft_consensus.cc:2468] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:31.058651 29225 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.080717 29123 tablet_bootstrap.cc:492] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.081215 29123 ts_tablet_manager.cc:1403] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.004s
I20260709 13:11:31.082450 29225 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:31.078873 29120 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:31.083788 29123 raft_consensus.cc:359] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.084429 29123 raft_consensus.cc:385] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.084673 29123 raft_consensus.cc:740] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.085695 29123 consensus_queue.cc:260] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.088084 29123 ts_tablet_manager.cc:1434] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:31.088927 29123 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.089638 29120 tablet_bootstrap.cc:654] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.101538 29122 tablet_bootstrap.cc:654] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.098835 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:31.103372 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:31.107429 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:31.112031 29123 tablet_bootstrap.cc:654] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:31.112826 28894 leader_election.cc:343] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:31.117966 28892 leader_election.cc:343] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.118528 28892 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:31.119866 29225 raft_consensus.cc:2749] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.134577 29121 tablet_bootstrap.cc:654] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.148890 29128 raft_consensus.cc:493] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.149483 29128 raft_consensus.cc:515] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.150041 29130 raft_consensus.cc:515] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.151754 29128 leader_election.cc:290] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:31.154083 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67b0d4cd04d4ca4beaa3eb4072622a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:31.155258 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67b0d4cd04d4ca4beaa3eb4072622a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:31.158066 28968 leader_election.cc:343] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.158217 29074 raft_consensus.cc:2468] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
W20260709 13:11:31.160329 28966 leader_election.cc:343] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.160928 28966 leader_election.cc:304] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:31.162441 28966 leader_election.cc:304] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:31.162631 28853 raft_consensus.cc:2468] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:31.163388 29128 raft_consensus.cc:2749] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.163728 29204 raft_consensus.cc:2804] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.166795 29204 raft_consensus.cc:697] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:31.169435 29204 consensus_queue.cc:237] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.172271 29120 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:31.172941 29120 ts_tablet_manager.cc:1403] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.011s
I20260709 13:11:31.178699 29120 raft_consensus.cc:359] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.179726 29120 raft_consensus.cc:385] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.180007 29120 raft_consensus.cc:740] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.180703 29120 consensus_queue.cc:260] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.182699 29120 ts_tablet_manager.cc:1434] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:11:31.185526 29123 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.186010 29123 ts_tablet_manager.cc:1403] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.019s
I20260709 13:11:31.187058 29130 leader_election.cc:290] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:31.187251 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:31.187894 28927 raft_consensus.cc:3060] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.188887 29123 raft_consensus.cc:359] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.189548 29123 raft_consensus.cc:385] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.189706 29122 tablet_bootstrap.cc:492] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:31.189822 29123 raft_consensus.cc:740] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.190232 29122 ts_tablet_manager.cc:1403] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.022s
I20260709 13:11:31.190587 29123 consensus_queue.cc:260] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.192648 29123 ts_tablet_manager.cc:1434] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:31.193518 29123 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.193590 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:31.194172 29001 raft_consensus.cc:3060] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.196189 28927 raft_consensus.cc:2468] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:31.197454 28818 leader_election.cc:304] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.198424 29130 raft_consensus.cc:2804] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.199149 29130 raft_consensus.cc:697] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:31.199793 29123 tablet_bootstrap.cc:654] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.200137 29130 consensus_queue.cc:237] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.186041 29121 tablet_bootstrap.cc:492] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:31.205958 29121 ts_tablet_manager.cc:1403] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.011s
I20260709 13:11:31.208648 29122 raft_consensus.cc:359] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.209555 29122 raft_consensus.cc:385] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.209908 29122 raft_consensus.cc:740] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.211954 29122 consensus_queue.cc:260] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.214641 29121 raft_consensus.cc:359] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.217604 29121 raft_consensus.cc:385] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.218329 29121 raft_consensus.cc:740] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.226979 29121 consensus_queue.cc:260] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.230077 29121 ts_tablet_manager.cc:1434] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:11:31.231858 29121 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:31.235666 29122 ts_tablet_manager.cc:1434] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 13:11:31.236560 29130 raft_consensus.cc:493] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.237106 29130 raft_consensus.cc:515] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.240404 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.241139 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:31.241914 28816 leader_election.cc:343] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.239238 29130 leader_election.cc:290] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:31.246109 29121 tablet_bootstrap.cc:654] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:31.246031 28818 leader_election.cc:343] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.246662 28818 leader_election.cc:304] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:31.246827 29130 consensus_queue.cc:1048] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.247862 29267 raft_consensus.cc:2749] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.251724 29120 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:31.215691 29001 raft_consensus.cc:2468] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
W20260709 13:11:31.252705 28966 consensus_peers.cc:597] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.255239 28749 catalog_manager.cc:5697] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.264786 29122 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:31.242971 28747 catalog_manager.cc:5697] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.274834 29204 consensus_queue.cc:1048] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.288837 29120 tablet_bootstrap.cc:654] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.291741 29123 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.292237 29123 ts_tablet_manager.cc:1403] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.099s	user 0.045s	sys 0.036s
I20260709 13:11:31.295038 29123 raft_consensus.cc:359] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.295769 29123 raft_consensus.cc:385] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.296039 29123 raft_consensus.cc:740] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.296092 29121 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:31.296761 29121 ts_tablet_manager.cc:1403] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.000s
I20260709 13:11:31.287366 29122 tablet_bootstrap.cc:654] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.296878 29123 consensus_queue.cc:260] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.300236 29121 raft_consensus.cc:359] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.301157 29121 raft_consensus.cc:385] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.301554 29121 raft_consensus.cc:740] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.302306 29121 consensus_queue.cc:260] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.302986 29123 ts_tablet_manager.cc:1434] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:31.304014 29123 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.305157 29121 ts_tablet_manager.cc:1434] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:31.306139 29121 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:31.311605 29123 tablet_bootstrap.cc:654] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.320787 29121 tablet_bootstrap.cc:654] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.328387 29267 consensus_queue.cc:1048] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:31.331988 29123 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.332530 29123 ts_tablet_manager.cc:1403] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.010s
I20260709 13:11:31.335282 29204 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.335906 29204 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.338043 29204 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:31.340921 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.341075 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
W20260709 13:11:31.342260 28966 leader_election.cc:343] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.343556 29121 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:31.344691 29121 ts_tablet_manager.cc:1403] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.000s
I20260709 13:11:31.346024 29122 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:31.346626 29122 ts_tablet_manager.cc:1403] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.006s
W20260709 13:11:31.348274 28968 leader_election.cc:343] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.348292 29197 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.348973 28968 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:31.350337 29204 raft_consensus.cc:2749] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.349068 29197 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.351907 29123 raft_consensus.cc:359] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.352538 29123 raft_consensus.cc:385] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.352694 29120 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:31.352795 29123 raft_consensus.cc:740] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.353259 29120 ts_tablet_manager.cc:1403] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.005s
I20260709 13:11:31.353662 29123 consensus_queue.cc:260] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.354144 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:31.354764 28927 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:31.355764 29123 ts_tablet_manager.cc:1434] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:11:31.355883 28818 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.356698 29123 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.356997 29197 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:31.357174 29130 raft_consensus.cc:2804] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.357620 29130 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.358122 29130 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.348837 29121 raft_consensus.cc:359] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.358628 29121 raft_consensus.cc:385] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.358946 29121 raft_consensus.cc:740] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.359789 29121 consensus_queue.cc:260] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.362033 29121 ts_tablet_manager.cc:1434] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 13:11:31.362951 29121 tablet_bootstrap.cc:492] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:31.364014 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.365001 29122 raft_consensus.cc:359] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.365612 29122 raft_consensus.cc:385] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.365868 29122 raft_consensus.cc:740] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.367053 29120 raft_consensus.cc:359] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.368227 29120 raft_consensus.cc:385] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.368564 29120 raft_consensus.cc:740] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.370146 29122 consensus_queue.cc:260] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.369414 29120 consensus_queue.cc:260] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:31.373358 28816 leader_election.cc:343] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.375324 29121 tablet_bootstrap.cc:654] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.379669 29122 ts_tablet_manager.cc:1434] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:11:31.380028 29123 tablet_bootstrap.cc:654] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.380525 29122 tablet_bootstrap.cc:492] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:31.381242 29130 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.383849 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:31.384356 29074 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.384557 29120 ts_tablet_manager.cc:1434] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:11:31.385609 29120 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:31.387072 28927 raft_consensus.cc:3060] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.387338 29204 raft_consensus.cc:493] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.387941 29204 raft_consensus.cc:515] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.392244 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:31.392838 28853 raft_consensus.cc:2468] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:31.393412 29074 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:31.394625 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.395251 28968 leader_election.cc:304] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.396396 29128 raft_consensus.cc:2804] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.396757 29128 raft_consensus.cc:493] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.397137 29128 raft_consensus.cc:3060] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.404551 29130 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:31.399140 29204 leader_election.cc:290] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
W20260709 13:11:31.403991 28966 leader_election.cc:343] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.408092 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:31.409006 28928 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.415050 29120 tablet_bootstrap.cc:654] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.418295 29122 tablet_bootstrap.cc:654] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.419198 28928 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:31.441039 28818 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.441537 29128 raft_consensus.cc:515] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.442236 29130 raft_consensus.cc:2804] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.442848 29130 raft_consensus.cc:697] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:31.443907 29130 consensus_queue.cc:237] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.444433 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:31.445626 28966 leader_election.cc:343] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.472828 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:31.473439 28853 raft_consensus.cc:3060] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.474982 29128 leader_election.cc:290] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:31.479198 29123 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.479696 29123 ts_tablet_manager.cc:1403] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.011s
I20260709 13:11:31.480819 28853 raft_consensus.cc:2468] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:31.481968 28968 leader_election.cc:304] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:31.482327 29123 raft_consensus.cc:359] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.483006 29123 raft_consensus.cc:385] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.483038 29204 raft_consensus.cc:2804] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.483374 29123 raft_consensus.cc:740] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.483593 29204 raft_consensus.cc:697] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:31.484155 29123 consensus_queue.cc:260] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.484445 29204 consensus_queue.cc:237] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.487846 29120 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:31.488329 29120 ts_tablet_manager.cc:1403] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.001s
I20260709 13:11:31.489621 29123 ts_tablet_manager.cc:1434] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:31.490265 29121 tablet_bootstrap.cc:492] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:31.490576 29123 tablet_bootstrap.cc:492] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.490713 29121 ts_tablet_manager.cc:1403] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.128s	user 0.033s	sys 0.031s
I20260709 13:11:31.493672 29121 raft_consensus.cc:359] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.494307 29121 raft_consensus.cc:385] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.494581 29121 raft_consensus.cc:740] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.495260 29121 consensus_queue.cc:260] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.497658 29122 tablet_bootstrap.cc:492] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:31.499390 29123 tablet_bootstrap.cc:654] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.500532 29121 ts_tablet_manager.cc:1434] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:31.502502 29122 ts_tablet_manager.cc:1403] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.008s
I20260709 13:11:31.506279 29121 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:31.497820 29120 raft_consensus.cc:359] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.506713 29120 raft_consensus.cc:385] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.507067 29120 raft_consensus.cc:740] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.507844 29120 consensus_queue.cc:260] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.510105 29120 ts_tablet_manager.cc:1434] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:11:31.516971 29120 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:31.513262 29121 tablet_bootstrap.cc:654] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.514644 28748 catalog_manager.cc:5697] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.512198 29122 raft_consensus.cc:359] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.527185 29122 raft_consensus.cc:385] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.527463 29122 raft_consensus.cc:740] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.533149 28749 catalog_manager.cc:5697] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.529357 29122 consensus_queue.cc:260] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.542007 29122 ts_tablet_manager.cc:1434] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:11:31.545428 29122 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:31.549463 29120 tablet_bootstrap.cc:654] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.556571 29121 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:31.557227 29121 ts_tablet_manager.cc:1403] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.002s
I20260709 13:11:31.556602 29123 tablet_bootstrap.cc:492] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.560060 29122 tablet_bootstrap.cc:654] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.560194 29123 ts_tablet_manager.cc:1403] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.070s	user 0.032s	sys 0.007s
I20260709 13:11:31.561398 29204 raft_consensus.cc:493] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.561928 29204 raft_consensus.cc:515] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.566316 29204 leader_election.cc:290] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:31.562944 29123 raft_consensus.cc:359] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.566939 29123 raft_consensus.cc:385] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.567375 29123 raft_consensus.cc:740] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.567811 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9cd3f2da964526b25e30af018cd9ef" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:31.568482 28927 raft_consensus.cc:2468] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:31.568151 29123 consensus_queue.cc:260] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.569869 28968 leader_election.cc:304] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:31.576341 29204 raft_consensus.cc:2804] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.576704 29204 raft_consensus.cc:493] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.577109 29204 raft_consensus.cc:3060] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.570600 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9cd3f2da964526b25e30af018cd9ef" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:31.580147 28853 raft_consensus.cc:2468] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:31.585486 29204 raft_consensus.cc:515] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.563831 29121 raft_consensus.cc:359] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.572460 29120 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:31.586886 29121 raft_consensus.cc:385] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.587306 29120 ts_tablet_manager.cc:1403] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.001s
I20260709 13:11:31.587380 29121 raft_consensus.cc:740] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.589540 29123 ts_tablet_manager.cc:1434] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:11:31.589417 29121 consensus_queue.cc:260] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.590751 29123 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.599972 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9cd3f2da964526b25e30af018cd9ef" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:31.600555 28853 raft_consensus.cc:3060] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.602524 29123 tablet_bootstrap.cc:654] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.607729 29121 ts_tablet_manager.cc:1434] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:11:31.612843 29204 leader_election.cc:290] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:31.601555 29120 raft_consensus.cc:359] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.613634 28853 raft_consensus.cc:2468] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:31.613687 29120 raft_consensus.cc:385] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.614084 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9cd3f2da964526b25e30af018cd9ef" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:31.614394 29120 raft_consensus.cc:740] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.614694 28927 raft_consensus.cc:3060] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.615329 29120 consensus_queue.cc:260] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.616452 29122 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:31.616920 29122 ts_tablet_manager.cc:1403] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.014s
I20260709 13:11:31.618409 29120 ts_tablet_manager.cc:1434] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:11:31.618978 28968 leader_election.cc:304] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.619791 29204 raft_consensus.cc:2804] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.619765 29122 raft_consensus.cc:359] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.620620 29122 raft_consensus.cc:385] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.620934 29122 raft_consensus.cc:740] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.621181 29120 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:31.621622 29122 consensus_queue.cc:260] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.623745 29122 ts_tablet_manager.cc:1434] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:31.626089 29204 raft_consensus.cc:697] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:31.627390 29120 tablet_bootstrap.cc:654] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.628116 29122 tablet_bootstrap.cc:492] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:31.642922 29123 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.643512 29123 ts_tablet_manager.cc:1403] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.053s	user 0.004s	sys 0.020s
I20260709 13:11:31.645641 29122 tablet_bootstrap.cc:654] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.627045 29204 consensus_queue.cc:237] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.647712 29120 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:31.634475 29130 consensus_queue.cc:1048] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.648142 29120 ts_tablet_manager.cc:1403] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:11:31.649560 29225 raft_consensus.cc:493] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.650125 29225 raft_consensus.cc:515] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.650512 29123 raft_consensus.cc:359] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.651283 29123 raft_consensus.cc:385] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.651778 29123 raft_consensus.cc:740] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.656172 29123 consensus_queue.cc:260] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.652312 29225 leader_election.cc:290] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:31.651636 29120 raft_consensus.cc:359] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.653792 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f1135e78c645c5abf8555c620907d9" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.659029 29123 ts_tablet_manager.cc:1434] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
W20260709 13:11:31.659349 28892 leader_election.cc:343] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.659958 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f1135e78c645c5abf8555c620907d9" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:31.659901 29120 raft_consensus.cc:385] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.660660 29001 raft_consensus.cc:2468] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:31.660936 29123 tablet_bootstrap.cc:492] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:31.660681 29120 raft_consensus.cc:740] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.662550 28894 leader_election.cc:304] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:31.663794 29148 raft_consensus.cc:2804] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.664178 29148 raft_consensus.cc:493] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.664558 29148 raft_consensus.cc:3060] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.667912 29225 raft_consensus.cc:493] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.669370 29257 raft_consensus.cc:493] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.669826 29257 raft_consensus.cc:515] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.668603 29225 raft_consensus.cc:515] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.671891 29257 leader_election.cc:290] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:31.674032 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67b0d4cd04d4ca4beaa3eb4072622a9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:31.674783 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67b0d4cd04d4ca4beaa3eb4072622a9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:31.674039 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8acd4f604914312a15bf2dcf21f7e21" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:31.675509 28926 raft_consensus.cc:2468] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:31.675704 28853 raft_consensus.cc:2468] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:31.676777 29042 leader_election.cc:304] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:31.677239 28894 leader_election.cc:304] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.674723 29001 raft_consensus.cc:2468] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:31.678015 29167 raft_consensus.cc:2804] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.679111 29167 raft_consensus.cc:493] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.679270 29225 leader_election.cc:290] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:31.679478 29167 raft_consensus.cc:3060] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.679838 29123 tablet_bootstrap.cc:654] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.679982 29120 consensus_queue.cc:260] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.682415 29120 ts_tablet_manager.cc:1434] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:11:31.682895 28927 raft_consensus.cc:2468] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:31.683285 29120 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:31.677639 29257 raft_consensus.cc:2804] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.678637 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8acd4f604914312a15bf2dcf21f7e21" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:31.684100 29148 raft_consensus.cc:515] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.703152 29198 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.705575 29167 raft_consensus.cc:515] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.685497 29257 raft_consensus.cc:493] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.699558 29000 raft_consensus.cc:2468] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:31.708048 29257 raft_consensus.cc:3060] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.711413 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f1135e78c645c5abf8555c620907d9" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:31.712014 29000 raft_consensus.cc:3060] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.714365 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8acd4f604914312a15bf2dcf21f7e21" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:31.714941 28853 raft_consensus.cc:3060] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.718837 29198 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.719945 29203 raft_consensus.cc:493] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.720460 29203 raft_consensus.cc:515] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.721832 28853 raft_consensus.cc:2468] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:31.722457 29203 leader_election.cc:290] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:31.724114 29130 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.728368 29130 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.729117 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8acd4f604914312a15bf2dcf21f7e21" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:31.729727 29002 raft_consensus.cc:3060] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.730335 29130 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:31.725195 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:31.726311 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:31.732019 28851 raft_consensus.cc:2393] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:31.726944 29210 raft_consensus.cc:493] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.732762 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.732910 29210 raft_consensus.cc:515] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.733302 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:31.734163 29001 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
W20260709 13:11:31.734344 28816 leader_election.cc:343] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.734808 29210 leader_election.cc:290] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:31.735538 28818 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:31.736313 29042 leader_election.cc:304] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:31.736788 29130 raft_consensus.cc:2804] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:31.737299 29130 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.737413 29210 raft_consensus.cc:3060] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.737702 29130 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.727547 29167 leader_election.cc:290] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:31.739995 29121 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:31.744208 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:31.744196 28894 leader_election.cc:304] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:31.745496 29148 leader_election.cc:290] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:31.745056 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f1135e78c645c5abf8555c620907d9" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:31.746034 29148 raft_consensus.cc:2804] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.746475 29148 raft_consensus.cc:697] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
W20260709 13:11:31.747169 28892 leader_election.cc:343] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.718027 29257 raft_consensus.cc:515] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.750519 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf65c49499e9410a82ebb36901c05a87" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:31.753487 29120 tablet_bootstrap.cc:654] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.756390 29042 leader_election.cc:304] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:31.757225 29203 raft_consensus.cc:2749] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.758456 29164 consensus_queue.cc:1048] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.758591 29002 raft_consensus.cc:2468] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:31.747351 29148 consensus_queue.cc:237] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:31.771831 29000 raft_consensus.cc:2468] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:31.772253 29122 tablet_bootstrap.cc:492] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:31.772691 29122 ts_tablet_manager.cc:1403] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.145s	user 0.039s	sys 0.032s
I20260709 13:11:31.775699 29122 raft_consensus.cc:359] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.776298 29122 raft_consensus.cc:385] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.776518 29122 raft_consensus.cc:740] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.777802 29130 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:31.780936 29122 consensus_queue.cc:260] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.783624 29122 ts_tablet_manager.cc:1434] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:11:31.785429 29122 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:31.789548 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:31.790187 29002 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.783601 29210 raft_consensus.cc:2749] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.793753 29130 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:31.801560 29123 tablet_bootstrap.cc:492] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:31.803845 29123 ts_tablet_manager.cc:1403] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.143s	user 0.030s	sys 0.032s
I20260709 13:11:31.806609 29121 tablet_bootstrap.cc:654] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.807256 29123 raft_consensus.cc:359] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.808166 29123 raft_consensus.cc:385] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.808499 29123 raft_consensus.cc:740] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.809325 29123 consensus_queue.cc:260] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.810444 29130 raft_consensus.cc:493] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.811051 29130 raft_consensus.cc:515] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.813625 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:31.814023 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.814492 28894 leader_election.cc:304] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:31.815379 29267 consensus_queue.cc:1048] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.815811 29167 raft_consensus.cc:2804] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.816506 29198 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:31.818306 29002 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
W20260709 13:11:31.815898 28816 leader_election.cc:343] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.830797 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67b0d4cd04d4ca4beaa3eb4072622a9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:31.831351 28926 raft_consensus.cc:3060] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:31.831485 28816 leader_election.cc:343] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.831982 28818 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:31.821275 29122 tablet_bootstrap.cc:654] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.833101 29267 raft_consensus.cc:2804] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.833482 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:31.833606 29267 raft_consensus.cc:697] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:31.821875 29130 leader_election.cc:290] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:31.823086 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:31.827163 29164 consensus_queue.cc:1048] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:31.826671 28747 catalog_manager.cc:5697] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.828078 29257 leader_election.cc:290] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:31.828985 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:31.830152 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67b0d4cd04d4ca4beaa3eb4072622a9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:31.840245 29123 ts_tablet_manager.cc:1434] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:11:31.845996 29123 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
W20260709 13:11:31.843075 28968 leader_election.cc:343] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.843981 29000 raft_consensus.cc:3060] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.834753 29267 consensus_queue.cc:237] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:31.852713 28966 leader_election.cc:343] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:31.853165 28966 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:31.853890 29204 raft_consensus.cc:2749] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:31.856871 29073 raft_consensus.cc:3060] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.844066 28927 raft_consensus.cc:2468] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:31.861217 28818 leader_election.cc:304] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:31.866009 29167 raft_consensus.cc:697] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:31.890872 29123 tablet_bootstrap.cc:654] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:31.898983 29000 raft_consensus.cc:2468] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:31.901407 29167 consensus_queue.cc:237] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.902436 29121 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:31.902887 29121 ts_tablet_manager.cc:1403] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.005s
I20260709 13:11:31.895270 28926 raft_consensus.cc:2468] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:31.910332 29042 leader_election.cc:304] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:31.911185 29257 raft_consensus.cc:2804] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:31.926920 29121 raft_consensus.cc:359] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.928058 29121 raft_consensus.cc:385] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.928227 29121 raft_consensus.cc:740] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.928704 29121 consensus_queue.cc:260] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.915947 29257 raft_consensus.cc:697] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:31.931100 29120 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:31.931723 29120 ts_tablet_manager.cc:1403] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.249s	user 0.014s	sys 0.001s
I20260709 13:11:31.933499 29121 ts_tablet_manager.cc:1434] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:11:31.936029 29121 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:31.930228 29267 raft_consensus.cc:2804] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:31.932261 28818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 71180.6us
I20260709 13:11:31.938663 29267 raft_consensus.cc:493] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.939836 29267 raft_consensus.cc:3060] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:31.943086 29257 consensus_queue.cc:237] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:31.955070 29122 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:31.955615 29122 ts_tablet_manager.cc:1403] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.170s	user 0.010s	sys 0.010s
I20260709 13:11:31.948923 29164 consensus_queue.cc:1048] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:11:31.954943 29120 raft_consensus.cc:359] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.964376 29120 raft_consensus.cc:385] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:31.964670 29120 raft_consensus.cc:740] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.936826 29197 consensus_queue.cc:1048] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:11:31.965338 29120 consensus_queue.cc:260] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:31.963526 28747 catalog_manager.cc:5697] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.989566 29120 ts_tablet_manager.cc:1434] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:11:31.990442 29120 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:31.999130 29122 raft_consensus.cc:359] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.006646 29122 raft_consensus.cc:385] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.006883 29122 raft_consensus.cc:740] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.007573 29122 consensus_queue.cc:260] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.014353 29121 tablet_bootstrap.cc:654] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.015895 29197 consensus_queue.cc:1048] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.044301 29122 ts_tablet_manager.cc:1434] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 13:11:32.045572 29122 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:32.042649 29120 tablet_bootstrap.cc:654] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.020043 28748 catalog_manager.cc:5697] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.054325 29122 tablet_bootstrap.cc:654] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.057319 28748 catalog_manager.cc:5697] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.064910 29267 raft_consensus.cc:515] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:32.051352 29312 log.cc:927] Time spent T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:32.067052 29267 leader_election.cc:290] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:32.068145 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:32.068738 28927 raft_consensus.cc:3060] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.073539 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:32.074183 29075 raft_consensus.cc:3060] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.053370 29164 consensus_queue.cc:1048] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:11:32.077175 28927 raft_consensus.cc:2468] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:32.077509 28747 catalog_manager.cc:5697] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 1 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.078408 28818 leader_election.cc:304] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:32.079257 29267 raft_consensus.cc:2804] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.080416 29267 raft_consensus.cc:697] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:32.084959 29121 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:32.085553 29121 ts_tablet_manager.cc:1403] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.007s
I20260709 13:11:32.081744 29267 consensus_queue.cc:237] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.101558 29123 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:32.103238 29123 ts_tablet_manager.cc:1403] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.260s	user 0.029s	sys 0.009s
I20260709 13:11:32.102632 29075 raft_consensus.cc:2468] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:32.113283 29198 consensus_queue.cc:1048] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:32.118395 29167 raft_consensus.cc:493] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.118896 29167 raft_consensus.cc:515] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.129230 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca028d51a9934f5f93f321e1f06fb783" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:32.124763 29167 leader_election.cc:290] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
W20260709 13:11:32.130769 28892 leader_election.cc:343] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:32.131814 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:32.133206 29121 raft_consensus.cc:359] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.134089 29121 raft_consensus.cc:385] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.134884 29121 raft_consensus.cc:740] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.135437 29122 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:32.136368 29122 ts_tablet_manager.cc:1403] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.017s
I20260709 13:11:32.136504 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca028d51a9934f5f93f321e1f06fb783" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:32.137249 28853 raft_consensus.cc:2468] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:32.139025 29121 consensus_queue.cc:260] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.145516 29121 ts_tablet_manager.cc:1434] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.002s
I20260709 13:11:32.148626 29121 tablet_bootstrap.cc:492] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:32.152135 28894 leader_election.cc:304] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:32.153060 29167 raft_consensus.cc:2804] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.153532 29167 raft_consensus.cc:493] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.153841 29167 raft_consensus.cc:3060] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.154495 29120 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:32.154995 29120 ts_tablet_manager.cc:1403] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.011s
I20260709 13:11:32.163226 29167 raft_consensus.cc:515] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.163138 29120 raft_consensus.cc:359] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.164201 29120 raft_consensus.cc:385] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.164520 29120 raft_consensus.cc:740] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.165303 29120 consensus_queue.cc:260] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.166800 29301 consensus_queue.cc:1048] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.167186 29123 raft_consensus.cc:359] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.167845 29120 ts_tablet_manager.cc:1434] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:11:32.167965 29123 raft_consensus.cc:385] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.168560 29123 raft_consensus.cc:740] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.169513 29123 consensus_queue.cc:260] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.171993 29123 ts_tablet_manager.cc:1434] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:11:32.172713 29257 raft_consensus.cc:493] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.173174 29123 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:32.173146 29257 raft_consensus.cc:515] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.172554 29122 raft_consensus.cc:359] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.174235 29120 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:32.178109 29122 raft_consensus.cc:385] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.178422 29122 raft_consensus.cc:740] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.177155 29257 leader_election.cc:290] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:32.181144 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f1135e78c645c5abf8555c620907d9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:32.181918 29000 raft_consensus.cc:2393] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in this term.
I20260709 13:11:32.184010 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f1135e78c645c5abf8555c620907d9" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:32.184830 29198 consensus_queue.cc:1048] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.186542 29042 leader_election.cc:304] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:32.178993 29122 consensus_queue.cc:260] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.187551 29257 raft_consensus.cc:3060] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.190971 29120 tablet_bootstrap.cc:654] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.194336 28749 catalog_manager.cc:5697] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.196691 29122 ts_tablet_manager.cc:1434] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.003s
I20260709 13:11:32.197707 29122 tablet_bootstrap.cc:492] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:32.200428 29301 consensus_queue.cc:1048] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.206861 29123 tablet_bootstrap.cc:654] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.216169 29267 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.217262 29267 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.220944 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:32.221566 29000 raft_consensus.cc:2468] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:32.221948 29267 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:32.222795 28818 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:32.223647 29267 raft_consensus.cc:2804] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.224038 29267 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.224165 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:32.224404 29267 raft_consensus.cc:3060] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.224557 29204 raft_consensus.cc:493] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.224704 29167 leader_election.cc:290] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:32.235759 29204 raft_consensus.cc:515] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.236975 29257 raft_consensus.cc:2749] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.242030 29204 leader_election.cc:290] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:32.250540 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d327b0d2f19b4bcb89a2d313b3f61582" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:32.252116 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d327b0d2f19b4bcb89a2d313b3f61582" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:32.253358 28968 leader_election.cc:343] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:32.254660 28816 leader_election.cc:343] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.256042 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca028d51a9934f5f93f321e1f06fb783" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:32.256546 28853 raft_consensus.cc:3060] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:32.261401 28966 leader_election.cc:343] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.261891 28966 leader_election.cc:304] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:32.262705 29204 raft_consensus.cc:2749] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.264392 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca028d51a9934f5f93f321e1f06fb783" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:32.266436 28892 leader_election.cc:343] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.275818 28853 raft_consensus.cc:2468] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:32.277011 28894 leader_election.cc:304] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:32.278147 29301 raft_consensus.cc:2804] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.278596 29301 raft_consensus.cc:697] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:32.279399 29301 consensus_queue.cc:237] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.282886 29122 tablet_bootstrap.cc:654] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.286736 29120 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:32.287207 29120 ts_tablet_manager.cc:1403] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.113s	user 0.007s	sys 0.024s
I20260709 13:11:32.290720 29267 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.292228 29120 raft_consensus.cc:359] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.293084 29120 raft_consensus.cc:385] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.293411 29120 raft_consensus.cc:740] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.294731 29120 consensus_queue.cc:260] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.298738 29123 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:32.299185 29123 ts_tablet_manager.cc:1403] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.126s	user 0.028s	sys 0.027s
I20260709 13:11:32.301906 29314 consensus_queue.cc:1048] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.302477 29210 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.302965 29210 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.304903 29210 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:32.306562 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:32.307130 29267 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:32.308037 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:32.321259 29120 ts_tablet_manager.cc:1434] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:11:32.322419 29120 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:32.321597 29123 raft_consensus.cc:359] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.323153 29123 raft_consensus.cc:385] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.323397 29123 raft_consensus.cc:740] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.325493 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:32.326051 29000 raft_consensus.cc:3060] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.324193 29123 consensus_queue.cc:260] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.327550 29301 consensus_queue.cc:1048] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:32.334049 29198 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.334574 29198 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.332628 29204 raft_consensus.cc:493] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.319973 29042 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:32.336016 29204 raft_consensus.cc:515] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.336591 29198 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:32.336963 29210 raft_consensus.cc:2749] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.338008 29204 leader_election.cc:290] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:32.338081 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:32.341670 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:32.342835 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:32.343511 28853 raft_consensus.cc:2468] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:32.345495 29123 ts_tablet_manager.cc:1434] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.002s
I20260709 13:11:32.348215 29123 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:32.348326 28749 catalog_manager.cc:5697] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.353670 29120 tablet_bootstrap.cc:654] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.353673 29121 tablet_bootstrap.cc:654] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:32.344677 28968 leader_election.cc:343] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.338826 29073 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:32.375494 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:32.376186 28849 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:32.378687 29122 tablet_bootstrap.cc:492] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:32.379163 29122 ts_tablet_manager.cc:1403] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.182s	user 0.008s	sys 0.012s
I20260709 13:11:32.382100 28968 leader_election.cc:304] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:32.383176 29198 raft_consensus.cc:2804] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.383550 29198 raft_consensus.cc:493] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.383908 29198 raft_consensus.cc:3060] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.386590 29122 raft_consensus.cc:359] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.387219 29122 raft_consensus.cc:385] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.387401 29257 consensus_queue.cc:1048] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.383558 28968 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:32.344794 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:32.391646 29164 raft_consensus.cc:2804] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:32.392071 29164 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.392412 29164 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:32.392673 28816 leader_election.cc:343] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.387476 29122 raft_consensus.cc:740] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.394078 29122 consensus_queue.cc:260] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.396106 29122 ts_tablet_manager.cc:1434] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:11:32.396978 29122 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:32.388161 29000 raft_consensus.cc:2468] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:32.388935 29204 raft_consensus.cc:493] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.398622 29204 raft_consensus.cc:515] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.409051 29204 leader_election.cc:290] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:32.409168 29257 raft_consensus.cc:493] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.409849 29257 raft_consensus.cc:515] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.412484 28818 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:32.412740 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d327b0d2f19b4bcb89a2d313b3f61582" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:32.413715 29267 raft_consensus.cc:2804] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.414225 29267 raft_consensus.cc:697] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:32.414939 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:32.415035 29267 consensus_queue.cc:237] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.418179 29164 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:32.419909 29042 leader_election.cc:343] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.421208 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:32.422370 29257 leader_election.cc:290] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:32.434355 29167 raft_consensus.cc:493] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.434666 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d327b0d2f19b4bcb89a2d313b3f61582" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:32.434805 29167 raft_consensus.cc:515] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.435283 29002 raft_consensus.cc:2468] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:32.436754 29167 leader_election.cc:290] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:32.437527 29042 leader_election.cc:304] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:32.439049 29257 raft_consensus.cc:2804] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.439591 29121 tablet_bootstrap.cc:492] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:32.439101 29198 raft_consensus.cc:515] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.440079 29121 ts_tablet_manager.cc:1403] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.292s	user 0.016s	sys 0.012s
I20260709 13:11:32.440744 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:32.439491 29257 raft_consensus.cc:493] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.441831 29257 raft_consensus.cc:3060] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.442728 29121 raft_consensus.cc:359] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.443356 29121 raft_consensus.cc:385] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.444379 29164 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:32.441419 29198 leader_election.cc:290] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:32.440397 29123 tablet_bootstrap.cc:654] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.443602 29121 raft_consensus.cc:740] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.454427 29121 consensus_queue.cc:260] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.457990 29257 raft_consensus.cc:515] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
W20260709 13:11:32.459086 28894 leader_election.cc:343] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.466244 29075 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.459918 29120 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:32.459918 29123 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:32.460348 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:32.461166 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:32.468639 29123 ts_tablet_manager.cc:1403] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.000s
I20260709 13:11:32.468866 28849 raft_consensus.cc:3060] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.469723 29121 ts_tablet_manager.cc:1434] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:11:32.470595 29121 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:32.472095 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d327b0d2f19b4bcb89a2d313b3f61582" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:32.471446 29123 raft_consensus.cc:359] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.473049 29123 raft_consensus.cc:385] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.461303 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:32.472678 28926 raft_consensus.cc:3060] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.477718 29121 tablet_bootstrap.cc:654] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.479780 29123 raft_consensus.cc:740] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.480470 29123 consensus_queue.cc:260] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.482879 29123 ts_tablet_manager.cc:1434] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:32.483909 29123 tablet_bootstrap.cc:492] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:32.461277 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:32.484423 28853 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.486682 28849 raft_consensus.cc:2468] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:32.489168 29257 leader_election.cc:290] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:32.474687 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:32.490756 29120 ts_tablet_manager.cc:1403] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.012s
I20260709 13:11:32.467437 28749 catalog_manager.cc:5697] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.493100 29074 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:32.461555 28968 leader_election.cc:343] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.508208 29120 raft_consensus.cc:359] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.509186 29120 raft_consensus.cc:385] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.509466 29120 raft_consensus.cc:740] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
W20260709 13:11:32.505686 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 44170.8us
W20260709 13:11:32.519224 28894 leader_election.cc:343] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.519088 29130 consensus_queue.cc:1048] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.519794 28894 leader_election.cc:304] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:32.520828 29301 raft_consensus.cc:2749] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:32.508769 28966 leader_election.cc:343] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.523006 28966 leader_election.cc:304] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
W20260709 13:11:32.523937 28966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 50292.4us
I20260709 13:11:32.525565 29128 raft_consensus.cc:2749] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.526371 28926 raft_consensus.cc:2468] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:32.527436 29120 consensus_queue.cc:260] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:32.519146 28968 leader_election.cc:343] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.531394 28968 leader_election.cc:304] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:32.534375 29042 leader_election.cc:304] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:32.534807 29301 consensus_queue.cc:1048] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.535245 29210 raft_consensus.cc:2804] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.535619 29128 raft_consensus.cc:2804] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:32.535805 29210 raft_consensus.cc:697] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:32.536679 29210 consensus_queue.cc:237] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.538637 29120 ts_tablet_manager.cc:1434] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:11:32.539546 29120 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:32.543859 29123 tablet_bootstrap.cc:654] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.566722 29074 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:32.540849 28853 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:32.572150 28968 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:32.573148 29198 raft_consensus.cc:2804] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.573715 29198 raft_consensus.cc:697] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:32.574705 29198 consensus_queue.cc:237] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.584684 29305 consensus_queue.cc:1048] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.567687 29120 tablet_bootstrap.cc:654] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.545890 29128 raft_consensus.cc:697] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:32.624459 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d327b0d2f19b4bcb89a2d313b3f61582" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:32.625239 29002 raft_consensus.cc:3060] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.630750 29305 raft_consensus.cc:493] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.631251 29305 raft_consensus.cc:515] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.640506 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78523bc7e80a431c8097160346435949" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
W20260709 13:11:32.642903 28818 leader_election.cc:343] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.643707 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78523bc7e80a431c8097160346435949" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:32.644021 29002 raft_consensus.cc:2468] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
W20260709 13:11:32.645831 28816 leader_election.cc:343] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.643755 29120 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:32.646307 28816 leader_election.cc:304] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:32.646906 29120 ts_tablet_manager.cc:1403] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.004s
I20260709 13:11:32.647111 29307 raft_consensus.cc:2749] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.646811 29128 consensus_queue.cc:237] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.654171 29120 raft_consensus.cc:359] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.655002 29120 raft_consensus.cc:385] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.655318 29120 raft_consensus.cc:740] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.633416 29305 leader_election.cc:290] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:32.659356 29120 consensus_queue.cc:260] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.661989 29120 ts_tablet_manager.cc:1434] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:11:32.663441 29120 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:32.673308 29120 tablet_bootstrap.cc:654] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.646581 29122 tablet_bootstrap.cc:654] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.659413 29121 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:32.680703 29210 consensus_queue.cc:1048] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.685330 29121 ts_tablet_manager.cc:1403] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.215s	user 0.042s	sys 0.035s
I20260709 13:11:32.689790 29121 raft_consensus.cc:359] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.691099 29121 raft_consensus.cc:385] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.691418 29121 raft_consensus.cc:740] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.691771 29130 consensus_queue.cc:1048] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.692306 29121 consensus_queue.cc:260] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.696382 29121 ts_tablet_manager.cc:1434] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:11:32.700001 29121 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:32.683203 29123 tablet_bootstrap.cc:492] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:32.704368 29123 ts_tablet_manager.cc:1403] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.221s	user 0.010s	sys 0.016s
I20260709 13:11:32.707098 29123 raft_consensus.cc:359] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.724530 29123 raft_consensus.cc:385] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.717187 29122 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:32.725206 29122 ts_tablet_manager.cc:1403] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.328s	user 0.005s	sys 0.008s
I20260709 13:11:32.731146 29122 raft_consensus.cc:359] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.731868 29122 raft_consensus.cc:385] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.732199 29122 raft_consensus.cc:740] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.733018 29122 consensus_queue.cc:260] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.722867 28749 catalog_manager.cc:5697] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 1 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.736552 29123 raft_consensus.cc:740] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.737450 29123 consensus_queue.cc:260] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.739534 29123 ts_tablet_manager.cc:1434] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:11:32.717514 29120 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:32.743400 29120 ts_tablet_manager.cc:1403] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.002s
I20260709 13:11:32.746162 29120 raft_consensus.cc:359] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.721817 29121 tablet_bootstrap.cc:654] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.749291 29120 raft_consensus.cc:385] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.749663 29120 raft_consensus.cc:740] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.750433 29120 consensus_queue.cc:260] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.741348 29122 ts_tablet_manager.cc:1434] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:11:32.752555 29120 ts_tablet_manager.cc:1434] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:32.752882 29122 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:32.748965 29123 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:32.760188 29120 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:32.764045 29122 tablet_bootstrap.cc:654] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.764629 29123 tablet_bootstrap.cc:654] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.769950 29120 tablet_bootstrap.cc:654] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.771835 29121 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:32.772629 29121 ts_tablet_manager.cc:1403] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.000s
I20260709 13:11:32.777547 29121 raft_consensus.cc:359] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.778195 29121 raft_consensus.cc:385] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.778475 29121 raft_consensus.cc:740] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.779193 29120 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:32.780186 29120 ts_tablet_manager.cc:1403] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.002s
I20260709 13:11:32.785801 29120 raft_consensus.cc:359] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.786491 29120 raft_consensus.cc:385] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.786789 29120 raft_consensus.cc:740] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.779182 29121 consensus_queue.cc:260] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.787464 29120 consensus_queue.cc:260] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.789098 29121 ts_tablet_manager.cc:1434] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:11:32.789373 29120 ts_tablet_manager.cc:1434] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:11:32.790124 29121 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:32.795609 29120 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:32.797358 29121 tablet_bootstrap.cc:654] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.805395 29120 tablet_bootstrap.cc:654] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.816092 28747 catalog_manager.cc:5697] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.818193 28747 catalog_manager.cc:5697] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 2, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.821834 29120 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:32.822351 29120 ts_tablet_manager.cc:1403] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.006s
I20260709 13:11:32.828426 29121 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:32.829052 29121 ts_tablet_manager.cc:1403] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.005s
I20260709 13:11:32.833921 29121 raft_consensus.cc:359] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.834723 29121 raft_consensus.cc:385] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.835085 29121 raft_consensus.cc:740] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.835881 29121 consensus_queue.cc:260] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.838567 29121 ts_tablet_manager.cc:1434] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:11:32.840803 29305 raft_consensus.cc:493] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.841461 29305 raft_consensus.cc:515] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.844970 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:32.845548 28926 raft_consensus.cc:2468] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:32.848192 28818 leader_election.cc:304] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:32.849296 29130 raft_consensus.cc:2804] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.849836 29130 raft_consensus.cc:493] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.850284 29130 raft_consensus.cc:3060] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.849858 29121 tablet_bootstrap.cc:492] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:32.853798 29128 raft_consensus.cc:493] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.854269 29128 raft_consensus.cc:515] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.856294 29128 leader_election.cc:290] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:32.857394 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:32.857817 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:32.858541 29121 tablet_bootstrap.cc:654] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:32.859195 28968 leader_election.cc:343] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:32.859910 28966 leader_election.cc:343] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.860332 28966 leader_election.cc:304] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:32.861042 29128 raft_consensus.cc:2749] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:32.848961 29120 raft_consensus.cc:359] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.880604 29120 raft_consensus.cc:385] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.880898 29120 raft_consensus.cc:740] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
W20260709 13:11:32.881840 28892 consensus_peers.cc:597] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.881687 29120 consensus_queue.cc:260] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:32.883620 29121 tablet_bootstrap.cc:492] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:32.884202 29121 ts_tablet_manager.cc:1403] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.002s
I20260709 13:11:32.883121 29301 consensus_queue.cc:1048] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.890235 29120 ts_tablet_manager.cc:1434] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.068s	user 0.002s	sys 0.006s
I20260709 13:11:32.891170 29120 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:32.897033 29305 leader_election.cc:290] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:32.897833 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:32.907685 29121 raft_consensus.cc:359] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:32.908658 29121 raft_consensus.cc:385] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:32.908962 29121 raft_consensus.cc:740] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.909732 29121 consensus_queue.cc:260] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
W20260709 13:11:32.899456 28818 leader_election.cc:343] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.912557 29121 ts_tablet_manager.cc:1434] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:11:32.913756 29121 tablet_bootstrap.cc:492] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:32.927047 29307 consensus_queue.cc:1048] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:32.949034 29130 raft_consensus.cc:515] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:32.952625 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:32.953426 28926 raft_consensus.cc:3060] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.954300 29121 tablet_bootstrap.cc:654] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:32.956225 29225 raft_consensus.cc:493] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.956791 29314 raft_consensus.cc:493] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.956866 29225 raft_consensus.cc:515] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.957751 29314 raft_consensus.cc:515] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:32.961789 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78523bc7e80a431c8097160346435949" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:32.962088 29225 leader_election.cc:290] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:32.962410 29073 raft_consensus.cc:2468] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:32.962791 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78523bc7e80a431c8097160346435949" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:32.963409 28849 raft_consensus.cc:2468] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:32.964598 28894 leader_election.cc:304] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:32.965320 29073 raft_consensus.cc:1275] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:32.966445 29314 leader_election.cc:290] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:32.969466 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bb4f426f62474ea61c0ccd22e639f3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:32.970649 28816 leader_election.cc:343] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:32.971323 29128 consensus_queue.cc:1048] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:32.965410 29225 raft_consensus.cc:2804] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.973472 29225 raft_consensus.cc:493] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.973896 29225 raft_consensus.cc:3060] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.979887 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bb4f426f62474ea61c0ccd22e639f3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:32.980561 28928 raft_consensus.cc:2468] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:32.982735 28818 leader_election.cc:304] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:32.983621 29314 raft_consensus.cc:2804] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:32.987447 29314 raft_consensus.cc:493] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.987833 29314 raft_consensus.cc:3060] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:32.996594 28926 raft_consensus.cc:2468] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:32.997920 28818 leader_election.cc:304] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:32.998754 29307 raft_consensus.cc:2804] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:33.000417 28849 raft_consensus.cc:1275] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:33.003489 29128 consensus_queue.cc:1048] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.012795 29314 raft_consensus.cc:515] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.015091 29128 raft_consensus.cc:493] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.015622 29128 raft_consensus.cc:515] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:33.019753 28816 consensus_peers.cc:597] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.016530 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bb4f426f62474ea61c0ccd22e639f3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:33.021118 28816 leader_election.cc:343] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.023871 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875112fc0fc4410eb1a079bb5771d060" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:33.025385 28966 leader_election.cc:343] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.027544 29128 leader_election.cc:290] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:33.027680 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875112fc0fc4410eb1a079bb5771d060" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:33.028367 28853 raft_consensus.cc:2468] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:33.029902 29210 consensus_queue.cc:1048] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:33.029980 28968 leader_election.cc:304] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:33.031800 29128 raft_consensus.cc:2804] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:33.032191 29128 raft_consensus.cc:493] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.032541 29128 raft_consensus.cc:3060] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.035122 29225 raft_consensus.cc:515] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.044677 29128 raft_consensus.cc:515] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.045226 29307 raft_consensus.cc:697] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:33.055676 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875112fc0fc4410eb1a079bb5771d060" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:33.057894 28966 leader_election.cc:343] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.059764 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875112fc0fc4410eb1a079bb5771d060" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:33.060400 28849 raft_consensus.cc:3060] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.062822 29204 consensus_queue.cc:1048] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.055773 29307 consensus_queue.cc:237] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.078166 29301 raft_consensus.cc:493] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.078812 29301 raft_consensus.cc:515] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.077863 28849 raft_consensus.cc:2468] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:33.082064 28968 leader_election.cc:304] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:33.082758 29301 leader_election.cc:290] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:33.082886 29204 raft_consensus.cc:2804] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:33.083456 29204 raft_consensus.cc:697] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:33.070931 29128 leader_election.cc:290] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:33.105602 29120 tablet_bootstrap.cc:654] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.106040 29130 leader_election.cc:290] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:33.112022 29204 consensus_queue.cc:237] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.112882 29305 raft_consensus.cc:493] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.113363 29305 raft_consensus.cc:515] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.095999 28999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:33.115326 29305 leader_election.cc:290] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:33.098711 29314 leader_election.cc:290] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:33.125490 29121 tablet_bootstrap.cc:492] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:33.139297 29121 ts_tablet_manager.cc:1403] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.226s	user 0.026s	sys 0.047s
I20260709 13:11:33.124148 29225 leader_election.cc:290] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:33.135910 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:33.126221 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:33.151889 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78523bc7e80a431c8097160346435949" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:33.169176 28851 raft_consensus.cc:3060] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.174525 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:33.155524 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bb4f426f62474ea61c0ccd22e639f3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:33.178023 28928 raft_consensus.cc:3060] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.179929 28851 raft_consensus.cc:2468] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:33.182212 29121 raft_consensus.cc:359] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.182919 29121 raft_consensus.cc:385] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.183175 29121 raft_consensus.cc:740] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.183287 29123 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:33.185389 28894 leader_election.cc:304] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:33.186174 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78523bc7e80a431c8097160346435949" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:33.186754 29074 raft_consensus.cc:3060] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.188611 29225 raft_consensus.cc:2804] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:33.189272 29225 raft_consensus.cc:697] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:33.189642 29123 ts_tablet_manager.cc:1403] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.441s	user 0.069s	sys 0.128s
I20260709 13:11:33.190313 29225 consensus_queue.cc:237] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.193719 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:33.192629 29123 raft_consensus.cc:359] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.195751 29123 raft_consensus.cc:385] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.196049 29123 raft_consensus.cc:740] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
W20260709 13:11:33.205567 28816 leader_election.cc:343] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:33.208566 28818 leader_election.cc:343] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:33.209827 28818 leader_election.cc:343] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.213994 29074 raft_consensus.cc:2468] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:33.216073 28818 leader_election.cc:304] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:33.224475 28928 raft_consensus.cc:2468] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:33.225081 29123 consensus_queue.cc:260] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.226025 29121 consensus_queue.cc:260] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.238095 29122 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:33.238682 29122 ts_tablet_manager.cc:1403] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.486s	user 0.111s	sys 0.161s
I20260709 13:11:33.250308 29121 ts_tablet_manager.cc:1434] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.001s
I20260709 13:11:33.242796 28749 catalog_manager.cc:5697] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.268000 29123 ts_tablet_manager.cc:1434] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.001s
I20260709 13:11:33.269274 29123 tablet_bootstrap.cc:492] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:33.278277 29122 raft_consensus.cc:359] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.278954 29122 raft_consensus.cc:385] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.279213 29122 raft_consensus.cc:740] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.280558 29122 consensus_queue.cc:260] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.236760 29305 raft_consensus.cc:2749] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:33.283430 29121 tablet_bootstrap.cc:492] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
W20260709 13:11:33.255493 29042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 44343.2us
I20260709 13:11:33.294816 29148 raft_consensus.cc:493] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.296435 28818 leader_election.cc:304] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
W20260709 13:11:33.288741 29373 log.cc:927] Time spent T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:11:33.286448 29128 raft_consensus.cc:493] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.314030 29121 tablet_bootstrap.cc:654] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.312667 29307 raft_consensus.cc:2804] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:33.308425 29148 raft_consensus.cc:515] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.311286 29128 raft_consensus.cc:515] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.312050 29378 consensus_queue.cc:1048] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:11:33.328496 29307 raft_consensus.cc:697] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:33.339392 29128 leader_election.cc:290] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:33.344795 28894 leader_election.cc:304] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:33.352865 29307 consensus_queue.cc:237] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.351953 29225 raft_consensus.cc:2749] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:33.362502 29122 ts_tablet_manager.cc:1434] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.019s
I20260709 13:11:33.362843 29123 tablet_bootstrap.cc:654] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.363489 29122 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:33.370447 29167 raft_consensus.cc:493] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.370981 29167 raft_consensus.cc:515] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.373015 29167 leader_election.cc:290] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:33.374519 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:33.376065 28892 leader_election.cc:343] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.378837 29122 tablet_bootstrap.cc:654] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.382632 28750 catalog_manager.cc:5697] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.399030 29120 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:33.400238 29120 ts_tablet_manager.cc:1403] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.509s	user 0.023s	sys 0.038s
I20260709 13:11:33.408390 29148 leader_election.cc:290] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:33.410404 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:33.412177 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:33.412967 28928 raft_consensus.cc:2393] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:33.412868 28926 raft_consensus.cc:3060] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.414143 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:33.437014 28748 catalog_manager.cc:5697] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.438400 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
W20260709 13:11:33.440264 28892 leader_election.cc:343] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.445845 29381 raft_consensus.cc:493] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.446363 29381 raft_consensus.cc:515] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.448426 29381 leader_election.cc:290] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
W20260709 13:11:33.452229 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:33.458870 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca028d51a9934f5f93f321e1f06fb783" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:33.465508 28749 catalog_manager.cc:5697] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.466888 28968 leader_election.cc:304] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:33.468276 29128 raft_consensus.cc:3060] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.474278 29121 tablet_bootstrap.cc:492] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:33.474385 29377 consensus_queue.cc:1048] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:33.474997 29121 ts_tablet_manager.cc:1403] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.016s
W20260709 13:11:33.484557 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 114432us
I20260709 13:11:33.490749 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:33.496481 28894 leader_election.cc:343] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.496944 28894 leader_election.cc:304] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:33.497402 29128 raft_consensus.cc:2749] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:33.498015 29301 raft_consensus.cc:2749] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:33.498421 28894 leader_election.cc:343] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.498929 28894 leader_election.cc:304] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:33.499876 29301 raft_consensus.cc:2749] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:33.500123 29121 raft_consensus.cc:359] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.500844 29121 raft_consensus.cc:385] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.501098 29121 raft_consensus.cc:740] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.501742 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca028d51a9934f5f93f321e1f06fb783" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:33.503136 29075 raft_consensus.cc:3060] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.505586 29042 leader_election.cc:304] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:33.511412 29120 raft_consensus.cc:359] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.512140 29120 raft_consensus.cc:385] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.512439 29120 raft_consensus.cc:740] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
W20260709 13:11:33.515483 28966 consensus_peers.cc:597] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.518164 29121 consensus_queue.cc:260] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.521059 29121 ts_tablet_manager.cc:1434] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:11:33.531065 29123 tablet_bootstrap.cc:492] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:33.531533 29123 ts_tablet_manager.cc:1403] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.263s	user 0.020s	sys 0.011s
I20260709 13:11:33.532095 29121 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:33.534053 29123 raft_consensus.cc:359] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.534631 29123 raft_consensus.cc:385] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.534895 29123 raft_consensus.cc:740] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.536698 29122 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:33.537171 29122 ts_tablet_manager.cc:1403] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.174s	user 0.007s	sys 0.009s
I20260709 13:11:33.538013 29121 tablet_bootstrap.cc:654] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.539647 29122 raft_consensus.cc:359] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.542452 29122 raft_consensus.cc:385] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.542769 29122 raft_consensus.cc:740] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.513036 29120 consensus_queue.cc:260] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.546473 29120 ts_tablet_manager.cc:1434] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.146s	user 0.005s	sys 0.001s
I20260709 13:11:33.550081 29123 consensus_queue.cc:260] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.552153 29123 ts_tablet_manager.cc:1434] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:11:33.554075 29381 raft_consensus.cc:2749] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:33.558305 29122 consensus_queue.cc:260] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.560349 29120 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:33.565761 29120 tablet_bootstrap.cc:654] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.573436 29122 ts_tablet_manager.cc:1434] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 13:11:33.574330 29122 tablet_bootstrap.cc:492] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:33.578212 29121 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:33.578707 29121 ts_tablet_manager.cc:1403] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:11:33.580904 29123 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:33.581403 29121 raft_consensus.cc:359] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.582509 29121 raft_consensus.cc:385] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.582787 29121 raft_consensus.cc:740] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.583441 29121 consensus_queue.cc:260] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.585765 29121 ts_tablet_manager.cc:1434] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:33.590327 29121 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:33.595618 29307 consensus_queue.cc:1048] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.600538 29121 tablet_bootstrap.cc:654] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.620709 29307 raft_consensus.cc:493] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.621387 29307 raft_consensus.cc:515] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.625308 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:33.625871 29307 leader_election.cc:290] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:33.625944 29002 raft_consensus.cc:2468] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:33.627439 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:33.628438 29121 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:33.629040 29121 ts_tablet_manager.cc:1403] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.006s
I20260709 13:11:33.631742 29121 raft_consensus.cc:359] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.632368 29121 raft_consensus.cc:385] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.632699 29121 raft_consensus.cc:740] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
W20260709 13:11:33.631984 28816 leader_election.cc:343] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.633610 29121 consensus_queue.cc:260] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.636940 28818 leader_election.cc:304] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:33.638526 29305 raft_consensus.cc:2804] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:33.638571 29307 consensus_queue.cc:1048] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:33.639024 29305 raft_consensus.cc:493] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.639228 29122 tablet_bootstrap.cc:654] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.639400 29305 raft_consensus.cc:3060] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.646898 29305 raft_consensus.cc:515] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.649567 28999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:33.650115 28999 raft_consensus.cc:3060] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.637192 29121 ts_tablet_manager.cc:1434] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:33.655546 29121 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:33.658192 29123 tablet_bootstrap.cc:654] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.669077 28999 raft_consensus.cc:2468] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:33.670524 28818 leader_election.cc:304] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:33.671339 29307 raft_consensus.cc:2804] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:33.671993 29307 raft_consensus.cc:697] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:33.672778 29307 consensus_queue.cc:237] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.672837 29305 leader_election.cc:290] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:33.676064 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:33.677717 28816 leader_election.cc:343] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.678014 29377 raft_consensus.cc:493] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.678622 29121 tablet_bootstrap.cc:654] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.678531 29377 raft_consensus.cc:515] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.688915 29128 consensus_queue.cc:1048] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.695955 29167 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.696406 29167 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.698349 29167 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:33.702486 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:33.704137 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:33.703382 29377 leader_election.cc:290] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
W20260709 13:11:33.707597 28966 leader_election.cc:343] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.715404 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:33.722352 29120 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:33.722879 29120 ts_tablet_manager.cc:1403] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.163s	user 0.028s	sys 0.031s
I20260709 13:11:33.726151 29120 raft_consensus.cc:359] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.726974 29120 raft_consensus.cc:385] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.727300 29120 raft_consensus.cc:740] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.728022 29120 consensus_queue.cc:260] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:33.729753 29120 ts_tablet_manager.cc:1434] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:33.730674 29120 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:33.708081 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:33.732297 28925 raft_consensus.cc:2468] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:33.733995 28968 leader_election.cc:304] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:33.737140 29120 tablet_bootstrap.cc:654] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:33.710095 28892 leader_election.cc:343] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:33.737821 28894 leader_election.cc:343] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.738973 28894 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:33.742167 29128 raft_consensus.cc:2804] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:33.751959 29128 raft_consensus.cc:493] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.752310 29128 raft_consensus.cc:3060] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.754714 28750 catalog_manager.cc:5697] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.756922 29381 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.757459 29381 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.747946 29385 raft_consensus.cc:2749] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:33.759433 29381 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:33.761327 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:33.768743 29128 raft_consensus.cc:515] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.772053 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:33.772663 28925 raft_consensus.cc:3060] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.777169 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:33.779536 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
W20260709 13:11:33.784480 28966 leader_election.cc:343] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.787175 29123 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:33.790268 29123 ts_tablet_manager.cc:1403] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.237s	user 0.011s	sys 0.007s
I20260709 13:11:33.788383 29128 leader_election.cc:290] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:33.796808 29122 tablet_bootstrap.cc:492] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:33.797338 29122 ts_tablet_manager.cc:1403] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.223s	user 0.007s	sys 0.011s
I20260709 13:11:33.789161 29042 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:33.800812 29122 raft_consensus.cc:359] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.801429 29122 raft_consensus.cc:385] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.801517 29381 raft_consensus.cc:2749] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:33.801721 29122 raft_consensus.cc:740] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.802469 29122 consensus_queue.cc:260] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.807240 29121 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:33.807082 29167 consensus_queue.cc:1048] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:33.807791 29121 ts_tablet_manager.cc:1403] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.153s	user 0.033s	sys 0.019s
I20260709 13:11:33.810288 29121 raft_consensus.cc:359] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.810922 29121 raft_consensus.cc:385] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.811209 29121 raft_consensus.cc:740] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.812500 29385 consensus_queue.cc:1048] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:33.813813 28816 consensus_peers.cc:597] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.816133 29123 raft_consensus.cc:359] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.817814 29123 raft_consensus.cc:385] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.818149 29123 raft_consensus.cc:740] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.820102 29121 consensus_queue.cc:260] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.819080 29123 consensus_queue.cc:260] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.829000 29121 ts_tablet_manager.cc:1434] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:11:33.832579 28925 raft_consensus.cc:2468] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:33.833420 29121 tablet_bootstrap.cc:492] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:33.833616 28968 leader_election.cc:304] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:33.830013 29123 ts_tablet_manager.cc:1434] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:11:33.835443 29123 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:33.846545 29121 tablet_bootstrap.cc:654] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.836438 29204 raft_consensus.cc:2804] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:33.849139 29204 raft_consensus.cc:697] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:33.850310 29123 tablet_bootstrap.cc:654] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.849938 29204 consensus_queue.cc:237] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.860275 29120 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:33.860757 29120 ts_tablet_manager.cc:1403] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.009s
I20260709 13:11:33.864719 29120 raft_consensus.cc:359] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.865428 29120 raft_consensus.cc:385] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.865775 29120 raft_consensus.cc:740] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.866986 29120 consensus_queue.cc:260] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:33.875594 29120 ts_tablet_manager.cc:1434] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:11:33.887326 29122 ts_tablet_manager.cc:1434] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.002s
I20260709 13:11:33.888861 29120 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:33.889973 29122 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:33.896463 29122 tablet_bootstrap.cc:654] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.917243 29307 consensus_queue.cc:1048] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:33.918663 28749 catalog_manager.cc:5697] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.934072 29075 raft_consensus.cc:3060] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.943225 29120 tablet_bootstrap.cc:654] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:33.955351 29121 tablet_bootstrap.cc:492] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:33.955900 29121 ts_tablet_manager.cc:1403] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.023s
I20260709 13:11:33.958662 29121 raft_consensus.cc:359] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.959295 29121 raft_consensus.cc:385] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.959589 29121 raft_consensus.cc:740] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.964423 29225 raft_consensus.cc:493] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.964674 29123 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:33.965376 29123 ts_tablet_manager.cc:1403] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.130s	user 0.027s	sys 0.020s
I20260709 13:11:33.964967 29225 raft_consensus.cc:515] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.970588 29225 leader_election.cc:290] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:33.971203 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:33.971872 29002 raft_consensus.cc:2468] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:33.972539 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:33.973253 28894 leader_election.cc:304] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:33.974049 29225 raft_consensus.cc:2804] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:33.973982 29123 raft_consensus.cc:359] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:33.974334 28892 leader_election.cc:343] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.974545 29225 raft_consensus.cc:493] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.974785 29123 raft_consensus.cc:385] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.974933 29225 raft_consensus.cc:3060] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:33.975095 29123 raft_consensus.cc:740] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.975845 29123 consensus_queue.cc:260] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.977963 29123 ts_tablet_manager.cc:1434] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:11:33.978860 29123 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:33.973016 29121 consensus_queue.cc:260] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.981189 29121 ts_tablet_manager.cc:1434] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:11:33.983906 29121 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:33.989370 29120 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:33.989837 29120 ts_tablet_manager.cc:1403] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.000s
I20260709 13:11:33.995074 29120 raft_consensus.cc:359] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.995726 29120 raft_consensus.cc:385] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:33.995981 29120 raft_consensus.cc:740] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.996330 29301 raft_consensus.cc:493] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.996625 29120 consensus_queue.cc:260] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:33.996835 29301 raft_consensus.cc:515] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:33.998754 29120 ts_tablet_manager.cc:1434] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:11:33.998868 29301 leader_election.cc:290] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:34.000161 29225 raft_consensus.cc:515] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.000823 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f5cdde3e8541db925706bec3e9bdfe" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:34.002228 29225 leader_election.cc:290] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
W20260709 13:11:34.002377 28894 leader_election.cc:343] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.003351 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:34.003966 29000 raft_consensus.cc:3060] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.005522 29121 tablet_bootstrap.cc:654] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.007998 29128 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.008472 29128 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.010298 29128 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:34.011504 29301 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.012015 29301 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.012297 29123 tablet_bootstrap.cc:654] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.015033 29301 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.016405 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:34.017058 29002 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:34.018095 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.018851 28925 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:34.020134 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.021538 29120 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:34.021037 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.022415 28894 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:34.022753 29122 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:34.023207 29122 ts_tablet_manager.cc:1403] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.003s
W20260709 13:11:34.023506 28894 leader_election.cc:343] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.027287 29375 raft_consensus.cc:493] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.027770 29375 raft_consensus.cc:515] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.028167 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:34.028414 29301 raft_consensus.cc:2804] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.028924 29301 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.029335 29301 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.029765 29375 leader_election.cc:290] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
W20260709 13:11:34.029712 28892 leader_election.cc:343] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.032068 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:34.036477 29123 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:34.036937 29123 ts_tablet_manager.cc:1403] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.001s
I20260709 13:11:34.031919 29122 raft_consensus.cc:359] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.037364 29122 raft_consensus.cc:385] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.037706 29122 raft_consensus.cc:740] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.039354 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f5cdde3e8541db925706bec3e9bdfe" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:34.043632 28892 leader_election.cc:343] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.044253 28892 leader_election.cc:304] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:34.045080 29148 raft_consensus.cc:2749] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.040863 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.046799 28925 raft_consensus.cc:2393] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:34.048038 29042 leader_election.cc:304] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:34.049064 29375 raft_consensus.cc:3060] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.052481 29000 raft_consensus.cc:2468] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:34.020820 28968 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:34.053969 29305 raft_consensus.cc:493] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.054474 29305 raft_consensus.cc:515] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.057178 28894 leader_election.cc:304] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.058126 29148 raft_consensus.cc:2804] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.058584 29148 raft_consensus.cc:697] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:34.059487 29148 consensus_queue.cc:237] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.057380 29375 raft_consensus.cc:2749] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.067260 29128 raft_consensus.cc:2804] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.067732 29128 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.068104 29128 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:34.074246 28968 leader_election.cc:343] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.077963 29123 raft_consensus.cc:359] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.078598 29123 raft_consensus.cc:385] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.078850 29123 raft_consensus.cc:740] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.084007 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.084642 28928 raft_consensus.cc:2468] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:34.086596 29121 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:34.087049 29121 ts_tablet_manager.cc:1403] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.001s
I20260709 13:11:34.089637 29121 raft_consensus.cc:359] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.090232 29121 raft_consensus.cc:385] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.090518 29121 raft_consensus.cc:740] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.091313 29121 consensus_queue.cc:260] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.092733 29121 ts_tablet_manager.cc:1434] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
W20260709 13:11:34.093163 29042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 45217.5us
I20260709 13:11:34.093539 29121 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:34.094030 29301 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.094673 29305 leader_election.cc:290] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.094321 29123 consensus_queue.cc:260] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.106957 29123 ts_tablet_manager.cc:1434] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.007s
I20260709 13:11:34.107870 29123 tablet_bootstrap.cc:492] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:34.109386 29204 raft_consensus.cc:493] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.109899 29204 raft_consensus.cc:515] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.112620 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:34.113780 28966 leader_election.cc:343] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.114964 29204 leader_election.cc:290] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:34.096052 29120 tablet_bootstrap.cc:654] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.117499 29301 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.103499 29121 tablet_bootstrap.cc:654] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.103328 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:34.104837 28818 leader_election.cc:304] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:34.119016 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:34.119334 29305 raft_consensus.cc:2804] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.119763 29305 raft_consensus.cc:493] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.120137 29305 raft_consensus.cc:3060] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:34.120378 28894 leader_election.cc:343] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:34.120524 28818 leader_election.cc:343] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.115254 29123 tablet_bootstrap.cc:654] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.122915 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.123543 28849 raft_consensus.cc:2468] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:34.128264 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:34.095108 29128 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.130036 29122 consensus_queue.cc:260] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.130633 29128 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:34.126968 28968 leader_election.cc:304] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.131536 29122 ts_tablet_manager.cc:1434] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.003s
I20260709 13:11:34.131956 29002 raft_consensus.cc:2393] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f69f6a7e69e4093b7779d80aab42eb4 in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:34.132413 29122 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:34.132618 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:34.136521 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:34.137240 28925 raft_consensus.cc:2393] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 1: Already voted for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in this term.
I20260709 13:11:34.137362 29120 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:34.137811 29120 ts_tablet_manager.cc:1403] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.001s
I20260709 13:11:34.138476 29341 raft_consensus.cc:2804] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.138962 29341 raft_consensus.cc:493] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.139886 29341 raft_consensus.cc:3060] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.152259 29305 raft_consensus.cc:515] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
W20260709 13:11:34.154507 28968 leader_election.cc:343] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.155531 28894 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:34.155671 28968 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:34.147203 29120 raft_consensus.cc:359] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.156286 29148 raft_consensus.cc:2749] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.162496 29307 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.162997 29307 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.165055 29307 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:34.167340 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.168076 28928 raft_consensus.cc:2468] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:34.168802 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:34.169529 28818 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
W20260709 13:11:34.170522 28816 leader_election.cc:343] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.158474 29123 tablet_bootstrap.cc:492] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:34.172431 29123 ts_tablet_manager.cc:1403] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.002s
I20260709 13:11:34.175406 29122 tablet_bootstrap.cc:654] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.175098 29123 raft_consensus.cc:359] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.159709 29128 raft_consensus.cc:2749] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.175776 29123 raft_consensus.cc:385] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.176251 29123 raft_consensus.cc:740] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.157425 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:34.177181 29123 consensus_queue.cc:260] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.156777 29120 raft_consensus.cc:385] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.182263 29120 raft_consensus.cc:740] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.179989 28746 catalog_manager.cc:5697] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.183060 29120 consensus_queue.cc:260] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.179210 29123 ts_tablet_manager.cc:1434] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:34.185097 29128 raft_consensus.cc:493] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.185319 29123 tablet_bootstrap.cc:492] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:34.185508 29128 raft_consensus.cc:515] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.187242 29128 leader_election.cc:290] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:34.187853 29307 raft_consensus.cc:2804] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.188264 29307 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.188596 29307 raft_consensus.cc:3060] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.192122 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:34.192494 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.193128 28849 raft_consensus.cc:2468] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
W20260709 13:11:34.193392 28966 leader_election.cc:343] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.195577 28968 leader_election.cc:304] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.197260 29120 ts_tablet_manager.cc:1434] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:11:34.197468 29128 raft_consensus.cc:2804] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.197808 29307 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:34.200332 28818 leader_election.cc:343] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.201726 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:34.203095 28816 leader_election.cc:343] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.204892 29341 raft_consensus.cc:515] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.155925 29305 leader_election.cc:290] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.205641 29120 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:34.224648 29341 leader_election.cc:290] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:34.225265 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:34.226899 28966 leader_election.cc:343] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.197890 29128 raft_consensus.cc:493] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.228216 29128 raft_consensus.cc:3060] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.211355 29122 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:34.231993 29122 ts_tablet_manager.cc:1403] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.005s
I20260709 13:11:34.232712 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:34.233321 28928 raft_consensus.cc:3060] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.235241 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:34.235854 28853 raft_consensus.cc:3060] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.205989 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:34.240012 28925 raft_consensus.cc:3060] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.217835 29121 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:34.243968 29121 ts_tablet_manager.cc:1403] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.151s	user 0.007s	sys 0.016s
I20260709 13:11:34.244870 29120 tablet_bootstrap.cc:654] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.239809 29122 raft_consensus.cc:359] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.253042 29122 raft_consensus.cc:385] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.253415 29122 raft_consensus.cc:740] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.254199 29122 consensus_queue.cc:260] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.249748 28928 raft_consensus.cc:2468] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:34.221477 29123 tablet_bootstrap.cc:654] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.222162 29307 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:34.246448 29121 raft_consensus.cc:359] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.257786 29121 raft_consensus.cc:385] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.258050 29121 raft_consensus.cc:740] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.259217 29121 consensus_queue.cc:260] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.260694 28853 raft_consensus.cc:2468] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:34.261263 29121 ts_tablet_manager.cc:1434] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:11:34.261849 28968 leader_election.cc:304] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.262143 29121 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:34.263487 29122 ts_tablet_manager.cc:1434] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.003s
I20260709 13:11:34.264451 29122 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:34.265887 29377 raft_consensus.cc:2804] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.266414 29377 raft_consensus.cc:697] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:34.267221 29377 consensus_queue.cc:237] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.268532 29121 tablet_bootstrap.cc:654] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.286281 29130 consensus_queue.cc:1048] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:34.249914 29128 raft_consensus.cc:515] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.290035 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:34.290637 29075 raft_consensus.cc:3060] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:34.294621 28816 consensus_peers.cc:597] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.297078 29073 raft_consensus.cc:3060] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.300302 29075 raft_consensus.cc:2468] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:34.301854 28966 leader_election.cc:304] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:34.304422 28925 raft_consensus.cc:2468] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:34.305658 29377 raft_consensus.cc:2804] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.308552 28750 catalog_manager.cc:5697] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.309029 29204 consensus_queue.cc:1048] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:34.308383 29128 leader_election.cc:290] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:34.307504 29377 raft_consensus.cc:697] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:34.316301 29377 consensus_queue.cc:237] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.322595 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:34.323331 28853 raft_consensus.cc:3060] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:34.325204 28818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 63890.8us
I20260709 13:11:34.330009 29120 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:34.330535 29120 ts_tablet_manager.cc:1403] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.125s	user 0.008s	sys 0.004s
I20260709 13:11:34.333789 29120 raft_consensus.cc:359] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.341524 29120 raft_consensus.cc:385] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.342653 29121 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:34.339262 29122 tablet_bootstrap.cc:654] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.343154 29121 ts_tablet_manager.cc:1403] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.020s
I20260709 13:11:34.342803 29120 raft_consensus.cc:740] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.344775 29123 tablet_bootstrap.cc:492] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:34.345355 29123 ts_tablet_manager.cc:1403] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.160s	user 0.010s	sys 0.000s
I20260709 13:11:34.345813 29121 raft_consensus.cc:359] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.346467 29121 raft_consensus.cc:385] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.346740 29121 raft_consensus.cc:740] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.352450 29121 consensus_queue.cc:260] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.356748 29121 ts_tablet_manager.cc:1434] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:11:34.357029 29120 consensus_queue.cc:260] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.357683 29121 tablet_bootstrap.cc:492] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:34.361424 28853 raft_consensus.cc:2468] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:34.371076 29305 raft_consensus.cc:493] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.371580 29305 raft_consensus.cc:515] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.373735 29305 leader_election.cc:290] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.381052 29301 raft_consensus.cc:493] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.381392 29120 ts_tablet_manager.cc:1434] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:11:34.381567 29301 raft_consensus.cc:515] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.384732 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5265c21310c410993aea23cd9588704" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.385807 28853 raft_consensus.cc:2468] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:34.388619 28894 leader_election.cc:304] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:34.389679 29148 raft_consensus.cc:2804] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.390038 29148 raft_consensus.cc:493] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.390208 29301 leader_election.cc:290] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.390368 29148 raft_consensus.cc:3060] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.391732 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5265c21310c410993aea23cd9588704" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:34.393059 28894 leader_election.cc:343] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.398140 28818 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.398941 29148 raft_consensus.cc:515] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.401145 29148 leader_election.cc:290] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.411764 29120 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:34.415776 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5265c21310c410993aea23cd9588704" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:34.416465 28849 raft_consensus.cc:3060] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.425122 29123 raft_consensus.cc:359] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.417089 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5265c21310c410993aea23cd9588704" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:34.426133 29123 raft_consensus.cc:385] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.425649 28750 catalog_manager.cc:5697] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.426482 29123 raft_consensus.cc:740] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.427150 29130 raft_consensus.cc:2804] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.439112 28849 raft_consensus.cc:2468] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
W20260709 13:11:34.427774 28894 leader_election.cc:343] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.427394 28818 leader_election.cc:304] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:34.432780 29122 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:34.448730 29122 ts_tablet_manager.cc:1403] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.008s
I20260709 13:11:34.444545 29121 tablet_bootstrap.cc:654] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:34.445070 28892 consensus_peers.cc:597] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.447356 28894 leader_election.cc:304] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
W20260709 13:11:34.429056 29426 log.cc:927] Time spent T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:34.453107 29148 raft_consensus.cc:2804] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.453745 29148 raft_consensus.cc:697] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:34.459141 29148 consensus_queue.cc:237] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.464448 29123 consensus_queue.cc:260] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.469029 29121 tablet_bootstrap.cc:492] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:34.488406 29121 ts_tablet_manager.cc:1403] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.002s
I20260709 13:11:34.472987 29341 consensus_queue.cc:1048] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:34.484306 29307 raft_consensus.cc:2804] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.492132 29307 raft_consensus.cc:697] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:34.493276 29307 consensus_queue.cc:237] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.495914 29123 ts_tablet_manager.cc:1434] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.000s
I20260709 13:11:34.491173 29121 raft_consensus.cc:359] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.496824 29121 raft_consensus.cc:385] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.497208 29121 raft_consensus.cc:740] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.498095 29121 consensus_queue.cc:260] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.451537 29122 raft_consensus.cc:359] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.500516 29121 ts_tablet_manager.cc:1434] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:34.500583 29122 raft_consensus.cc:385] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.500926 29122 raft_consensus.cc:740] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.501538 29122 consensus_queue.cc:260] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.505527 29121 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:34.511088 29341 raft_consensus.cc:493] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.511757 29341 raft_consensus.cc:515] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.513854 29341 leader_election.cc:290] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:34.515669 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:34.516017 28818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 88739us
I20260709 13:11:34.436566 29120 tablet_bootstrap.cc:654] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.518033 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5265c21310c410993aea23cd9588704" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:34.518152 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.518865 28927 raft_consensus.cc:2468] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:34.519094 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5265c21310c410993aea23cd9588704" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.496872 29123 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
W20260709 13:11:34.520314 28966 leader_election.cc:343] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.535441 29122 ts_tablet_manager.cc:1434] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:11:34.536242 29121 tablet_bootstrap.cc:654] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.541049 28968 leader_election.cc:304] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.544523 29204 raft_consensus.cc:2804] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.545023 29204 raft_consensus.cc:493] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.545475 29204 raft_consensus.cc:3060] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:34.549345 28816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 102535us
I20260709 13:11:34.551764 29122 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
W20260709 13:11:34.559926 28818 leader_election.cc:343] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.534125 29148 raft_consensus.cc:493] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.560874 29148 raft_consensus.cc:515] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.567832 29204 raft_consensus.cc:515] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.580855 29204 leader_election.cc:290] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:34.582319 28750 catalog_manager.cc:5697] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.567454 29130 raft_consensus.cc:697] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:34.596596 29123 tablet_bootstrap.cc:654] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.587900 29148 leader_election.cc:290] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:34.606590 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:34.611195 28966 leader_election.cc:343] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.599925 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:34.621305 28928 raft_consensus.cc:3060] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.599879 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.624853 29130 consensus_queue.cc:237] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.631549 29225 consensus_queue.cc:1048] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:34.634155 28894 leader_election.cc:343] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.617971 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:34.666329 29385 raft_consensus.cc:493] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.666898 29385 raft_consensus.cc:515] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.668881 29122 tablet_bootstrap.cc:654] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.669220 29385 leader_election.cc:290] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:34.663867 29121 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:34.669783 29120 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:34.669806 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:34.670421 29120 ts_tablet_manager.cc:1403] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.259s	user 0.015s	sys 0.005s
W20260709 13:11:34.671811 28894 leader_election.cc:343] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.671975 28928 raft_consensus.cc:2468] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:34.674157 29120 raft_consensus.cc:359] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.674813 29120 raft_consensus.cc:385] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.675088 29120 raft_consensus.cc:740] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
W20260709 13:11:34.676864 28892 leader_election.cc:343] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.677378 28892 leader_election.cc:304] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:34.677814 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:34.679339 29225 raft_consensus.cc:2749] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.651465 29377 raft_consensus.cc:493] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.679481 29120 consensus_queue.cc:260] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.682363 28968 leader_election.cc:304] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.680557 29377 raft_consensus.cc:515] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.683899 29341 raft_consensus.cc:2804] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.684401 29341 raft_consensus.cc:697] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
W20260709 13:11:34.685058 28892 leader_election.cc:343] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.685513 28892 leader_election.cc:304] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:34.685249 29341 consensus_queue.cc:237] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.686246 29123 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:34.686543 29225 raft_consensus.cc:2749] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.686721 29123 ts_tablet_manager.cc:1403] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.002s
I20260709 13:11:34.690075 29377 leader_election.cc:290] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:34.690321 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f5cdde3e8541db925706bec3e9bdfe" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.691036 28928 raft_consensus.cc:2468] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:34.670717 29121 ts_tablet_manager.cc:1403] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.169s	user 0.028s	sys 0.003s
I20260709 13:11:34.692178 28968 leader_election.cc:304] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:34.694128 29123 raft_consensus.cc:359] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.694845 29123 raft_consensus.cc:385] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.694139 29128 raft_consensus.cc:2804] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.695165 29123 raft_consensus.cc:740] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.695492 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f5cdde3e8541db925706bec3e9bdfe" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:34.695508 29128 raft_consensus.cc:493] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.697142 29128 raft_consensus.cc:3060] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.697957 29123 consensus_queue.cc:260] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.698163 29121 raft_consensus.cc:359] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.698868 29121 raft_consensus.cc:385] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.699134 29121 raft_consensus.cc:740] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
W20260709 13:11:34.682020 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:34.700140 29120 ts_tablet_manager.cc:1434] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:11:34.701117 29120 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:34.701766 29123 ts_tablet_manager.cc:1434] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:11:34.702598 29123 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:34.707059 29120 tablet_bootstrap.cc:654] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:34.707619 28966 leader_election.cc:343] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.719928 29121 consensus_queue.cc:260] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.706707 29128 raft_consensus.cc:515] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.727726 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f5cdde3e8541db925706bec3e9bdfe" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:34.728407 28928 raft_consensus.cc:3060] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.731252 29121 ts_tablet_manager.cc:1434] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 13:11:34.730832 28748 catalog_manager.cc:5697] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.732260 29121 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:34.738502 29121 tablet_bootstrap.cc:654] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.737706 28928 raft_consensus.cc:2468] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:34.741609 29437 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.741914 29120 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:34.742344 29120 ts_tablet_manager.cc:1403] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 13:11:34.742046 29437 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.744072 29437 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
W20260709 13:11:34.724025 28818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 160968us
I20260709 13:11:34.744927 29120 raft_consensus.cc:359] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.725576 29122 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:34.745462 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.745986 29122 ts_tablet_manager.cc:1403] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.210s	user 0.012s	sys 0.000s
I20260709 13:11:34.746153 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.747002 28927 raft_consensus.cc:2393] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:34.745584 29120 raft_consensus.cc:385] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.747983 29120 raft_consensus.cc:740] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.748180 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f5cdde3e8541db925706bec3e9bdfe" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:34.748673 29120 consensus_queue.cc:260] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:34.749531 28966 leader_election.cc:343] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.741390 28750 catalog_manager.cc:5697] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.750710 29120 ts_tablet_manager.cc:1434] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:34.749050 29042 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:34.751482 28968 leader_election.cc:304] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.751565 28818 leader_election.cc:304] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:34.751802 29437 raft_consensus.cc:3060] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.752336 29341 raft_consensus.cc:2804] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.752827 29341 raft_consensus.cc:697] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:34.752689 29128 leader_election.cc:290] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:34.753705 29341 consensus_queue.cc:237] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.755806 29130 raft_consensus.cc:2749] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.748687 29122 raft_consensus.cc:359] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.758749 29122 raft_consensus.cc:385] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.759923 29167 raft_consensus.cc:493] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.760473 29167 raft_consensus.cc:515] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:34.761993 28966 consensus_peers.cc:597] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.759037 29122 raft_consensus.cc:740] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.762816 29167 leader_election.cc:290] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:34.763373 29122 consensus_queue.cc:260] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.764587 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e7fd2f04240aa908640daf9fc53df" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:34.765231 28849 raft_consensus.cc:2468] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:34.766718 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e7fd2f04240aa908640daf9fc53df" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:34.768215 28894 leader_election.cc:304] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:34.768824 29120 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
W20260709 13:11:34.769129 28892 leader_election.cc:343] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.769927 29167 raft_consensus.cc:2804] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:34.770303 29167 raft_consensus.cc:493] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.770627 29167 raft_consensus.cc:3060] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.775012 29120 tablet_bootstrap.cc:654] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.780114 29167 raft_consensus.cc:515] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.782939 29122 ts_tablet_manager.cc:1434] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:11:34.784134 29122 tablet_bootstrap.cc:492] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:34.785815 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e7fd2f04240aa908640daf9fc53df" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:34.787725 29437 raft_consensus.cc:2749] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.788609 29377 consensus_queue.cc:1048] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:34.795111 29121 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
W20260709 13:11:34.795491 28892 leader_election.cc:343] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:34.795761 29121 ts_tablet_manager.cc:1403] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.001s
I20260709 13:11:34.797286 28749 catalog_manager.cc:5697] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.799399 29121 raft_consensus.cc:359] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.807971 29167 leader_election.cc:290] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:34.809084 29429 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.810851 29429 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.812786 29429 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:34.813601 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e7fd2f04240aa908640daf9fc53df" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:34.814191 28851 raft_consensus.cc:3060] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.800334 29121 raft_consensus.cc:385] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.818287 29121 raft_consensus.cc:740] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.819020 29121 consensus_queue.cc:260] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:34.822368 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:34.823184 29002 raft_consensus.cc:2393] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:34.823205 28851 raft_consensus.cc:2468] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:34.823629 29121 ts_tablet_manager.cc:1434] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:11:34.828089 28746 catalog_manager.cc:5697] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.829653 28894 leader_election.cc:304] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:34.832159 29148 raft_consensus.cc:2804] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:34.832764 29148 raft_consensus.cc:697] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:34.833666 29148 consensus_queue.cc:237] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:34.840448 29122 tablet_bootstrap.cc:654] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.841147 29121 tablet_bootstrap.cc:492] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:34.841935 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:34.846866 28928 raft_consensus.cc:2393] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 1: Already voted for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in this term.
I20260709 13:11:34.857568 29123 tablet_bootstrap.cc:654] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.873293 29120 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:34.873858 29120 ts_tablet_manager.cc:1403] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.105s	user 0.024s	sys 0.036s
I20260709 13:11:34.878909 29121 tablet_bootstrap.cc:654] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.880578 29341 consensus_queue.cc:1048] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:34.881693 29122 tablet_bootstrap.cc:492] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:34.882201 29122 ts_tablet_manager.cc:1403] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.002s
I20260709 13:11:34.882243 29120 raft_consensus.cc:359] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.883018 29120 raft_consensus.cc:385] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.883261 29120 raft_consensus.cc:740] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.883890 29120 consensus_queue.cc:260] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:34.884047 29341 consensus_queue.cc:1048] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:34.886032 29120 ts_tablet_manager.cc:1434] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:11:34.886878 29120 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:34.893292 29122 raft_consensus.cc:359] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.894146 29122 raft_consensus.cc:385] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.894481 29122 raft_consensus.cc:740] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.895449 29122 consensus_queue.cc:260] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.896692 28818 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:34.898029 29122 ts_tablet_manager.cc:1434] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:11:34.899125 29122 tablet_bootstrap.cc:492] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:34.901960 29429 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.905092 29122 tablet_bootstrap.cc:654] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.935281 29000 raft_consensus.cc:3060] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.940346 29148 consensus_queue.cc:1048] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:34.946775 29120 tablet_bootstrap.cc:654] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.947897 29074 raft_consensus.cc:3060] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:34.963210 29121 tablet_bootstrap.cc:492] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:34.964493 29121 ts_tablet_manager.cc:1403] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.029s
I20260709 13:11:34.964944 29148 consensus_queue.cc:1048] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:34.967293 29429 raft_consensus.cc:2749] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:34.967083 29121 raft_consensus.cc:359] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.967849 29121 raft_consensus.cc:385] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:34.968149 29121 raft_consensus.cc:740] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.969300 29121 consensus_queue.cc:260] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:34.988435 29121 ts_tablet_manager.cc:1434] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:11:34.989399 29121 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:34.995139 29121 tablet_bootstrap.cc:654] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:34.994653 28750 catalog_manager.cc:5697] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.041411 29122 tablet_bootstrap.cc:492] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:35.041875 29122 ts_tablet_manager.cc:1403] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.018s
I20260709 13:11:35.042770 29123 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:35.043304 29123 ts_tablet_manager.cc:1403] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.341s	user 0.012s	sys 0.012s
I20260709 13:11:35.044728 29122 raft_consensus.cc:359] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.045451 29122 raft_consensus.cc:385] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.045725 29122 raft_consensus.cc:740] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.046712 29122 consensus_queue.cc:260] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.049243 29122 ts_tablet_manager.cc:1434] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:11:35.053850 29122 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:35.049748 29123 raft_consensus.cc:359] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.059551 29385 raft_consensus.cc:493] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.053237 29167 raft_consensus.cc:493] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.086395 29167 raft_consensus.cc:515] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.087062 29123 raft_consensus.cc:385] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.087347 29123 raft_consensus.cc:740] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
W20260709 13:11:35.053965 28818 consensus_peers.cc:597] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.088018 29123 consensus_queue.cc:260] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.072641 29120 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:35.089607 29120 ts_tablet_manager.cc:1403] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.203s	user 0.027s	sys 0.045s
I20260709 13:11:35.083829 29429 raft_consensus.cc:493] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.094799 29429 raft_consensus.cc:515] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.099195 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:35.103226 29130 consensus_queue.cc:1048] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:35.086331 29385 raft_consensus.cc:515] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.069918 29122 tablet_bootstrap.cc:654] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.094200 29167 leader_election.cc:290] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
W20260709 13:11:35.117062 28894 leader_election.cc:343] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.119011 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:35.142997 28816 leader_election.cc:343] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.152233 29123 ts_tablet_manager.cc:1434] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.000s
I20260709 13:11:35.156682 29120 raft_consensus.cc:359] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.157712 29120 raft_consensus.cc:385] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.158068 29120 raft_consensus.cc:740] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.158856 29120 consensus_queue.cc:260] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.160939 28924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:35.161554 28924 raft_consensus.cc:2468] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:35.161793 29120 ts_tablet_manager.cc:1434] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.011s
I20260709 13:11:35.163048 29120 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:35.174026 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe7b1ea920e462e8b046d5d41f6bd8c" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:35.162526 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:35.175176 28892 leader_election.cc:343] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:35.176405 28894 leader_election.cc:343] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.176810 28894 leader_election.cc:304] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:35.162834 29429 leader_election.cc:290] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:35.180635 29167 raft_consensus.cc:2749] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:35.187690 28966 consensus_peers.cc:597] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.188144 29429 consensus_queue.cc:1048] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:11:35.192235 29204 consensus_queue.cc:1048] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:35.196151 29123 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:35.202620 29123 tablet_bootstrap.cc:654] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.204607 28818 leader_election.cc:304] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:35.205572 29120 tablet_bootstrap.cc:654] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.206272 29431 raft_consensus.cc:2804] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.206674 29431 raft_consensus.cc:493] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.206974 29431 raft_consensus.cc:3060] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.228636 29385 leader_election.cc:290] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:35.227797 29375 raft_consensus.cc:493] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.238564 29122 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:35.238981 29122 ts_tablet_manager.cc:1403] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.185s	user 0.017s	sys 0.013s
I20260709 13:11:35.252393 29120 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:35.252175 29442 consensus_queue.cc:1048] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:35.252838 29120 ts_tablet_manager.cc:1403] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.005s
I20260709 13:11:35.255348 29120 raft_consensus.cc:359] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.262956 29120 raft_consensus.cc:385] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.269956 29431 raft_consensus.cc:515] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.273422 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:35.274186 29123 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:35.274623 29121 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:35.274694 29123 ts_tablet_manager.cc:1403] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.011s
I20260709 13:11:35.275247 29121 ts_tablet_manager.cc:1403] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.286s	user 0.012s	sys 0.030s
I20260709 13:11:35.242740 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe7b1ea920e462e8b046d5d41f6bd8c" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:35.276598 28849 raft_consensus.cc:2468] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:35.277837 29123 raft_consensus.cc:359] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.242570 29375 raft_consensus.cc:515] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.278378 29121 raft_consensus.cc:359] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.278555 29123 raft_consensus.cc:385] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.279131 29121 raft_consensus.cc:385] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.279340 29123 raft_consensus.cc:740] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.281420 29123 consensus_queue.cc:260] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.279500 29121 raft_consensus.cc:740] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.280166 29375 leader_election.cc:290] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:35.282884 29122 raft_consensus.cc:359] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.282796 29121 consensus_queue.cc:260] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
W20260709 13:11:35.284195 28816 leader_election.cc:343] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.285941 29121 ts_tablet_manager.cc:1434] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:35.287740 29431 leader_election.cc:290] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:35.288079 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.289445 29075 raft_consensus.cc:3060] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.263319 29120 raft_consensus.cc:740] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.292248 29120 consensus_queue.cc:260] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.292637 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:35.293247 28927 raft_consensus.cc:3060] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.293746 29120 ts_tablet_manager.cc:1434] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:11:35.294667 29120 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:35.283476 29122 raft_consensus.cc:385] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.296242 29122 raft_consensus.cc:740] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.296998 29376 consensus_queue.cc:1048] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:35.296904 29122 consensus_queue.cc:260] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.298439 29122 ts_tablet_manager.cc:1434] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.000s
I20260709 13:11:35.299243 29122 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:35.291460 29123 ts_tablet_manager.cc:1434] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:11:35.303002 29121 tablet_bootstrap.cc:492] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:35.302165 28894 leader_election.cc:304] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:35.307652 29123 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:35.308158 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:35.309298 28928 raft_consensus.cc:2393] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:35.317715 29167 raft_consensus.cc:2804] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.318053 29167 raft_consensus.cc:493] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.318352 29167 raft_consensus.cc:3060] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.337437 29375 raft_consensus.cc:493] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.337962 29375 raft_consensus.cc:515] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.340031 29375 leader_election.cc:290] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
W20260709 13:11:35.342003 28892 consensus_peers.cc:597] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.342810 29442 raft_consensus.cc:493] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.343273 29442 raft_consensus.cc:515] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.345108 29442 leader_election.cc:290] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:35.346036 29204 consensus_queue.cc:1048] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:35.346313 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.346994 28998 raft_consensus.cc:2468] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:35.349042 29075 raft_consensus.cc:3060] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.350674 28818 leader_election.cc:304] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:35.351893 29429 raft_consensus.cc:2804] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.352257 29429 raft_consensus.cc:493] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.352552 29429 raft_consensus.cc:3060] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.363740 29120 tablet_bootstrap.cc:654] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.378198 29123 tablet_bootstrap.cc:654] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.383769 29167 raft_consensus.cc:515] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.371248 29429 raft_consensus.cc:515] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.392159 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:35.392690 29002 raft_consensus.cc:3060] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.394387 29377 raft_consensus.cc:493] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.395023 29377 raft_consensus.cc:515] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.403566 29225 raft_consensus.cc:493] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.404127 29225 raft_consensus.cc:515] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.404513 29167 leader_election.cc:290] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:35.405579 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe7b1ea920e462e8b046d5d41f6bd8c" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:35.406106 29225 leader_election.cc:290] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:35.406186 28849 raft_consensus.cc:3060] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.406819 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe7b1ea920e462e8b046d5d41f6bd8c" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:35.403290 29429 leader_election.cc:290] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
W20260709 13:11:35.408912 28892 leader_election.cc:343] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.411581 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:35.411464 29002 raft_consensus.cc:2468] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:35.412986 28818 leader_election.cc:304] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:35.413756 29429 raft_consensus.cc:2804] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.413988 28849 raft_consensus.cc:2468] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:35.414669 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:35.415318 28894 leader_election.cc:304] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:35.415704 29429 raft_consensus.cc:697] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:35.416628 29429 consensus_queue.cc:237] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.417351 29451 raft_consensus.cc:2804] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.417824 29451 raft_consensus.cc:697] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:35.418300 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.418617 29451 consensus_queue.cc:237] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:35.420166 28894 leader_election.cc:343] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:35.423147 28892 leader_election.cc:343] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.423519 28892 leader_election.cc:304] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:35.428169 29377 leader_election.cc:290] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:35.428948 29301 raft_consensus.cc:2749] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:35.429752 29301 consensus_queue.cc:1048] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:11:35.454650 29122 tablet_bootstrap.cc:654] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.455892 29042 leader_election.cc:304] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:35.468240 29120 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:35.468736 29120 ts_tablet_manager.cc:1403] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.174s	user 0.021s	sys 0.025s
I20260709 13:11:35.474438 29471 raft_consensus.cc:2749] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:35.475706 29120 raft_consensus.cc:359] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.476405 29120 raft_consensus.cc:385] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.476753 29120 raft_consensus.cc:740] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.479458 29123 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:35.479092 29120 consensus_queue.cc:260] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.480796 29123 ts_tablet_manager.cc:1403] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.173s	user 0.022s	sys 0.009s
I20260709 13:11:35.482357 29120 ts_tablet_manager.cc:1434] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:35.484319 29120 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:35.473544 28924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:35.488013 28750 catalog_manager.cc:5697] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.489867 28927 raft_consensus.cc:2468] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:35.489756 29123 raft_consensus.cc:359] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.490697 29123 raft_consensus.cc:385] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.490969 29123 raft_consensus.cc:740] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
W20260709 13:11:35.494483 29042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 45853.7us
I20260709 13:11:35.495481 29123 consensus_queue.cc:260] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.501748 28818 leader_election.cc:304] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:35.502177 29121 tablet_bootstrap.cc:654] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.503279 29442 raft_consensus.cc:2804] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.505048 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:35.512120 29130 raft_consensus.cc:493] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.520958 29123 ts_tablet_manager.cc:1434] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:11:35.522222 29123 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:35.512543 29130 raft_consensus.cc:515] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.530782 29120 tablet_bootstrap.cc:654] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.512040 29442 raft_consensus.cc:697] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
W20260709 13:11:35.540210 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 47210.9us
I20260709 13:11:35.537760 29130 leader_election.cc:290] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:35.541007 29122 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:35.541528 29122 ts_tablet_manager.cc:1403] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.242s	user 0.016s	sys 0.002s
I20260709 13:11:35.543414 29075 raft_consensus.cc:3060] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.545830 28968 leader_election.cc:304] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:35.548025 29204 raft_consensus.cc:2749] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:35.557248 28748 catalog_manager.cc:5697] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.558914 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.558236 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:35.563387 28816 leader_election.cc:343] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.566766 29442 consensus_queue.cc:237] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.575978 29121 tablet_bootstrap.cc:492] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:35.576601 29121 ts_tablet_manager.cc:1403] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.290s	user 0.011s	sys 0.023s
I20260709 13:11:35.590363 29042 leader_election.cc:304] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:35.591099 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.591974 29471 raft_consensus.cc:2749] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:35.592540 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:35.594010 28816 leader_election.cc:343] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.601570 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:35.603075 28816 leader_election.cc:343] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.611255 28998 raft_consensus.cc:3060] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.616577 29123 tablet_bootstrap.cc:654] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.621999 29122 raft_consensus.cc:359] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.624578 29122 raft_consensus.cc:385] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.624969 29122 raft_consensus.cc:740] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.625710 29122 consensus_queue.cc:260] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.631354 29122 ts_tablet_manager.cc:1434] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.090s	user 0.002s	sys 0.004s
I20260709 13:11:35.632253 29122 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:35.633826 29121 raft_consensus.cc:359] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.634862 29121 raft_consensus.cc:385] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.635142 29121 raft_consensus.cc:740] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.635840 29121 consensus_queue.cc:260] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.643074 29120 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:35.643739 29120 ts_tablet_manager.cc:1403] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.160s	user 0.031s	sys 0.015s
I20260709 13:11:35.647329 29120 raft_consensus.cc:359] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.648195 29120 raft_consensus.cc:385] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.648521 29120 raft_consensus.cc:740] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.649417 29120 consensus_queue.cc:260] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.652807 29121 ts_tablet_manager.cc:1434] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:11:35.653934 29121 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:35.659225 29122 tablet_bootstrap.cc:654] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.659953 29120 ts_tablet_manager.cc:1434] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:11:35.660939 29120 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
W20260709 13:11:35.663161 28818 leader_election.cc:343] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.663632 28818 leader_election.cc:304] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:35.664700 29442 raft_consensus.cc:2749] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:35.672894 29120 tablet_bootstrap.cc:654] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.692631 29442 raft_consensus.cc:493] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.693315 29442 raft_consensus.cc:515] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.697619 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:35.698312 29120 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:35.698580 29122 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:35.698771 29120 ts_tablet_manager.cc:1403] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:11:35.699062 29122 ts_tablet_manager.cc:1403] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.012s
I20260709 13:11:35.701509 29120 raft_consensus.cc:359] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.702168 29120 raft_consensus.cc:385] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.702425 29120 raft_consensus.cc:740] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.702996 29120 consensus_queue.cc:260] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.705174 29120 ts_tablet_manager.cc:1434] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:11:35.706001 29120 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:35.706436 28745 catalog_manager.cc:5697] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.698201 28923 raft_consensus.cc:2468] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:35.709213 28818 leader_election.cc:304] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:35.709986 29130 raft_consensus.cc:2804] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.710328 29130 raft_consensus.cc:493] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.710381 29442 leader_election.cc:290] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:35.710691 29130 raft_consensus.cc:3060] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.710937 29122 raft_consensus.cc:359] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.711583 29122 raft_consensus.cc:385] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.711849 29122 raft_consensus.cc:740] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.712522 29122 consensus_queue.cc:260] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.717255 29130 raft_consensus.cc:515] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.720443 29123 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:35.721122 29123 ts_tablet_manager.cc:1403] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.012s
I20260709 13:11:35.723047 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:35.723696 28923 raft_consensus.cc:3060] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.727811 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.728284 29471 raft_consensus.cc:493] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.728470 29002 raft_consensus.cc:2468] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:35.728765 29471 raft_consensus.cc:515] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.730800 29471 leader_election.cc:290] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:35.731330 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:35.731913 29002 raft_consensus.cc:3060] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.732431 28999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.734265 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:35.732753 28923 raft_consensus.cc:2468] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:35.735628 29122 ts_tablet_manager.cc:1434] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:11:35.734501 29120 tablet_bootstrap.cc:654] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.738003 29002 raft_consensus.cc:2468] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:35.735749 28818 leader_election.cc:304] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:35.728771 29130 leader_election.cc:290] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:35.740973 29122 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:35.741485 29042 leader_election.cc:304] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:35.740890 29431 raft_consensus.cc:2804] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.742739 29431 raft_consensus.cc:697] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:35.743571 29431 consensus_queue.cc:237] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.747225 29122 tablet_bootstrap.cc:654] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.742285 29471 raft_consensus.cc:2749] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:35.748467 29121 tablet_bootstrap.cc:654] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.749193 29225 raft_consensus.cc:493] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.759407 29225 raft_consensus.cc:515] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.763882 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:35.765228 28894 leader_election.cc:343] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.767894 29123 raft_consensus.cc:359] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.768524 29123 raft_consensus.cc:385] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.768785 29123 raft_consensus.cc:740] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.761328 29225 leader_election.cc:290] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:35.770140 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:35.770774 28851 raft_consensus.cc:2468] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 0.
I20260709 13:11:35.772119 28894 leader_election.cc:304] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:35.772972 29167 raft_consensus.cc:2804] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.773319 29167 raft_consensus.cc:493] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.773602 29167 raft_consensus.cc:3060] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.775920 28745 catalog_manager.cc:5697] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.784188 29167 raft_consensus.cc:515] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.784489 29123 consensus_queue.cc:260] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:35.787304 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:35.787019 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:35.789268 29167 leader_election.cc:290] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:35.790096 28851 raft_consensus.cc:3060] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.792552 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
W20260709 13:11:35.793642 28894 leader_election.cc:343] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.798216 29121 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:35.798573 29121 ts_tablet_manager.cc:1403] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.000s
I20260709 13:11:35.802102 29123 ts_tablet_manager.cc:1434] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.003s
I20260709 13:11:35.802836 29123 tablet_bootstrap.cc:492] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:35.801002 29121 raft_consensus.cc:359] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.804270 29121 raft_consensus.cc:385] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.804646 29121 raft_consensus.cc:740] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.814812 29076 raft_consensus.cc:3060] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.822058 28851 raft_consensus.cc:2468] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:35.826171 29121 consensus_queue.cc:260] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.835371 29121 ts_tablet_manager.cc:1434] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:11:35.838339 29121 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:35.841856 29225 raft_consensus.cc:493] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.842226 29123 tablet_bootstrap.cc:654] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.842355 29225 raft_consensus.cc:515] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.846163 29122 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:35.846596 29122 ts_tablet_manager.cc:1403] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.106s	user 0.030s	sys 0.019s
I20260709 13:11:35.841148 28894 leader_election.cc:304] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:35.851011 29167 raft_consensus.cc:2804] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.851457 29167 raft_consensus.cc:697] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:35.852188 29167 consensus_queue.cc:237] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.865252 29121 tablet_bootstrap.cc:654] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.868187 29120 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:35.868657 29120 ts_tablet_manager.cc:1403] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.007s
I20260709 13:11:35.867092 29225 leader_election.cc:290] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:35.871116 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a49b8cb161469c804c3693d6642483" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:35.872648 28892 leader_election.cc:343] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.867311 29122 raft_consensus.cc:359] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.874647 29122 raft_consensus.cc:385] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.874925 29122 raft_consensus.cc:740] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.875612 29122 consensus_queue.cc:260] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:35.877731 29122 ts_tablet_manager.cc:1434] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:11:35.878602 29122 tablet_bootstrap.cc:492] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:35.871356 29120 raft_consensus.cc:359] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.882776 29120 raft_consensus.cc:385] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.882709 29301 consensus_queue.cc:1048] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:35.883211 29120 raft_consensus.cc:740] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.885078 29120 consensus_queue.cc:260] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.887012 29120 ts_tablet_manager.cc:1434] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:11:35.887957 29123 tablet_bootstrap.cc:492] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:35.888438 29123 ts_tablet_manager.cc:1403] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.086s	user 0.004s	sys 0.006s
I20260709 13:11:35.890297 29120 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:35.888497 29075 raft_consensus.cc:3060] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.900272 29123 raft_consensus.cc:359] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.900928 29123 raft_consensus.cc:385] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.901203 29123 raft_consensus.cc:740] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.902813 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a49b8cb161469c804c3693d6642483" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:35.908951 29122 tablet_bootstrap.cc:654] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.912988 29123 consensus_queue.cc:260] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.916708 29123 ts_tablet_manager.cc:1434] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:11:35.917560 29123 tablet_bootstrap.cc:492] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:35.924374 29120 tablet_bootstrap.cc:654] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:35.925695 28892 consensus_peers.cc:597] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.928932 29122 tablet_bootstrap.cc:492] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:35.929409 29122 ts_tablet_manager.cc:1403] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.002s
I20260709 13:11:35.930574 29121 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:35.931169 29121 ts_tablet_manager.cc:1403] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.093s	user 0.005s	sys 0.008s
I20260709 13:11:35.931605 29482 raft_consensus.cc:493] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.932096 29482 raft_consensus.cc:515] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:35.933924 29123 tablet_bootstrap.cc:654] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.934082 29482 leader_election.cc:290] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:35.934443 29121 raft_consensus.cc:359] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.935190 29121 raft_consensus.cc:385] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.935432 29121 raft_consensus.cc:740] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.936053 29121 consensus_queue.cc:260] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:35.936846 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:35.937072 29122 raft_consensus.cc:359] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.937750 29122 raft_consensus.cc:385] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.938105 29121 ts_tablet_manager.cc:1434] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:35.938002 29122 raft_consensus.cc:740] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.939082 29122 consensus_queue.cc:260] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.939206 29121 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4: Bootstrap starting.
I20260709 13:11:35.937984 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:35.952488 28851 raft_consensus.cc:2468] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
W20260709 13:11:35.939294 28966 leader_election.cc:343] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:35.953629 29122 ts_tablet_manager.cc:1434] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:11:35.943361 29431 consensus_queue.cc:1048] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:35.954757 29122 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:35.946529 29123 tablet_bootstrap.cc:492] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:35.956514 29123 ts_tablet_manager.cc:1403] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 13:11:35.957351 28968 leader_election.cc:304] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:35.958719 29482 raft_consensus.cc:2804] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:35.959071 29482 raft_consensus.cc:493] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.959546 29482 raft_consensus.cc:3060] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.959245 29123 raft_consensus.cc:359] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.962014 29123 raft_consensus.cc:385] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.962337 29123 raft_consensus.cc:740] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.962971 29123 consensus_queue.cc:260] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:35.965042 29123 ts_tablet_manager.cc:1434] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:35.965893 29123 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:35.959122 29121 tablet_bootstrap.cc:654] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.969781 29076 raft_consensus.cc:3060] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.976759 29122 tablet_bootstrap.cc:654] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.979010 29431 consensus_queue.cc:1048] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:35.989078 29122 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:35.989643 29122 ts_tablet_manager.cc:1403] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:11:35.994834 29123 tablet_bootstrap.cc:654] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:35.996459 28816 consensus_peers.cc:597] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.004040 29122 raft_consensus.cc:359] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:36.004411 28894 leader_election.cc:343] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.004740 29122 raft_consensus.cc:385] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.004828 28894 leader_election.cc:304] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:36.005023 29122 raft_consensus.cc:740] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.008083 29122 consensus_queue.cc:260] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.010615 29123 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:36.011075 29123 ts_tablet_manager.cc:1403] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:11:36.013530 29123 raft_consensus.cc:359] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.014086 29123 raft_consensus.cc:385] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.014348 29123 raft_consensus.cc:740] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.017484 29122 ts_tablet_manager.cc:1434] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:11:36.021919 29122 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:36.025578 29123 consensus_queue.cc:260] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.026069 29128 raft_consensus.cc:493] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.026511 29128 raft_consensus.cc:515] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.044098 29128 leader_election.cc:290] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
W20260709 13:11:36.046635 28892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 85582.9us
I20260709 13:11:36.047477 29122 tablet_bootstrap.cc:654] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.048352 29167 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.061268 29167 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.063073 29167 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:36.051537 29130 consensus_queue.cc:1048] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:11:36.058522 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:36.055876 29442 raft_consensus.cc:493] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.065150 29442 raft_consensus.cc:515] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.067152 29442 leader_election.cc:290] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
W20260709 13:11:36.069531 28966 leader_election.cc:343] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.072194 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:36.073586 28816 leader_election.cc:343] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.075608 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:36.077366 28818 leader_election.cc:343] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.078008 29073 raft_consensus.cc:3060] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.077914 28818 leader_election.cc:304] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:36.079716 29130 raft_consensus.cc:2749] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:36.101742 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 143272us
W20260709 13:11:36.104794 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 100406us
I20260709 13:11:36.106002 29167 raft_consensus.cc:2749] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:36.110911 29167 raft_consensus.cc:493] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.111424 29167 raft_consensus.cc:515] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.113508 29167 leader_election.cc:290] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:35.972874 29482 raft_consensus.cc:515] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.130973 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:36.131574 28928 raft_consensus.cc:2468] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:36.135403 29167 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.135959 29167 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:36.139843 29442 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.140493 29442 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:36.143280 29442 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:36.144521 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:36.145117 28925 raft_consensus.cc:2468] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:36.145272 29074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:36.146263 28818 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:36.147028 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:36.147136 28816 leader_election.cc:343] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:36.148851 28892 leader_election.cc:343] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.149690 29442 raft_consensus.cc:2804] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.150177 29442 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.150552 29442 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.155872 29167 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:36.172060 29442 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:36.175362 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:36.182464 28816 leader_election.cc:343] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.184636 28747 catalog_manager.cc:5697] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:36.194104 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 87281.3us
I20260709 13:11:36.204375 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:36.205893 28966 leader_election.cc:343] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.210990 29122 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:36.211475 29122 ts_tablet_manager.cc:1403] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.021s
I20260709 13:11:36.214150 29122 raft_consensus.cc:359] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.224443 29122 raft_consensus.cc:385] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.224735 29122 raft_consensus.cc:740] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.225430 29431 consensus_queue.cc:1048] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.230098 29122 consensus_queue.cc:260] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.242134 29122 ts_tablet_manager.cc:1434] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.003s
I20260709 13:11:36.245900 29122 tablet_bootstrap.cc:492] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:36.245970 29123 ts_tablet_manager.cc:1434] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.235s	user 0.006s	sys 0.053s
I20260709 13:11:36.246963 29123 tablet_bootstrap.cc:492] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:36.243037 29471 raft_consensus.cc:493] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.250989 29471 raft_consensus.cc:515] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.231462 29482 leader_election.cc:290] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:36.250174 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:36.252950 29002 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:36.256312 29471 leader_election.cc:290] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:36.257774 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:36.260294 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:36.263221 28968 leader_election.cc:304] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:36.260967 28998 raft_consensus.cc:2393] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:36.260968 28849 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:36.266053 28852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:36.267575 29376 raft_consensus.cc:2804] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.267970 29376 raft_consensus.cc:493] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.268162 29120 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:36.268318 29376 raft_consensus.cc:3060] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.268698 29120 ts_tablet_manager.cc:1403] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.379s	user 0.055s	sys 0.038s
I20260709 13:11:36.278697 29376 raft_consensus.cc:515] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.279230 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:36.280026 28850 raft_consensus.cc:2393] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f69f6a7e69e4093b7779d80aab42eb4 in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:36.282258 29073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:36.283825 28850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:36.284494 28850 raft_consensus.cc:2468] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 0.
I20260709 13:11:36.287222 29123 tablet_bootstrap.cc:654] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:36.289812 28966 leader_election.cc:343] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.291155 29042 leader_election.cc:304] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:36.287883 29122 tablet_bootstrap.cc:654] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.271217 29120 raft_consensus.cc:359] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.296880 29120 raft_consensus.cc:385] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.297178 29120 raft_consensus.cc:740] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.297854 29120 consensus_queue.cc:260] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.291177 29376 leader_election.cc:290] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:36.294203 29471 raft_consensus.cc:2804] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.309813 29120 ts_tablet_manager.cc:1434] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:11:36.310443 28894 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
W20260709 13:11:36.314597 28894 leader_election.cc:343] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.315682 28894 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:36.317914 29128 raft_consensus.cc:493] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.318531 29128 raft_consensus.cc:515] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.321165 29167 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.325875 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:36.296613 29442 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:36.342026 29128 leader_election.cc:290] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:36.345644 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:36.316855 28925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:36.349131 29120 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:36.317685 29471 raft_consensus.cc:493] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.368110 29471 raft_consensus.cc:3060] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.353863 29121 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4: No bootstrap required, opened a new log
I20260709 13:11:36.326033 29385 raft_consensus.cc:2804] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:36.368747 29385 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.369110 29385 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.366513 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:36.371719 28848 raft_consensus.cc:3060] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.374464 29442 consensus_queue.cc:1048] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.375913 29121 ts_tablet_manager.cc:1403] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent bootstrapping tablet: real 0.437s	user 0.101s	sys 0.131s
W20260709 13:11:36.384502 29042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 86475.8us
I20260709 13:11:36.383567 29167 raft_consensus.cc:2749] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:36.395534 29130 raft_consensus.cc:493] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.395991 29130 raft_consensus.cc:515] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.352080 28924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:36.429913 29121 raft_consensus.cc:359] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:36.430609 29121 raft_consensus.cc:385] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.430881 29121 raft_consensus.cc:740] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.425864 28924 raft_consensus.cc:3060] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.452349 29130 leader_election.cc:290] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:36.431572 29121 consensus_queue.cc:260] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:36.460112 29121 ts_tablet_manager.cc:1434] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.000s
W20260709 13:11:36.461290 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 136704us
W20260709 13:11:36.462673 28894 leader_election.cc:343] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.463156 28894 leader_election.cc:304] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:36.480892 29120 tablet_bootstrap.cc:654] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.483001 29301 raft_consensus.cc:2749] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:36.524863 28925 raft_consensus.cc:2468] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:36.534889 29385 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.537350 29385 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:36.538878 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:36.539968 28849 raft_consensus.cc:2393] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 1: Already voted for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in this term.
W20260709 13:11:36.542865 28816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 134487us
I20260709 13:11:36.502311 29525 raft_consensus.cc:493] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.547065 28968 leader_election.cc:304] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:36.556017 29204 raft_consensus.cc:3060] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.559373 28848 raft_consensus.cc:2468] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:36.525166 29376 raft_consensus.cc:493] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.563406 29204 raft_consensus.cc:2749] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:36.543303 28924 raft_consensus.cc:2468] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:36.570879 28968 leader_election.cc:304] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:36.573884 29123 tablet_bootstrap.cc:492] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:36.574471 29123 ts_tablet_manager.cc:1403] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.328s	user 0.020s	sys 0.028s
I20260709 13:11:36.577080 29128 raft_consensus.cc:2804] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.577672 29128 raft_consensus.cc:697] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:36.578572 29128 consensus_queue.cc:237] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.604044 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:36.564293 29376 raft_consensus.cc:515] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.550872 29525 raft_consensus.cc:515] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.584939 29471 raft_consensus.cc:515] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.631438 28968 leader_election.cc:304] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:36.642652 29120 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:36.643119 29120 ts_tablet_manager.cc:1403] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.294s	user 0.015s	sys 0.006s
I20260709 13:11:36.646001 29120 raft_consensus.cc:359] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.646629 29120 raft_consensus.cc:385] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.643277 29123 raft_consensus.cc:359] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.647615 29123 raft_consensus.cc:385] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.647907 29123 raft_consensus.cc:740] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.646919 29120 raft_consensus.cc:740] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.634204 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:36.637639 29510 raft_consensus.cc:2804] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.639734 29067 raft_consensus.cc:3060] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.663019 29123 consensus_queue.cc:260] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.665478 29301 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.665983 29376 leader_election.cc:290] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:36.663057 29510 raft_consensus.cc:697] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:36.667126 29510 consensus_queue.cc:237] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.679068 29120 consensus_queue.cc:260] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:36.660796 28927 raft_consensus.cc:2468] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:36.707945 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:36.709478 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 231705us
I20260709 13:11:36.702355 29122 tablet_bootstrap.cc:492] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:36.711279 29120 ts_tablet_manager.cc:1434] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:11:36.665978 29301 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:36.731276 29122 ts_tablet_manager.cc:1403] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.486s	user 0.015s	sys 0.021s
I20260709 13:11:36.712090 29123 ts_tablet_manager.cc:1434] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.137s	user 0.008s	sys 0.000s
I20260709 13:11:36.719465 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:36.738169 29123 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
W20260709 13:11:36.712371 28818 leader_election.cc:343] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.740119 28818 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:36.742015 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:36.742568 29002 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.736408 29471 leader_election.cc:290] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:36.745935 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:36.747099 28853 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.751142 28999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:36.752488 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:36.753262 28844 raft_consensus.cc:2393] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:36.755141 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:36.759382 28923 raft_consensus.cc:2468] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:36.759878 29528 raft_consensus.cc:2804] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:36.764658 28853 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:36.765746 29042 leader_election.cc:304] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:36.772392 29002 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:36.797350 28968 leader_election.cc:304] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:36.798995 29301 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:36.784005 29471 raft_consensus.cc:2749] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:36.799770 29540 raft_consensus.cc:2804] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.800294 29540 raft_consensus.cc:493] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.800654 29540 raft_consensus.cc:3060] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:36.808713 29536 log.cc:927] Time spent T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:36.812852 29122 raft_consensus.cc:359] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.813822 29122 raft_consensus.cc:385] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.814143 29122 raft_consensus.cc:740] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.827684 29525 leader_election.cc:290] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:36.828145 29123 tablet_bootstrap.cc:654] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.828522 29122 consensus_queue.cc:260] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.831254 29541 raft_consensus.cc:493] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.832365 29120 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:36.833606 29122 ts_tablet_manager.cc:1434] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.001s
I20260709 13:11:36.835049 29122 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:36.841638 29540 raft_consensus.cc:515] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.832667 29541 raft_consensus.cc:515] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.843844 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
W20260709 13:11:36.836163 28966 leader_election.cc:343] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:36.865851 28818 leader_election.cc:304] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:36.868702 29130 raft_consensus.cc:2804] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:36.869143 29130 raft_consensus.cc:493] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.869504 29130 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.844254 29540 leader_election.cc:290] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:36.849932 29528 raft_consensus.cc:697] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:36.878140 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:36.889652 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 144688us
I20260709 13:11:36.893924 29541 leader_election.cc:290] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
W20260709 13:11:36.898373 28966 leader_election.cc:343] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:36.904222 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:36.903963 28894 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:36.914948 29167 consensus_queue.cc:1048] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.917757 29518 raft_consensus.cc:493] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.918365 29301 raft_consensus.cc:2804] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.918262 29518 raft_consensus.cc:515] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:36.918892 29301 raft_consensus.cc:697] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:36.919871 29042 leader_election.cc:304] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:36.919780 29301 consensus_queue.cc:237] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.920341 29518 leader_election.cc:290] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:36.922290 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:36.922892 29120 tablet_bootstrap.cc:654] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.927989 29130 raft_consensus.cc:515] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:36.931277 29167 consensus_queue.cc:1048] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:36.933122 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b8e0e7bf241b881fcd9238c779010" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:36.936350 28928 raft_consensus.cc:2393] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:36.941653 29122 tablet_bootstrap.cc:654] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.942791 29042 leader_election.cc:304] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:36.946228 29471 raft_consensus.cc:3060] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.946161 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:36.914476 29528 consensus_queue.cc:237] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:36.950453 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:36.951032 28921 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:36.954881 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a49b8cb161469c804c3693d6642483" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
W20260709 13:11:37.048228 28894 leader_election.cc:343] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.050560 29130 leader_election.cc:290] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
W20260709 13:11:37.048743 28818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 92397.5us
I20260709 13:11:37.048530 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:37.042291 29518 raft_consensus.cc:2749] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.051304 28922 raft_consensus.cc:2468] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:37.063031 28926 raft_consensus.cc:3060] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.090102 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:37.094430 28921 raft_consensus.cc:2468] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:37.094738 29471 raft_consensus.cc:2749] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:37.105185 28892 leader_election.cc:343] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.105921 28892 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:37.100580 28968 leader_election.cc:304] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:37.113031 29123 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:37.113663 29123 ts_tablet_manager.cc:1403] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.376s	user 0.014s	sys 0.005s
I20260709 13:11:37.125007 29120 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: No bootstrap required, opened a new log
I20260709 13:11:37.125492 29120 ts_tablet_manager.cc:1403] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.293s	user 0.025s	sys 0.022s
I20260709 13:11:37.132417 29538 consensus_queue.cc:1048] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:37.134760 29120 raft_consensus.cc:359] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.135316 29509 raft_consensus.cc:2804] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.136018 29509 raft_consensus.cc:493] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.135500 29120 raft_consensus.cc:385] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.136665 29120 raft_consensus.cc:740] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.137348 29120 consensus_queue.cc:260] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.149894 29123 raft_consensus.cc:359] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.151526 29123 raft_consensus.cc:385] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.151939 29123 raft_consensus.cc:740] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.152611 29123 consensus_queue.cc:260] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.154232 29123 ts_tablet_manager.cc:1434] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 13:11:37.155167 29123 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:37.163407 29122 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:37.165000 29122 ts_tablet_manager.cc:1403] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.330s	user 0.013s	sys 0.010s
I20260709 13:11:37.136386 29509 raft_consensus.cc:3060] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.170892 29120 ts_tablet_manager.cc:1434] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:11:37.178192 29520 raft_consensus.cc:2749] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.197496 28926 raft_consensus.cc:2468] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:37.208788 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a49b8cb161469c804c3693d6642483" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:37.211006 29122 raft_consensus.cc:359] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.211728 29122 raft_consensus.cc:385] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.211998 29122 raft_consensus.cc:740] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.212533 29122 consensus_queue.cc:260] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.214222 29122 ts_tablet_manager.cc:1434] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.000s
I20260709 13:11:37.214252 29509 raft_consensus.cc:515] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:37.221455 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a49b8cb161469c804c3693d6642483" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:37.221782 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a49b8cb161469c804c3693d6642483" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:37.222098 28922 raft_consensus.cc:3060] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.231865 28922 raft_consensus.cc:2468] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:37.234715 28968 leader_election.cc:304] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:37.235777 29509 leader_election.cc:290] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:37.236837 29538 raft_consensus.cc:2804] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.237634 29538 raft_consensus.cc:697] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:37.238427 29538 consensus_queue.cc:237] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
W20260709 13:11:37.244763 28966 leader_election.cc:343] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:37.246434 28966 leader_election.cc:343] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.262733 29122 tablet_bootstrap.cc:492] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:37.263222 29123 tablet_bootstrap.cc:654] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.271790 29122 tablet_bootstrap.cc:654] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.276190 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:37.287042 29122 tablet_bootstrap.cc:492] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:37.287683 29122 ts_tablet_manager.cc:1403] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.006s
I20260709 13:11:37.291399 29122 raft_consensus.cc:359] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:37.292310 29122 raft_consensus.cc:385] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.292629 29122 raft_consensus.cc:740] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.293951 29122 consensus_queue.cc:260] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:37.296294 29122 ts_tablet_manager.cc:1434] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:37.297778 29122 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:37.298825 29538 consensus_queue.cc:1048] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.305361 29122 tablet_bootstrap.cc:654] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:37.309305 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 68825.6us
I20260709 13:11:37.220937 28749 catalog_manager.cc:5697] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.381315 28968 leader_election.cc:304] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:37.400751 29204 raft_consensus.cc:493] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.401962 29204 raft_consensus.cc:515] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.402732 29128 raft_consensus.cc:2804] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.405916 29204 leader_election.cc:290] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:37.403558 29128 raft_consensus.cc:697] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:37.414898 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:37.419924 28966 leader_election.cc:343] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.438442 29122 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:37.412002 29128 consensus_queue.cc:237] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:37.426740 29530 raft_consensus.cc:493] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.447520 29530 raft_consensus.cc:515] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.450239 29530 leader_election.cc:290] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:37.431196 29123 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:37.435320 29511 consensus_queue.cc:1048] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:37.451453 29123 ts_tablet_manager.cc:1403] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.296s	user 0.026s	sys 0.019s
I20260709 13:11:37.444123 28998 raft_consensus.cc:1275] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:37.461880 29122 ts_tablet_manager.cc:1403] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.164s	user 0.010s	sys 0.009s
W20260709 13:11:37.471004 28818 leader_election.cc:343] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.473582 28818 leader_election.cc:304] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:37.474865 29527 raft_consensus.cc:2804] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.477787 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:37.505039 28849 raft_consensus.cc:2468] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 0.
I20260709 13:11:37.487164 29071 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.474812 28748 catalog_manager.cc:5697] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.489449 29123 raft_consensus.cc:359] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.492298 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:37.484503 29521 consensus_queue.cc:1048] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:37.518026 28816 leader_election.cc:343] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.513281 29527 raft_consensus.cc:697] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:37.519819 29527 consensus_queue.cc:237] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:37.510499 29123 raft_consensus.cc:385] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.521574 29538 consensus_queue.cc:1048] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:37.503504 29122 raft_consensus.cc:359] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.526767 29525 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.529794 29123 raft_consensus.cc:740] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.530470 29122 raft_consensus.cc:385] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.530789 29122 raft_consensus.cc:740] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.528487 29530 consensus_queue.cc:1048] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:37.531415 29525 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.531947 28849 raft_consensus.cc:1275] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:37.534806 28968 leader_election.cc:304] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:37.535766 29123 consensus_queue.cc:260] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.540656 29122 consensus_queue.cc:260] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.542636 28996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:37.543500 28996 raft_consensus.cc:2468] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:37.544158 29564 raft_consensus.cc:2804] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.544667 29564 raft_consensus.cc:493] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.545130 29564 raft_consensus.cc:3060] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.546181 29525 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:37.536897 28748 catalog_manager.cc:5697] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.552042 28818 leader_election.cc:304] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:37.553556 29530 raft_consensus.cc:2804] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.553972 29530 raft_consensus.cc:493] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.554291 29530 raft_consensus.cc:3060] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.554965 29123 ts_tablet_manager.cc:1434] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.103s	user 0.011s	sys 0.000s
I20260709 13:11:37.556865 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:37.542642 29521 consensus_queue.cc:1048] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:11:37.587581 29431 consensus_queue.cc:1048] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:11:37.594148 29122 ts_tablet_manager.cc:1434] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.132s	user 0.007s	sys 0.003s
I20260709 13:11:37.601465 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:37.602313 28922 raft_consensus.cc:2468] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:37.605561 29042 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:37.605999 29123 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e: Bootstrap starting.
I20260709 13:11:37.614861 29525 raft_consensus.cc:2804] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:37.616775 29122 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:37.618076 29525 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:37.621636 29525 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.634768 29564 raft_consensus.cc:515] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.680795 29518 raft_consensus.cc:493] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.681100 29564 leader_election.cc:290] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:37.681504 29518 raft_consensus.cc:515] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:37.687599 29518 leader_election.cc:290] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:37.691370 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:37.692349 28923 raft_consensus.cc:2393] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:37.692941 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:37.693712 28851 raft_consensus.cc:3060] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.693984 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:37.694584 29123 tablet_bootstrap.cc:654] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.714488 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab59da765c8447b186cb5d144d71bab8" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:37.712848 29525 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.717564 29042 leader_election.cc:304] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:37.718693 29518 raft_consensus.cc:3060] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.720212 29541 consensus_queue.cc:1048] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:37.722424 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:37.717662 29072 raft_consensus.cc:1240] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Rejecting Update request from peer c2d8ce5db69d488bac364452e3c87684 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:37.723877 29525 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
W20260709 13:11:37.727898 28966 leader_election.cc:343] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.730486 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:37.730309 29547 consensus_queue.cc:1059] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:37.731479 29547 raft_consensus.cc:3055] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.731926 29547 raft_consensus.cc:740] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:37.733340 29042 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:37.733106 29547 consensus_queue.cc:260] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.734148 29525 raft_consensus.cc:2749] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:37.734539 29547 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:37.735112 28966 consensus_peers.cc:597] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e -> Peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Couldn't send request to peer 1b99cdfeeb2f418fa34b0ac78532b59c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.735827 29530 raft_consensus.cc:515] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.738027 29530 leader_election.cc:290] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:37.739318 28996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:37.740124 28996 raft_consensus.cc:3060] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.741487 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:37.745668 29122 tablet_bootstrap.cc:654] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:37.743889 28816 leader_election.cc:343] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.798332 28851 raft_consensus.cc:2468] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:37.800252 28968 leader_election.cc:304] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:37.802901 29541 raft_consensus.cc:2804] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.804327 29541 raft_consensus.cc:697] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:37.809724 29541 consensus_queue.cc:237] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.811170 29518 raft_consensus.cc:2749] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.821776 29122 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:37.822379 29122 ts_tablet_manager.cc:1403] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.206s	user 0.002s	sys 0.018s
I20260709 13:11:37.827049 29122 raft_consensus.cc:359] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.827812 29122 raft_consensus.cc:385] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.828159 29122 raft_consensus.cc:740] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.830118 29122 consensus_queue.cc:260] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.839298 29067 raft_consensus.cc:3060] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.843696 29123 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e: No bootstrap required, opened a new log
I20260709 13:11:37.852301 29123 ts_tablet_manager.cc:1403] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e: Time spent bootstrapping tablet: real 0.247s	user 0.019s	sys 0.008s
I20260709 13:11:37.851728 29122 ts_tablet_manager.cc:1434] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:11:37.854553 29122 tablet_bootstrap.cc:492] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:37.861806 29123 raft_consensus.cc:359] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:37.862556 29123 raft_consensus.cc:385] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.862886 29123 raft_consensus.cc:740] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.863785 29123 consensus_queue.cc:260] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:37.818424 28996 raft_consensus.cc:2468] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:37.864197 29541 consensus_queue.cc:1048] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:37.866019 29122 tablet_bootstrap.cc:654] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.867962 28818 leader_election.cc:304] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:37.869302 29547 raft_consensus.cc:2804] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.870036 29547 raft_consensus.cc:697] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:37.870978 29547 consensus_queue.cc:237] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:37.887720 29537 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.888424 29537 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.890688 29537 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:37.891204 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:37.892438 28816 leader_election.cc:343] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.893306 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:37.894179 28923 raft_consensus.cc:2468] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 0.
I20260709 13:11:37.897608 28818 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:37.901296 29537 raft_consensus.cc:2804] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.901708 29537 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.902252 29537 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.903782 29123 ts_tablet_manager.cc:1434] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:11:37.909627 28745 catalog_manager.cc:5697] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.928789 29122 tablet_bootstrap.cc:492] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:37.929250 29122 ts_tablet_manager.cc:1403] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.005s
I20260709 13:11:37.931258 29122 raft_consensus.cc:359] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:37.937001 29122 raft_consensus.cc:385] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.937459 29122 raft_consensus.cc:740] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.938500 29537 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:37.938449 29122 consensus_queue.cc:260] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:37.941270 29122 ts_tablet_manager.cc:1434] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:37.942589 29122 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:37.949018 29122 tablet_bootstrap.cc:654] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.960348 29537 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:37.961534 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:37.962136 28927 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.965960 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:37.971161 28816 leader_election.cc:343] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.976368 29564 consensus_queue.cc:1048] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.988749 28927 raft_consensus.cc:2468] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 1.
I20260709 13:11:37.990250 29537 consensus_queue.cc:1048] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.990332 28818 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:37.992110 29527 raft_consensus.cc:2804] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.992591 29527 raft_consensus.cc:697] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:37.993546 29527 consensus_queue.cc:237] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:38.016571 29471 raft_consensus.cc:493] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.023087 29471 raft_consensus.cc:515] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:38.025945 29471 leader_election.cc:290] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:38.034861 29122 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:38.036038 29122 ts_tablet_manager.cc:1403] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.038s
I20260709 13:11:38.050576 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:38.051194 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:38.051927 28849 raft_consensus.cc:2393] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:38.054064 28998 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.060153 29042 leader_election.cc:304] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:38.064965 29518 raft_consensus.cc:3060] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.073840 29122 raft_consensus.cc:359] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:38.074862 29122 raft_consensus.cc:385] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.075209 29122 raft_consensus.cc:740] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.076172 29122 consensus_queue.cc:260] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:38.077715 29530 consensus_queue.cc:1048] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.079706 29518 raft_consensus.cc:2749] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.089202 29122 ts_tablet_manager.cc:1434] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
I20260709 13:11:38.090518 29122 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c: Bootstrap starting.
I20260709 13:11:38.097713 29122 tablet_bootstrap.cc:654] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.100603 28749 catalog_manager.cc:5697] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } }
I20260709 13:11:38.107348 28749 catalog_manager.cc:5697] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } }
I20260709 13:11:38.135244 28748 catalog_manager.cc:5697] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 1 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.172061 29122 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c: No bootstrap required, opened a new log
I20260709 13:11:38.172672 29122 ts_tablet_manager.cc:1403] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.014s
I20260709 13:11:38.175619 29122 raft_consensus.cc:359] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:38.176386 29122 raft_consensus.cc:385] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.176690 29122 raft_consensus.cc:740] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.177469 29122 consensus_queue.cc:260] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:38.180405 29122 ts_tablet_manager.cc:1434] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:38.186074 29072 raft_consensus.cc:3060] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.230526 28749 catalog_manager.cc:5697] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.233301 28749 catalog_manager.cc:5697] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.234905 28749 catalog_manager.cc:5697] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:38.248540 28798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:38.290638 29518 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.291224 29518 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:38.293501 29518 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:38.296655 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:38.300704 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:38.301467 28927 raft_consensus.cc:2393] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 1: Already voted for candidate c2d8ce5db69d488bac364452e3c87684 in this term.
I20260709 13:11:38.303333 29042 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:38.314137 29599 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.329914 29599 raft_consensus.cc:2749] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.331171 29072 raft_consensus.cc:3060] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.339138 29527 consensus_queue.cc:1048] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.364741 29564 consensus_queue.cc:1048] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.365744 29482 consensus_queue.cc:1048] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.422662 29527 consensus_queue.cc:1048] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.552444 29547 consensus_queue.cc:1048] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.574616 29442 consensus_queue.cc:1048] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.176509 29385 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:39.177067 29385 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:39.179831 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:39.179417 29385 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:39.180364 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:39.180720 29068 raft_consensus.cc:2393] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f69f6a7e69e4093b7779d80aab42eb4 in current term 2: Already voted for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in this term.
I20260709 13:11:39.181191 28851 raft_consensus.cc:2468] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:39.182348 28894 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:39.183005 29385 raft_consensus.cc:2804] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:39.183413 29385 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:39.183817 29385 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.204123 29385 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:39.208978 29385 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:39.209411 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:39.209826 28851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:39.210247 29068 raft_consensus.cc:2393] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f69f6a7e69e4093b7779d80aab42eb4 in current term 2: Already voted for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in this term.
I20260709 13:11:39.214769 28851 raft_consensus.cc:2468] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:39.215582 28894 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:39.216228 29385 raft_consensus.cc:2804] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.216678 29385 raft_consensus.cc:697] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:39.217463 29385 consensus_queue.cc:237] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:39.236047 28745 catalog_manager.cc:5697] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.384994 29610 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.385453 29610 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:39.387377 29610 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:39.388177 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:39.388257 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:39.389055 28849 raft_consensus.cc:2468] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:39.390058 29042 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:39.390606 29610 raft_consensus.cc:2804] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:39.390941 29610 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.391206 29610 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:39.396675 29610 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:39.398193 29610 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:39.399120 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:39.399505 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:39.400375 28849 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:39.407765 28849 raft_consensus.cc:2468] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 3.
I20260709 13:11:39.410084 29042 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:39.411239 29610 raft_consensus.cc:2804] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:39.412391 29610 raft_consensus.cc:697] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:39.415402 29610 consensus_queue.cc:237] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:39.425839 28745 catalog_manager.cc:5697] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 2 to 3, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 3 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.655517 28849 raft_consensus.cc:1240] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Rejecting Update request from peer 4f69f6a7e69e4093b7779d80aab42eb4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:39.656783 29385 consensus_queue.cc:1059] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:39.657675 29558 raft_consensus.cc:3055] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:39.658018 29558 raft_consensus.cc:740] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:39.658676 29558 consensus_queue.cc:260] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:39.659584 29558 raft_consensus.cc:3060] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:39.833732 28922 raft_consensus.cc:1275] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:39.835788 28922 pending_rounds.cc:85] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: Aborting all ops after (but not including) 1
I20260709 13:11:39.836154 28922 pending_rounds.cc:107] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:39.836522 28922 raft_consensus.cc:2889] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.844684 29610 consensus_queue.cc:1048] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.870987 28849 raft_consensus.cc:1275] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:39.872447 29599 consensus_queue.cc:1048] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:40.107584 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
W20260709 13:11:40.123876 28968 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 551 similar messages]
W20260709 13:11:40.131682 28968 consensus_peers.cc:597] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.133901 28968 consensus_peers.cc:597] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.151091 28968 consensus_peers.cc:597] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.152539 28894 consensus_peers.cc:597] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.155526 28894 consensus_peers.cc:597] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.160979 28894 consensus_peers.cc:597] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.166505 29042 consensus_peers.cc:597] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.173040 28968 consensus_peers.cc:597] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.176649 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:40.177740 21775 tablet_replica.cc:333] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.180033 21775 raft_consensus.cc:2243] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.181034 21775 raft_consensus.cc:2272] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.183408 21775 tablet_replica.cc:333] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.184288 21775 raft_consensus.cc:2243] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.184819 21775 raft_consensus.cc:2272] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.187460 21775 tablet_replica.cc:333] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.188238 21775 raft_consensus.cc:2243] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.188689 21775 raft_consensus.cc:2272] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.191125 21775 tablet_replica.cc:333] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.192045 21775 raft_consensus.cc:2243] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.192548 21775 raft_consensus.cc:2272] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.194622 21775 tablet_replica.cc:333] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.195199 21775 raft_consensus.cc:2243] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.195958 21775 raft_consensus.cc:2272] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.197904 21775 tablet_replica.cc:333] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.198446 21775 raft_consensus.cc:2243] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.198902 21775 raft_consensus.cc:2272] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.201349 21775 tablet_replica.cc:333] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.202035 21775 raft_consensus.cc:2243] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.202544 21775 raft_consensus.cc:2272] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.203851 28968 consensus_peers.cc:597] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.205135 21775 tablet_replica.cc:333] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.205799 21775 raft_consensus.cc:2243] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.206187 21775 raft_consensus.cc:2272] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.208149 21775 tablet_replica.cc:333] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.208696 21775 raft_consensus.cc:2243] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.209609 21775 raft_consensus.cc:2272] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.212049 21775 tablet_replica.cc:333] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.212836 21775 raft_consensus.cc:2243] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.213490 21775 raft_consensus.cc:2272] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.216372 21775 tablet_replica.cc:333] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.217200 21775 raft_consensus.cc:2243] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:40.217388 28894 consensus_peers.cc:597] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.217696 21775 raft_consensus.cc:2272] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.220350 21775 tablet_replica.cc:333] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.221186 21775 raft_consensus.cc:2243] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.222270 21775 raft_consensus.cc:2272] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.222404 28894 consensus_peers.cc:597] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.224785 21775 tablet_replica.cc:333] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.225436 21775 raft_consensus.cc:2243] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.226151 21775 raft_consensus.cc:2272] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.228341 21775 tablet_replica.cc:333] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.228888 21775 raft_consensus.cc:2243] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.229311 21775 raft_consensus.cc:2272] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.231091 21775 tablet_replica.cc:333] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.231648 21775 raft_consensus.cc:2243] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.232399 21775 raft_consensus.cc:2272] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.234546 21775 tablet_replica.cc:333] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.235333 21775 raft_consensus.cc:2243] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.236171 21775 raft_consensus.cc:2272] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.238473 21775 tablet_replica.cc:333] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.239267 21775 raft_consensus.cc:2243] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.239821 21775 raft_consensus.cc:2272] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.242245 21775 tablet_replica.cc:333] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.242945 21775 raft_consensus.cc:2243] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.243484 21775 raft_consensus.cc:2272] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.245698 21775 tablet_replica.cc:333] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.246238 21775 raft_consensus.cc:2243] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.246696 21775 raft_consensus.cc:2272] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.248646 21775 tablet_replica.cc:333] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.249150 21775 raft_consensus.cc:2243] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.250038 21775 raft_consensus.cc:2272] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.252622 21775 tablet_replica.cc:333] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.253263 21775 raft_consensus.cc:2243] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.254146 21775 raft_consensus.cc:2272] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.256596 21775 tablet_replica.cc:333] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.257457 21775 raft_consensus.cc:2243] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.258059 21775 raft_consensus.cc:2272] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.260829 21775 tablet_replica.cc:333] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.261615 21775 raft_consensus.cc:2243] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.262152 21775 raft_consensus.cc:2272] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.262743 28894 consensus_peers.cc:597] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.264787 21775 tablet_replica.cc:333] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.265676 21775 raft_consensus.cc:2243] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.266678 21775 raft_consensus.cc:2272] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.269491 21775 tablet_replica.cc:333] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.270210 21775 raft_consensus.cc:2243] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.270835 21775 raft_consensus.cc:2272] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.273706 21775 tablet_replica.cc:333] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.274482 21775 raft_consensus.cc:2243] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.275552 21775 raft_consensus.cc:2272] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.278219 21775 tablet_replica.cc:333] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.278963 21775 raft_consensus.cc:2243] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.280011 21775 raft_consensus.cc:2272] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.280517 28968 consensus_peers.cc:597] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.282919 21775 tablet_replica.cc:333] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.283710 21775 raft_consensus.cc:2243] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.284135 21775 raft_consensus.cc:2272] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.286289 21775 tablet_replica.cc:333] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.286978 21775 raft_consensus.cc:2243] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.287834 21775 raft_consensus.cc:2272] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.290307 21775 tablet_replica.cc:333] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.291040 21775 raft_consensus.cc:2243] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.291910 21775 raft_consensus.cc:2272] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.294139 21775 tablet_replica.cc:333] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.294867 21775 raft_consensus.cc:2243] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.295786 21775 raft_consensus.cc:2272] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.298130 21775 tablet_replica.cc:333] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.298883 21775 raft_consensus.cc:2243] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.299459 21775 raft_consensus.cc:2272] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.300163 28894 consensus_peers.cc:597] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.301092 28894 consensus_peers.cc:597] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.302057 21775 tablet_replica.cc:333] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.302793 21775 raft_consensus.cc:2243] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.303220 21775 raft_consensus.cc:2272] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.305150 21775 tablet_replica.cc:333] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.305877 21775 raft_consensus.cc:2243] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.306713 21775 raft_consensus.cc:2272] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.309298 21775 tablet_replica.cc:333] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.309803 21775 raft_consensus.cc:2243] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.310209 21775 raft_consensus.cc:2272] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.312160 21775 tablet_replica.cc:333] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.312637 21775 raft_consensus.cc:2243] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.313076 21775 raft_consensus.cc:2272] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.315438 21775 tablet_replica.cc:333] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.316110 21775 raft_consensus.cc:2243] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.316992 21775 raft_consensus.cc:2272] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.319115 21775 tablet_replica.cc:333] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.319628 21775 raft_consensus.cc:2243] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.320103 21775 raft_consensus.cc:2272] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.321985 21775 tablet_replica.cc:333] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.322486 21775 raft_consensus.cc:2243] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.322940 21775 raft_consensus.cc:2272] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.325084 21775 tablet_replica.cc:333] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.325616 21775 raft_consensus.cc:2243] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.325999 21775 raft_consensus.cc:2272] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.328370 21775 tablet_replica.cc:333] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.329085 21775 raft_consensus.cc:2243] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.329577 21775 raft_consensus.cc:2272] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.331964 21775 tablet_replica.cc:333] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.332631 21775 raft_consensus.cc:2243] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.333139 21775 raft_consensus.cc:2272] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.335619 21775 tablet_replica.cc:333] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.336359 21775 raft_consensus.cc:2243] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.336870 21775 raft_consensus.cc:2272] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.339937 21775 tablet_replica.cc:333] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
I20260709 13:11:40.340762 21775 raft_consensus.cc:2243] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.341766 21775 raft_consensus.cc:2272] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.344482 21775 tablet_replica.cc:333] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: stopping tablet replica
W20260709 13:11:40.341363 28968 consensus_peers.cc:597] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.345108 21775 raft_consensus.cc:2243] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.345796 21775 raft_consensus.cc:2272] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.351662 28968 consensus_peers.cc:597] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.456054 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
W20260709 13:11:40.458223 29042 consensus_peers.cc:597] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.472770 28894 consensus_peers.cc:597] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.481292 29042 consensus_peers.cc:597] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.513295 28968 consensus_peers.cc:597] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.551250 28894 consensus_peers.cc:597] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.552874 28968 consensus_peers.cc:597] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.557719 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:40.566080 29631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:40.567378 29630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:40.574584 29633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:40.575210 21775 server_base.cc:1061] running on GCE node
I20260709 13:11:40.578783 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:40.579094 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:40.579315 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602700579297 us; error 0 us; skew 500 ppm
I20260709 13:11:40.580134 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:40.583417 21775 webserver.cc:533] Webserver started at http://127.21.67.193:41743/ using document root <none> and password file <none>
I20260709 13:11:40.584075 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:40.584342 21775 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:40.595783 21775 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.005s	sys 0.000s
W20260709 13:11:40.643752 28968 consensus_peers.cc:597] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.646483 28968 consensus_peers.cc:597] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.648481 29638 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:11:40.652235 28894 consensus_peers.cc:597] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.658262 28894 consensus_peers.cc:597] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.659037 21775 fs_manager.cc:730] Time spent opening block manager: real 0.056s	user 0.024s	sys 0.017s
I20260709 13:11:40.659447 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "c2d8ce5db69d488bac364452e3c87684"
format_stamp: "Formatted at 2026-07-09 13:11:27 on dist-test-slave-zkvt"
I20260709 13:11:40.659927 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:11:40.679410 28968 consensus_peers.cc:597] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.700263 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:40.701460 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:40.703146 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:40.708189 29646 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:11:40.972245 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:11:40.972580 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.266s	user 0.005s	sys 0.004s
I20260709 13:11:40.972935 21775 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:11:40.979985 29646 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:40.994524 29646 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:40.995373 29646 tablet_bootstrap.cc:492] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:40.995949 29646 ts_tablet_manager.cc:1403] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:11:40.998250 29646 raft_consensus.cc:359] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:40.998885 29646 raft_consensus.cc:740] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.999542 29646 consensus_queue.cc:260] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.005014 29646 ts_tablet_manager.cc:1434] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.008s
I20260709 13:11:41.005724 29646 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.022352 29646 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.023208 29646 tablet_bootstrap.cc:492] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.023872 29646 ts_tablet_manager.cc:1403] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:11:41.026072 29646 raft_consensus.cc:359] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.026670 29646 raft_consensus.cc:740] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.027247 29646 consensus_queue.cc:260] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.028944 29646 ts_tablet_manager.cc:1434] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:41.029654 29646 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.063987 29646 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.064869 29646 tablet_bootstrap.cc:492] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.065491 29646 ts_tablet_manager.cc:1403] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.012s
I20260709 13:11:41.067790 29646 raft_consensus.cc:359] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.068401 29646 raft_consensus.cc:740] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.069074 29646 consensus_queue.cc:260] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.071056 29646 ts_tablet_manager.cc:1434] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:41.071784 29646 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.093546 29646 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.094355 29646 tablet_bootstrap.cc:492] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.095149 29646 ts_tablet_manager.cc:1403] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 13:11:41.097465 29646 raft_consensus.cc:359] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.098088 29646 raft_consensus.cc:740] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.098739 29646 consensus_queue.cc:260] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.100471 29646 ts_tablet_manager.cc:1434] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:11:41.101197 29646 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
W20260709 13:11:41.122874 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 76464.2us
I20260709 13:11:41.203964 29646 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.204875 29646 tablet_bootstrap.cc:492] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.205533 29646 ts_tablet_manager.cc:1403] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.105s	user 0.040s	sys 0.045s
I20260709 13:11:41.208164 29646 raft_consensus.cc:359] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.208849 29646 raft_consensus.cc:740] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.209671 29646 consensus_queue.cc:260] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.211742 29646 ts_tablet_manager.cc:1434] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:11:41.212459 29646 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.226420 29646 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.227268 29646 tablet_bootstrap.cc:492] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.227866 29646 ts_tablet_manager.cc:1403] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:11:41.230115 29646 raft_consensus.cc:359] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.230775 29646 raft_consensus.cc:740] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.231408 29646 consensus_queue.cc:260] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.233829 29646 ts_tablet_manager.cc:1434] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:41.234530 29646 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.254415 29646 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.255467 29646 tablet_bootstrap.cc:492] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.256124 29646 ts_tablet_manager.cc:1403] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:11:41.258358 29646 raft_consensus.cc:359] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.258999 29646 raft_consensus.cc:740] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.260661 29646 consensus_queue.cc:260] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.262698 29646 ts_tablet_manager.cc:1434] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:11:41.263401 29646 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.270927 21775 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:11:41.271339 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.298s	user 0.259s	sys 0.001s
I20260709 13:11:41.284015 29646 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.283996 29599 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.284720 29599 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.285137 29646 tablet_bootstrap.cc:492] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.287014 29599 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.287228 29646 ts_tablet_manager.cc:1403] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
W20260709 13:11:41.293156 29042 leader_election.cc:336] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.293308 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.296350 29042 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.297402 29599 raft_consensus.cc:2749] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.297667 29646 raft_consensus.cc:359] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.298629 29646 raft_consensus.cc:740] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.299544 29646 consensus_queue.cc:260] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.302168 29646 ts_tablet_manager.cc:1434] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:41.303030 29646 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.304770 29599 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.305323 29599 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.307353 29599 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.311137 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.330505 29652 raft_consensus.cc:493] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.331037 29652 raft_consensus.cc:515] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.335140 29482 raft_consensus.cc:493] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.335597 29482 raft_consensus.cc:515] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.337301 29482 leader_election.cc:290] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.338716 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.343303 29652 leader_election.cc:290] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.344827 29646 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.345183 29639 raft_consensus.cc:493] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.345779 29646 tablet_bootstrap.cc:492] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.345696 29639 raft_consensus.cc:515] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.346422 29646 ts_tablet_manager.cc:1403] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.008s
I20260709 13:11:41.348958 29646 raft_consensus.cc:359] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.354563 29646 raft_consensus.cc:740] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.354848 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.355337 29646 consensus_queue.cc:260] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.350782 29625 raft_consensus.cc:493] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.356173 29625 raft_consensus.cc:515] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.357465 29646 ts_tablet_manager.cc:1434] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:11:41.358104 29625 leader_election.cc:290] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.358217 29646 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
W20260709 13:11:41.351243 29042 leader_election.cc:336] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.360198 29042 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.368902 29385 raft_consensus.cc:493] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.369377 29385 raft_consensus.cc:515] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.381381 29646 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.382392 29646 tablet_bootstrap.cc:492] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.383016 29646 ts_tablet_manager.cc:1403] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:11:41.385506 29646 raft_consensus.cc:359] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.386176 29646 raft_consensus.cc:740] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.386902 29646 consensus_queue.cc:260] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.389014 29646 ts_tablet_manager.cc:1434] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:41.389799 29646 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.347596 29639 leader_election.cc:290] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
W20260709 13:11:41.405260 29042 leader_election.cc:336] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.371582 29385 leader_election.cc:290] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.418795 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.421532 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.407415 29625 raft_consensus.cc:2749] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.434118 29639 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.434701 29639 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.437603 29639 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.441362 29646 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.442291 29646 tablet_bootstrap.cc:492] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.442955 29646 ts_tablet_manager.cc:1403] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.016s
I20260709 13:11:41.419051 29652 raft_consensus.cc:493] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.452370 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.453522 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.454130 29072 raft_consensus.cc:2468] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:41.452647 29646 raft_consensus.cc:359] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:41.455226 28968 leader_election.cc:336] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.456647 29646 raft_consensus.cc:740] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.456753 28968 leader_election.cc:304] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.457345 29646 consensus_queue.cc:260] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:41.457741 28968 leader_election.cc:336] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.458146 28968 leader_election.cc:304] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.458655 28892 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:41.459429 29639 raft_consensus.cc:2804] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.459808 29639 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.460001 29564 raft_consensus.cc:2749] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.461068 29564 raft_consensus.cc:2749] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.465221 29646 ts_tablet_manager.cc:1434] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:11:41.466037 29646 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.460124 29639 raft_consensus.cc:3060] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.451561 29652 raft_consensus.cc:515] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.476271 29669 raft_consensus.cc:493] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.476811 29669 raft_consensus.cc:515] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.478843 29669 leader_election.cc:290] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.480842 29509 raft_consensus.cc:493] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.481283 29509 raft_consensus.cc:515] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.482975 29509 leader_election.cc:290] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.486189 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.487048 28997 raft_consensus.cc:2468] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:41.491971 29042 leader_election.cc:304] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.494414 29599 raft_consensus.cc:2804] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.495760 29599 raft_consensus.cc:493] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.496110 29599 raft_consensus.cc:3060] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.500216 29671 raft_consensus.cc:493] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.500900 29671 raft_consensus.cc:515] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:41.502316 29042 leader_election.cc:336] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.504426 29668 raft_consensus.cc:493] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.504873 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.505542 28997 raft_consensus.cc:2468] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:41.505097 29668 raft_consensus.cc:515] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.503430 29671 leader_election.cc:290] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.509994 29668 leader_election.cc:290] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.515044 29652 leader_election.cc:290] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.516080 29611 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.516748 29611 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.518723 29669 raft_consensus.cc:493] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.519093 29665 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.511273 29599 raft_consensus.cc:515] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.519268 29625 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.519737 29665 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.520313 29625 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.522156 29625 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.519224 29669 raft_consensus.cc:515] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:41.523943 28894 leader_election.cc:336] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.524379 29669 leader_election.cc:290] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.522532 29665 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.525409 29599 leader_election.cc:290] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.526068 29042 leader_election.cc:304] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.527385 29611 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.527973 29611 raft_consensus.cc:493] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.528606 29611 raft_consensus.cc:515] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.529959 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.530740 28997 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:41.531834 29509 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.532027 29611 leader_election.cc:290] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.532402 29509 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.533421 29671 raft_consensus.cc:2804] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.534336 29671 raft_consensus.cc:493] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.534667 29509 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.534884 29671 raft_consensus.cc:3060] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.536768 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:41.537391 28997 raft_consensus.cc:3060] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.537659 29639 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:41.527397 28968 leader_election.cc:336] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.542999 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.544003 29072 raft_consensus.cc:2393] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 2: Already voted for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in this term.
I20260709 13:11:41.544150 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.545855 29639 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.549161 29639 raft_consensus.cc:493] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.546630 28997 raft_consensus.cc:2468] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:41.539327 29042 leader_election.cc:304] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.550746 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.551869 29599 raft_consensus.cc:2749] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.549664 29639 raft_consensus.cc:515] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.551657 29000 raft_consensus.cc:2468] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:41.524392 28894 leader_election.cc:304] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
W20260709 13:11:41.553844 28894 leader_election.cc:336] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.554430 29639 leader_election.cc:290] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.555027 29564 raft_consensus.cc:493] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
W20260709 13:11:41.556488 29042 leader_election.cc:336] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.556074 28894 leader_election.cc:304] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.560155 29665 raft_consensus.cc:493] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.564632 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.565351 29072 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:41.553598 29668 raft_consensus.cc:2749] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.563256 29042 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.567723 28966 leader_election.cc:304] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.572445 29042 leader_election.cc:304] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.587819 29482 raft_consensus.cc:2749] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.560375 29611 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
W20260709 13:11:41.592036 29042 leader_election.cc:336] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.593257 29042 leader_election.cc:336] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.593562 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:41.593879 29042 leader_election.cc:336] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.594117 29072 raft_consensus.cc:2468] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
W20260709 13:11:41.594362 29042 leader_election.cc:336] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.598629 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8542c2d49442dd8176393fb85f499e" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:41.599316 29072 raft_consensus.cc:3060] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.572606 29639 raft_consensus.cc:2749] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.594873 29669 raft_consensus.cc:2804] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.572154 29665 raft_consensus.cc:515] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.592428 29599 raft_consensus.cc:2804] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.595635 29625 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.563423 29564 raft_consensus.cc:515] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.626554 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.627055 28927 raft_consensus.cc:2468] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:41.629063 29072 raft_consensus.cc:2468] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:41.598132 29611 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.622342 29599 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.634262 29385 raft_consensus.cc:493] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.626222 29625 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.635713 29675 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.636222 29675 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.637146 29625 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.638214 29675 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.629998 29676 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.638931 29676 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.641098 29676 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.625269 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.645584 29385 raft_consensus.cc:515] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:41.648010 28966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 58621.4us
I20260709 13:11:41.648331 28997 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:41.650115 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.650287 29564 leader_election.cc:290] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.650748 28922 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:41.651297 29385 leader_election.cc:290] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.632261 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.651908 29000 raft_consensus.cc:2468] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:41.653218 29665 leader_election.cc:290] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
W20260709 13:11:41.654975 28968 leader_election.cc:336] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.655423 28968 leader_election.cc:304] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.657444 28892 leader_election.cc:304] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:41.657519 29671 raft_consensus.cc:515] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.658001 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.658346 28892 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:41.658687 29072 raft_consensus.cc:2468] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:41.660280 29678 raft_consensus.cc:2804] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.660398 29639 raft_consensus.cc:2804] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.660758 29678 raft_consensus.cc:493] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.660982 29639 raft_consensus.cc:697] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:41.661212 29678 raft_consensus.cc:3060] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.662299 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.661871 29639 consensus_queue.cc:237] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.662930 29068 raft_consensus.cc:2468] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:41.659514 29671 leader_election.cc:290] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.664743 28966 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.665740 28892 leader_election.cc:304] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:41.666497 29385 raft_consensus.cc:2804] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.666839 29385 raft_consensus.cc:493] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.667125 29385 raft_consensus.cc:3060] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.668120 29669 raft_consensus.cc:697] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:41.669179 29611 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.643522 29599 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.669032 29669 consensus_queue.cc:237] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.673108 28892 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
W20260709 13:11:41.673635 28968 leader_election.cc:336] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.677575 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.677879 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095c41dda35e41798dda1b4bdca1e55e" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:41.678212 29000 raft_consensus.cc:2468] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 1.
I20260709 13:11:41.678474 28997 raft_consensus.cc:3060] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.685045 28997 raft_consensus.cc:2468] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:41.686367 29385 raft_consensus.cc:515] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.687788 29385 leader_election.cc:290] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.688280 29482 raft_consensus.cc:493] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.688689 29482 raft_consensus.cc:515] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
W20260709 13:11:41.689491 28968 leader_election.cc:336] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.690006 29482 leader_election.cc:290] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
W20260709 13:11:41.690181 28968 leader_election.cc:336] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.692482 29681 raft_consensus.cc:493] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.694247 29042 leader_election.cc:304] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.697501 29679 raft_consensus.cc:2804] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.697271 29681 raft_consensus.cc:515] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.697935 29679 raft_consensus.cc:493] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.698345 29679 raft_consensus.cc:3060] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.696758 29646 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.699747 29646 tablet_bootstrap.cc:492] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:41.700235 29681 leader_election.cc:290] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.701994 29042 leader_election.cc:304] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.674309 29676 raft_consensus.cc:2749] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.707789 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.714833 29071 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
I20260709 13:11:41.709693 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:41.701611 29682 raft_consensus.cc:2804] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.715811 29682 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.716166 29682 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.717095 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.717945 28922 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:41.675025 29611 raft_consensus.cc:2804] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.718873 29611 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.719247 29611 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.719496 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.720323 28922 raft_consensus.cc:2468] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:41.722476 29676 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.711865 29681 raft_consensus.cc:2804] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.714030 29668 raft_consensus.cc:493] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.723126 29676 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.736037 29668 raft_consensus.cc:515] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.738031 29676 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.738740 29668 leader_election.cc:290] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.739241 29599 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
W20260709 13:11:41.741298 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 110560us
I20260709 13:11:41.742411 29564 raft_consensus.cc:493] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.742897 29564 raft_consensus.cc:515] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.743062 28894 leader_election.cc:304] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.745095 29564 leader_election.cc:290] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.746582 29599 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.730795 29678 raft_consensus.cc:515] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.724202 29076 raft_consensus.cc:3060] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.763988 29678 leader_election.cc:290] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
W20260709 13:11:41.750125 29042 leader_election.cc:336] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.750336 29683 raft_consensus.cc:2804] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.765702 29683 raft_consensus.cc:493] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.766213 29683 raft_consensus.cc:3060] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.748327 29681 raft_consensus.cc:697] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:41.750474 28748 catalog_manager.cc:5697] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:41.768292 29681 consensus_queue.cc:237] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.774569 29076 raft_consensus.cc:2468] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:41.752830 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.775353 29075 raft_consensus.cc:2468] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:41.730588 29611 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.777679 29611 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.702582 29646 ts_tablet_manager.cc:1403] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.237s	user 0.028s	sys 0.007s
I20260709 13:11:41.781683 28966 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.782449 29676 raft_consensus.cc:2804] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.782816 29676 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.783167 29676 raft_consensus.cc:3060] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.756934 28968 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.757993 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.781980 29646 raft_consensus.cc:359] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.788129 28922 raft_consensus.cc:2468] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
I20260709 13:11:41.788604 29646 raft_consensus.cc:740] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.788401 28968 leader_election.cc:304] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.790189 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:41.791038 29509 raft_consensus.cc:2804] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.791376 29509 raft_consensus.cc:493] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.791759 29509 raft_consensus.cc:3060] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.787077 28745 catalog_manager.cc:5697] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.794476 29646 consensus_queue.cc:260] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.754060 28892 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
W20260709 13:11:41.797425 28892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 43483.9us
I20260709 13:11:41.788686 29482 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.730635 29682 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.751325 28894 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.801565 29482 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.804407 29482 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:41.804147 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 52930.7us
I20260709 13:11:41.805150 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:41.781903 29683 raft_consensus.cc:515] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.806046 29075 raft_consensus.cc:2393] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 2: Already voted for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in this term.
I20260709 13:11:41.805107 28894 leader_election.cc:304] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.798056 29678 raft_consensus.cc:2804] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.807585 29683 leader_election.cc:290] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.809295 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65a86245d1042e3b9c4cbea4a2aa661" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:41.809882 29075 raft_consensus.cc:3060] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.809973 29683 raft_consensus.cc:2804] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.810567 29683 raft_consensus.cc:493] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.811025 29683 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.802863 28997 raft_consensus.cc:2393] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 2: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:41.802249 29509 raft_consensus.cc:515] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.798825 29646 ts_tablet_manager.cc:1434] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:11:41.808028 29678 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.815635 29646 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:41.815596 29678 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.807989 29385 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.816444 29385 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.816763 29385 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:41.807534 28894 leader_election.cc:336] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.802434 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.818485 28927 raft_consensus.cc:2468] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 1.
W20260709 13:11:41.818810 28894 leader_election.cc:336] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.823094 29611 raft_consensus.cc:493] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.823789 29611 raft_consensus.cc:515] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.824270 29385 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.826002 29385 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.750702 29679 raft_consensus.cc:515] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.826380 29611 leader_election.cc:290] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.827505 29678 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.829502 29678 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.829907 29683 raft_consensus.cc:515] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.804171 29682 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.832620 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:41.833266 29076 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.833647 29683 leader_election.cc:290] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:41.808578 28892 leader_election.cc:304] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:41.836684 29611 raft_consensus.cc:2804] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.837442 29611 raft_consensus.cc:697] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:41.838851 29611 consensus_queue.cc:237] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.844128 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:41.844961 29069 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.848599 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bb4f426f62474ea61c0ccd22e639f3" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:41.849207 29071 raft_consensus.cc:2468] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 1.
W20260709 13:11:41.839874 29042 leader_election.cc:336] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.854694 29042 leader_election.cc:336] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.855329 28892 leader_election.cc:304] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
W20260709 13:11:41.868405 29042 leader_election.cc:336] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.872048 29076 raft_consensus.cc:2468] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:41.872655 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071ad308999465eb78a22785db01b62" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:41.873409 28892 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:41.873466 28997 raft_consensus.cc:3060] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.874248 29639 raft_consensus.cc:2804] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.874764 29639 raft_consensus.cc:697] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:41.856318 29482 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.875607 29639 consensus_queue.cc:237] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.877426 29482 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.878587 29042 leader_election.cc:304] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.871819 29611 raft_consensus.cc:2804] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.879611 29042 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.857012 29069 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:41.857034 29509 leader_election.cc:290] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.859369 28968 leader_election.cc:304] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:41.827905 29679 leader_election.cc:290] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.861049 29075 raft_consensus.cc:2468] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:41.863090 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:41.831391 29676 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:41.866101 28923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bb4f426f62474ea61c0ccd22e639f3" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
W20260709 13:11:41.866393 29686 log.cc:927] Time spent T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:11:41.867208 28894 leader_election.cc:336] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.880406 29611 raft_consensus.cc:493] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.889007 29482 raft_consensus.cc:2804] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.889614 28892 leader_election.cc:304] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
W20260709 13:11:41.898908 28894 leader_election.cc:336] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.899236 29482 raft_consensus.cc:493] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.899616 29482 raft_consensus.cc:3060] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:41.899709 28894 leader_election.cc:336] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.900431 28894 leader_election.cc:336] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.890530 28968 leader_election.cc:304] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
W20260709 13:11:41.901171 28894 leader_election.cc:336] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.902590 29564 raft_consensus.cc:2804] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.902981 29564 raft_consensus.cc:493] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:11:41.903330 29564 raft_consensus.cc:3060] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.908120 29678 raft_consensus.cc:2804] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.908658 29678 raft_consensus.cc:697] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:41.909495 29678 consensus_queue.cc:237] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.911875 28892 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
W20260709 13:11:41.910909 28968 leader_election.cc:336] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.900431 29611 raft_consensus.cc:3060] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:41.917492 28894 leader_election.cc:336] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.918267 28894 leader_election.cc:336] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.918879 28894 leader_election.cc:336] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.919502 28894 leader_election.cc:336] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.920152 28894 leader_election.cc:336] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.889807 29599 raft_consensus.cc:2764] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:11:41.920867 28894 leader_election.cc:336] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.921691 28894 leader_election.cc:336] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.921667 29482 raft_consensus.cc:515] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
W20260709 13:11:41.911531 29042 leader_election.cc:336] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:41.924393 29042 leader_election.cc:336] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:41.925840 29042 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.926493 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf6422e395e4363ba3daf68501ad7b3" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:41.926781 29688 raft_consensus.cc:2804] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.927058 28927 raft_consensus.cc:3060] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.890008 29681 raft_consensus.cc:2764] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:41.947121 29679 raft_consensus.cc:2749] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:41.972311 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 46947.9us
I20260709 13:11:41.976797 28997 raft_consensus.cc:2468] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:41.978237 29676 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.978597 29482 leader_election.cc:290] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.980526 29564 raft_consensus.cc:515] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:41.981336 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:41.982131 29069 raft_consensus.cc:3060] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.982570 29564 leader_election.cc:290] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:41.985954 29688 raft_consensus.cc:697] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:41.987084 29611 raft_consensus.cc:515] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:41.988288 28923 raft_consensus.cc:2393] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b99cdfeeb2f418fa34b0ac78532b59c in current term 2: Already voted for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in this term.
I20260709 13:11:41.991297 29042 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.992652 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:41.992955 29669 raft_consensus.cc:2749] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.993386 29000 raft_consensus.cc:2393] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f69f6a7e69e4093b7779d80aab42eb4 in current term 2: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:41.994356 28926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:41.995123 28926 raft_consensus.cc:2393] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aceb6f6c95434708b96f7552ee379a8e in current term 2: Already voted for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in this term.
I20260709 13:11:41.998227 29042 leader_election.cc:304] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:41.999258 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "999b5645c9a5429d89ef42071b72ff41" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:41.999881 29001 raft_consensus.cc:3060] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.006146 28927 raft_consensus.cc:2468] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:41.991442 29069 raft_consensus.cc:2468] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:42.008822 28966 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:42.008697 29001 raft_consensus.cc:2468] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
W20260709 13:11:42.010521 28894 leader_election.cc:336] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:42.011211 28894 leader_election.cc:336] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.011994 29001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:42.012338 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:42.012753 29001 raft_consensus.cc:2393] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f69f6a7e69e4093b7779d80aab42eb4 in current term 2: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:42.012887 29000 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:42.013304 28894 leader_election.cc:336] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:42.014164 28894 leader_election.cc:336] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.013347 29701 raft_consensus.cc:2804] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.020100 29701 raft_consensus.cc:697] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:42.021355 29701 consensus_queue.cc:237] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:42.023221 29611 leader_election.cc:290] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:41.986951 29688 consensus_queue.cc:237] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:42.028192 28968 leader_election.cc:336] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:42.029050 28968 leader_election.cc:336] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.029429 28968 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.030146 29509 raft_consensus.cc:2749] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.032987 29669 raft_consensus.cc:2804] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.033497 29669 raft_consensus.cc:697] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:42.034366 29669 consensus_queue.cc:237] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:42.047127 29000 raft_consensus.cc:2468] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:42.053781 29042 leader_election.cc:304] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.057097 29646 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:42.058173 29646 tablet_bootstrap.cc:492] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
W20260709 13:11:42.058372 28894 leader_election.cc:336] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.058837 29646 ts_tablet_manager.cc:1403] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.243s	user 0.018s	sys 0.005s
I20260709 13:11:42.060036 29671 raft_consensus.cc:3060] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.078394 29671 raft_consensus.cc:2749] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.083259 28749 catalog_manager.cc:5697] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.085664 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70244d272ca8458a91edd4e2388bcbe0" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:42.086642 28922 raft_consensus.cc:3060] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.099334 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bb4f426f62474ea61c0ccd22e639f3" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:42.101671 28927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1766cdfb35f400dbee45175e8278150" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:42.102630 28927 raft_consensus.cc:3060] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.103138 29646 raft_consensus.cc:359] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:42.103822 29646 raft_consensus.cc:740] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.106457 29075 raft_consensus.cc:2468] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
I20260709 13:11:42.112643 28922 raft_consensus.cc:2468] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:42.112730 28892 leader_election.cc:304] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.113904 29678 raft_consensus.cc:2804] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.114609 29678 raft_consensus.cc:697] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:42.115582 29678 consensus_queue.cc:237] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:42.118093 28968 leader_election.cc:304] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
W20260709 13:11:42.113929 28894 consensus_peers.cc:597] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.118722 29646 consensus_queue.cc:260] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:42.127913 29646 ts_tablet_manager.cc:1434] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:11:42.128557 29646 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:42.119957 29701 raft_consensus.cc:2804] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.129993 29701 raft_consensus.cc:697] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:42.123004 28968 leader_election.cc:304] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:42.131623 29564 raft_consensus.cc:2804] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.132272 29564 raft_consensus.cc:697] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:42.133090 29701 consensus_queue.cc:237] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:42.133371 29564 consensus_queue.cc:237] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:42.123024 28927 raft_consensus.cc:2468] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:42.125989 29001 raft_consensus.cc:1275] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:42.140677 28968 leader_election.cc:336] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.140753 29669 consensus_queue.cc:1048] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:42.142046 28968 leader_election.cc:336] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.142554 28968 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.171871 28894 leader_election.cc:304] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.173923 29639 raft_consensus.cc:2749] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.176291 29682 raft_consensus.cc:2749] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.175633 28894 leader_election.cc:304] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.178504 28894 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.179276 28749 catalog_manager.cc:5697] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.181928 29688 raft_consensus.cc:2804] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.182416 29688 raft_consensus.cc:697] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:42.183314 29688 consensus_queue.cc:237] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:42.182401 28749 catalog_manager.cc:5697] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.190658 29639 raft_consensus.cc:2749] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:42.189510 28968 leader_election.cc:336] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.194677 28894 leader_election.cc:304] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:42.199489 29649 raft_consensus.cc:493] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.199986 29649 raft_consensus.cc:515] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:42.202106 29684 raft_consensus.cc:2804] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.202469 29649 leader_election.cc:290] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:42.202632 29684 raft_consensus.cc:697] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:42.197288 28968 leader_election.cc:304] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: 
W20260709 13:11:42.206475 28968 leader_election.cc:336] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:42.207343 28968 leader_election.cc:336] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:11:42.208140 28968 leader_election.cc:336] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:11:42.213022 29682 raft_consensus.cc:2804] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.224118 28745 catalog_manager.cc:5697] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.239475 28745 catalog_manager.cc:5697] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.241720 28745 catalog_manager.cc:5697] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.246817 29069 raft_consensus.cc:1275] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.249876 28997 raft_consensus.cc:1275] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.203534 29684 consensus_queue.cc:237] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
W20260709 13:11:42.252063 29042 consensus_peers.cc:597] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.266618 29385 consensus_queue.cc:1048] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.254837 28745 catalog_manager.cc:5697] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.274022 28745 catalog_manager.cc:5697] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.269586 28748 catalog_manager.cc:5697] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.279027 28748 catalog_manager.cc:5697] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.271513 29682 raft_consensus.cc:697] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:42.291253 29682 consensus_queue.cc:237] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:42.292438 29649 raft_consensus.cc:493] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.293058 29649 raft_consensus.cc:515] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:42.298003 29711 consensus_queue.cc:1048] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:11:42.303221 29042 consensus_peers.cc:597] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.312734 29649 leader_election.cc:290] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
W20260709 13:11:42.392760 29727 log.cc:927] Time spent T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:11:42.395092 28894 consensus_peers.cc:597] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.396653 29067 raft_consensus.cc:1275] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:42.396739 28894 consensus_peers.cc:597] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.419550 29646 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:42.422739 29611 consensus_queue.cc:1048] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.420532 29646 tablet_bootstrap.cc:492] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:42.429332 29646 ts_tablet_manager.cc:1403] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.301s	user 0.022s	sys 0.004s
I20260709 13:11:42.433048 29646 raft_consensus.cc:359] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:42.433763 29646 raft_consensus.cc:740] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.434527 29646 consensus_queue.cc:260] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:42.436658 29646 ts_tablet_manager.cc:1434] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:42.437426 29646 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:42.456488 29075 raft_consensus.cc:1275] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.463783 29072 raft_consensus.cc:1275] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.465754 29385 consensus_queue.cc:1048] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.466447 29684 consensus_queue.cc:1048] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:11:42.476329 29068 raft_consensus.cc:1275] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:42.478686 28894 consensus_peers.cc:597] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.473367 29649 raft_consensus.cc:493] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.489526 28745 catalog_manager.cc:5697] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.495838 28745 catalog_manager.cc:5697] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.510182 29684 consensus_queue.cc:1048] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.521438 29743 raft_consensus.cc:493] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.522493 29744 raft_consensus.cc:493] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.523046 29743 raft_consensus.cc:515] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:42.523203 29744 raft_consensus.cc:515] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:42.494501 29649 raft_consensus.cc:515] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:42.557222 29649 leader_election.cc:290] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:42.560408 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:42.560962 29739 log.cc:927] Time spent T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:42.561288 29068 raft_consensus.cc:2393] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 2: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:42.562017 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:42.572525 29743 leader_election.cc:290] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:42.561574 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:42.567340 29649 raft_consensus.cc:493] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.589748 29646 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:42.582054 29071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:42.620865 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:42.633821 29646 tablet_bootstrap.cc:492] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:42.590277 29649 raft_consensus.cc:515] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:42.643859 29646 ts_tablet_manager.cc:1403] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.022s
W20260709 13:11:42.664765 29042 consensus_peers.cc:597] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.676324 28998 raft_consensus.cc:1275] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.676607 29649 leader_election.cc:290] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:42.679517 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e7fd2f04240aa908640daf9fc53df" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:42.682869 29671 consensus_queue.cc:1048] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.683634 28996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:42.684818 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dcb234db264bc5be97cd38c312274b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:42.685532 28922 raft_consensus.cc:1275] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.683040 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955d423ccbf49f092ae423e2778518b" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:42.686781 29069 raft_consensus.cc:1275] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.689863 29744 leader_election.cc:290] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:42.694424 29643 leader_election.cc:304] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:42.696131 29643 leader_election.cc:304] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:42.697656 29643 leader_election.cc:304] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:42.700117 29743 raft_consensus.cc:2749] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.700919 29743 raft_consensus.cc:3060] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.703868 29744 raft_consensus.cc:2749] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.703220 28745 catalog_manager.cc:5697] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 1 to 2, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 2 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.714854 29482 consensus_queue.cc:1048] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.722820 29072 raft_consensus.cc:1275] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.731720 29509 consensus_queue.cc:1048] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.736339 29646 raft_consensus.cc:359] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:42.737154 29646 raft_consensus.cc:740] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.737954 29646 consensus_queue.cc:260] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:42.740108 29646 ts_tablet_manager.cc:1434] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.000s
I20260709 13:11:42.741087 29646 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:42.741881 28922 raft_consensus.cc:1275] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:42.762436 28968 consensus_peers.cc:597] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:42.763131 28968 consensus_peers.cc:597] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:42.763799 29668 consensus_queue.cc:1048] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:42.765489 28968 consensus_peers.cc:597] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.789203 29509 consensus_queue.cc:1048] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:42.804710 29649 raft_consensus.cc:493] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.805228 29649 raft_consensus.cc:515] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:42.807180 29649 leader_election.cc:290] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
W20260709 13:11:42.812456 28894 consensus_peers.cc:597] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:42.807773 29743 raft_consensus.cc:2749] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.853935 28998 raft_consensus.cc:1275] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:42.883117 28968 consensus_peers.cc:597] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.883812 28968 consensus_peers.cc:597] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:42.884434 28968 consensus_peers.cc:597] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:42.889634 28892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 57806.2us
I20260709 13:11:42.906708 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:42.957939 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:43757, user_credentials={real_user=slave}} blocked reactor thread for 61745.3us
W20260709 13:11:42.995167 28968 consensus_peers.cc:597] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.995950 28968 consensus_peers.cc:597] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.996537 28968 consensus_peers.cc:597] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.996961 28968 consensus_peers.cc:597] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:42.998063 28997 raft_consensus.cc:1275] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:43.015265 29646 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:11:43.015407 28968 consensus_peers.cc:597] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.032742 28968 consensus_peers.cc:597] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.020088 29042 consensus_peers.cc:597] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.027025 29743 raft_consensus.cc:493] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.027349 28928 raft_consensus.cc:1275] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:43.008033 29688 consensus_queue.cc:1048] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:11:43.034322 29042 consensus_peers.cc:597] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.036283 29042 consensus_peers.cc:597] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.043567 29646 tablet_bootstrap.cc:492] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.044428 29509 consensus_queue.cc:1048] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:43.047580 29646 ts_tablet_manager.cc:1403] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.307s	user 0.017s	sys 0.006s
W20260709 13:11:43.056864 28894 consensus_peers.cc:597] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.057868 28894 consensus_peers.cc:597] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:43.058643 28894 consensus_peers.cc:597] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.059386 28894 consensus_peers.cc:597] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:43.060726 28894 consensus_peers.cc:597] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.040406 29649 raft_consensus.cc:493] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.040153 29743 raft_consensus.cc:515] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.082468 29744 raft_consensus.cc:493] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.083247 29744 raft_consensus.cc:515] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.066367 29649 raft_consensus.cc:515] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.085933 29744 leader_election.cc:290] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:43.086218 29649 leader_election.cc:290] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:43.061389 29765 consensus_queue.cc:1048] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:11:43.087479 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe7b1ea920e462e8b046d5d41f6bd8c" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:43.095463 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:43.096262 29743 leader_election.cc:290] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:43.098187 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d98016c79645be808873970bf26945" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:43.098789 28996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875112fc0fc4410eb1a079bb5771d060" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
W20260709 13:11:43.100049 28968 consensus_peers.cc:597] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.100507 28968 consensus_peers.cc:597] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.104457 29646 raft_consensus.cc:359] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.105170 29646 raft_consensus.cc:740] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.105906 29646 consensus_queue.cc:260] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.107733 29646 ts_tablet_manager.cc:1434] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.003s
I20260709 13:11:43.108465 29646 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.118177 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875112fc0fc4410eb1a079bb5771d060" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:43.120767 28894 consensus_peers.cc:597] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.121937 28894 consensus_peers.cc:597] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:43.122347 28894 consensus_peers.cc:597] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.122689 28894 consensus_peers.cc:597] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:43.127076 29641 leader_election.cc:304] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:43.130216 29641 leader_election.cc:304] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:43.130988 29649 raft_consensus.cc:2749] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.131279 29743 raft_consensus.cc:2749] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.150934 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:43.151608 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa926f9b106492fa4f9170584cdc0d0" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:43.152693 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e7fd2f04240aa908640daf9fc53df" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:43.154407 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:43.155860 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe7b1ea920e462e8b046d5d41f6bd8c" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:43.175343 29649 raft_consensus.cc:493] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.175889 29649 raft_consensus.cc:515] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.180743 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
W20260709 13:11:43.181885 28968 consensus_peers.cc:597] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.182230 29646 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.185212 29643 leader_election.cc:304] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:43.186069 29743 raft_consensus.cc:2749] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.187322 29646 tablet_bootstrap.cc:492] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.188180 29646 ts_tablet_manager.cc:1403] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.005s
I20260709 13:11:43.183601 29649 leader_election.cc:290] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:43.190668 29646 raft_consensus.cc:359] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.191329 29646 raft_consensus.cc:740] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.191956 29646 consensus_queue.cc:260] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.192126 29643 leader_election.cc:304] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:43.193408 29643 leader_election.cc:304] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:43.194085 29743 raft_consensus.cc:2749] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.194540 29643 leader_election.cc:304] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:43.195314 29744 raft_consensus.cc:2749] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.194676 29743 raft_consensus.cc:2749] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.196717 29643 leader_election.cc:304] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:43.197458 29649 raft_consensus.cc:2749] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:43.202610 28894 consensus_peers.cc:597] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.203088 28894 consensus_peers.cc:597] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.202162 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac826ae3d4a50b9a1fdec1e9a2e69" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" is_pre_election: true
I20260709 13:11:43.206981 29646 ts_tablet_manager.cc:1434] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:11:43.207742 29646 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.212126 29643 leader_election.cc:304] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4
I20260709 13:11:43.212929 29649 raft_consensus.cc:2749] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:43.237480 28968 consensus_peers.cc:597] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.256258 28968 consensus_peers.cc:597] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.260378 28894 consensus_peers.cc:597] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.311401 29646 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.312677 29646 tablet_bootstrap.cc:492] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.313308 29646 ts_tablet_manager.cc:1403] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.106s	user 0.026s	sys 0.030s
I20260709 13:11:43.316323 29646 raft_consensus.cc:359] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.316987 29646 raft_consensus.cc:740] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.319638 29646 consensus_queue.cc:260] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.322811 29646 ts_tablet_manager.cc:1434] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:43.323592 29646 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
W20260709 13:11:43.324122 28894 consensus_peers.cc:597] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.344704 29795 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:43757 every 8 connection(s)
I20260709 13:11:43.344277 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:43757
I20260709 13:11:43.351712 29646 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.352860 29646 tablet_bootstrap.cc:492] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.353555 29646 ts_tablet_manager.cc:1403] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.007s
I20260709 13:11:43.359354 29646 raft_consensus.cc:359] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.360126 29646 raft_consensus.cc:740] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.360790 29646 consensus_queue.cc:260] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.363251 29646 ts_tablet_manager.cc:1434] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:43.364321 29646 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.391239 29725 raft_consensus.cc:3060] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.393158 29646 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.394035 29646 tablet_bootstrap.cc:492] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.394651 29646 ts_tablet_manager.cc:1403] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.000s
I20260709 13:11:43.399055 29646 raft_consensus.cc:359] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.399796 29646 raft_consensus.cc:740] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.400602 29646 consensus_queue.cc:260] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.404168 29646 ts_tablet_manager.cc:1434] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:43.404989 29646 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
W20260709 13:11:43.433295 28894 consensus_peers.cc:597] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.436137 29724 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.485024 29646 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.486320 29646 tablet_bootstrap.cc:492] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.487931 29646 ts_tablet_manager.cc:1403] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.004s
I20260709 13:11:43.492902 29646 raft_consensus.cc:359] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.497059 29646 raft_consensus.cc:740] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.501497 29646 consensus_queue.cc:260] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.507916 29649 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.503401 29646 ts_tablet_manager.cc:1434] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:11:43.508445 29649 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.510574 29649 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:43.512760 28996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:43.513536 28996 raft_consensus.cc:2393] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 2: Already voted for candidate aceb6f6c95434708b96f7552ee379a8e in this term.
I20260709 13:11:43.514204 29646 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.517917 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:43.518589 29072 raft_consensus.cc:2393] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2d8ce5db69d488bac364452e3c87684 in current term 2: Already voted for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in this term.
I20260709 13:11:43.519637 29725 raft_consensus.cc:3060] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.523411 29641 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2d8ce5db69d488bac364452e3c87684; no voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:11:43.523675 29798 heartbeater.cc:344] Connected to a master server at 127.21.67.254:35781
I20260709 13:11:43.524323 29649 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.524784 29798 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:43.525763 29798 heartbeater.cc:507] Master 127.21.67.254:35781 requested a full tablet report, sending...
I20260709 13:11:43.534997 29649 raft_consensus.cc:2749] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.535532 29646 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.536546 29646 tablet_bootstrap.cc:492] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.537248 29646 ts_tablet_manager.cc:1403] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 13:11:43.538962 29646 raft_consensus.cc:359] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.539531 29646 raft_consensus.cc:740] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.540210 29646 consensus_queue.cc:260] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.541900 29646 ts_tablet_manager.cc:1434] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:43.542522 29646 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.557426 29646 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.557542 28749 ts_manager.cc:194] Re-registered known tserver with Master: c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:43.558403 29646 tablet_bootstrap.cc:492] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.559084 29646 ts_tablet_manager.cc:1403] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:11:43.561601 29646 raft_consensus.cc:359] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.562280 29646 raft_consensus.cc:740] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.567478 29646 consensus_queue.cc:260] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.569444 29646 ts_tablet_manager.cc:1434] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.003s
I20260709 13:11:43.570182 29646 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.587845 29646 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.588688 29646 tablet_bootstrap.cc:492] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.589270 29646 ts_tablet_manager.cc:1403] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:11:43.591636 29646 raft_consensus.cc:359] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.592262 29646 raft_consensus.cc:740] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.593019 29646 consensus_queue.cc:260] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.595384 29646 ts_tablet_manager.cc:1434] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:11:43.596117 29646 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.618448 29646 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.619606 29646 tablet_bootstrap.cc:492] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.620484 29646 ts_tablet_manager.cc:1403] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:11:43.620945 28749 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53014
I20260709 13:11:43.624493 29646 raft_consensus.cc:359] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.625300 29646 raft_consensus.cc:740] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.626088 29646 consensus_queue.cc:260] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.628677 29646 ts_tablet_manager.cc:1434] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:43.626111 29798 heartbeater.cc:499] Master 127.21.67.254:35781 was elected leader, sending a full tablet report...
I20260709 13:11:43.629462 29646 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.652604 29646 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.653527 29646 tablet_bootstrap.cc:492] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.654143 29646 ts_tablet_manager.cc:1403] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 13:11:43.656764 29646 raft_consensus.cc:359] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.657460 29646 raft_consensus.cc:740] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.658099 29646 consensus_queue.cc:260] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.660261 29646 ts_tablet_manager.cc:1434] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:43.661026 29646 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.682188 29646 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.683102 29646 tablet_bootstrap.cc:492] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.683732 29646 ts_tablet_manager.cc:1403] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 13:11:43.686290 29646 raft_consensus.cc:359] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.687850 29646 raft_consensus.cc:740] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.688921 29646 consensus_queue.cc:260] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.690973 29646 ts_tablet_manager.cc:1434] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:43.691751 29646 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.712488 29733 raft_consensus.cc:3060] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.748880 29717 raft_consensus.cc:3060] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.772049 29688 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.772610 29688 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.778514 29688 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:43.780552 29724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:43.783533 28996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e" is_pre_election: true
I20260709 13:11:43.784231 28996 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 2.
W20260709 13:11:43.783820 28894 leader_election.cc:343] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.788558 28894 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:43.789590 29678 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.789975 29678 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.790334 29678 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.794653 29646 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.795595 29646 tablet_bootstrap.cc:492] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.796219 29646 ts_tablet_manager.cc:1403] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.042s
I20260709 13:11:43.801662 29646 raft_consensus.cc:359] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.802328 29646 raft_consensus.cc:740] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.802947 29646 consensus_queue.cc:260] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.806368 29678 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.807253 29646 ts_tablet_manager.cc:1434] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:43.808075 29646 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.816817 29733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
W20260709 13:11:43.818346 28894 leader_election.cc:343] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.820228 29678 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 3 election: Requested vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:43.824949 28996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:43.825517 28996 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.828030 29646 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.833563 28996 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f69f6a7e69e4093b7779d80aab42eb4 in term 3.
I20260709 13:11:43.836285 28894 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e; no voters: c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:43.828965 29646 tablet_bootstrap.cc:492] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.837687 29678 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.837821 29646 ts_tablet_manager.cc:1403] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
I20260709 13:11:43.838194 29678 raft_consensus.cc:697] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 LEADER]: Becoming Leader. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:43.841068 29646 raft_consensus.cc:359] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.843910 29646 raft_consensus.cc:740] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.844595 29646 consensus_queue.cc:260] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:43.839087 29678 consensus_queue.cc:237] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.846716 29646 ts_tablet_manager.cc:1434] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:11:43.847576 29646 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.876885 29509 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.877441 29509 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.881870 29509 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:43.876281 28749 catalog_manager.cc:5697] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 reported cstate change: term changed from 1 to 3, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.884409 29733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684" is_pre_election: true
I20260709 13:11:43.885006 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" is_pre_election: true
I20260709 13:11:43.885847 29069 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:43.887144 28966 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:43.885080 29733 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 2.
I20260709 13:11:43.887468 29646 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.888693 29646 tablet_bootstrap.cc:492] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.889328 29646 ts_tablet_manager.cc:1403] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.015s
I20260709 13:11:43.889667 29482 raft_consensus.cc:2804] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.890027 29482 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.890300 29482 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.891829 29646 raft_consensus.cc:359] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.892484 29646 raft_consensus.cc:740] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.893216 29646 consensus_queue.cc:260] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.895035 29646 ts_tablet_manager.cc:1434] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:43.895709 29646 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.907313 29482 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.909082 29482 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:43.910423 29733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:43.910967 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "aceb6f6c95434708b96f7552ee379a8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:43.915989 29069 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.915478 29733 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.925195 29646 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.928131 29646 tablet_bootstrap.cc:492] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:43.928577 29717 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.928756 29646 ts_tablet_manager.cc:1403] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.004s
I20260709 13:11:43.931330 29646 raft_consensus.cc:359] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.932014 29646 raft_consensus.cc:740] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.934298 29724 raft_consensus.cc:3060] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.937315 29069 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 3.
I20260709 13:11:43.936960 29646 consensus_queue.cc:260] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:43.939292 29733 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aceb6f6c95434708b96f7552ee379a8e in term 3.
I20260709 13:11:43.940514 28968 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:43.941147 29646 ts_tablet_manager.cc:1434] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:11:43.941255 29482 raft_consensus.cc:2804] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.941953 29482 raft_consensus.cc:697] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 LEADER]: Becoming Leader. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:43.942656 29482 consensus_queue.cc:237] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:43.963049 29646 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:43.971374 28748 catalog_manager.cc:5697] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e reported cstate change: term changed from 1 to 3, leader changed from c2d8ce5db69d488bac364452e3c87684 (127.21.67.193) to aceb6f6c95434708b96f7552ee379a8e (127.21.67.195). New cstate: current_term: 3 leader_uuid: "aceb6f6c95434708b96f7552ee379a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.982391 29733 raft_consensus.cc:3060] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.115526 29646 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.116778 29646 tablet_bootstrap.cc:492] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.117426 29646 ts_tablet_manager.cc:1403] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.155s	user 0.055s	sys 0.044s
I20260709 13:11:44.148151 29646 raft_consensus.cc:359] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.149093 29646 raft_consensus.cc:740] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.150039 29646 consensus_queue.cc:260] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.159102 29646 ts_tablet_manager.cc:1434] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:11:44.161439 29646 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.197127 29646 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.197856 29646 tablet_bootstrap.cc:492] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.198339 29646 ts_tablet_manager.cc:1403] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.001s
I20260709 13:11:44.200428 29646 raft_consensus.cc:359] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:44.201025 29646 raft_consensus.cc:740] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.201617 29646 consensus_queue.cc:260] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:44.207022 29646 ts_tablet_manager.cc:1434] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:44.207763 29646 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.228914 29646 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.229861 29646 tablet_bootstrap.cc:492] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.230530 29646 ts_tablet_manager.cc:1403] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 13:11:44.233475 29646 raft_consensus.cc:359] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.234172 29646 raft_consensus.cc:740] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.234853 29646 consensus_queue.cc:260] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.237000 29646 ts_tablet_manager.cc:1434] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:44.237831 29646 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.239799 29733 raft_consensus.cc:3060] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.295922 29733 raft_consensus.cc:3060] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.356837 29646 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.357841 29646 tablet_bootstrap.cc:492] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.358479 29646 ts_tablet_manager.cc:1403] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.121s	user 0.050s	sys 0.021s
I20260709 13:11:44.361088 29646 raft_consensus.cc:359] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:44.361941 29646 raft_consensus.cc:740] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.362673 29646 consensus_queue.cc:260] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:44.365028 29646 ts_tablet_manager.cc:1434] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:11:44.365926 29646 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.384424 29724 raft_consensus.cc:3060] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.408207 29646 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.409343 29646 tablet_bootstrap.cc:492] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.410097 29646 ts_tablet_manager.cc:1403] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.008s
I20260709 13:11:44.412799 29646 raft_consensus.cc:359] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.413540 29646 raft_consensus.cc:740] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.414357 29646 consensus_queue.cc:260] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.416821 29646 ts_tablet_manager.cc:1434] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:44.417671 29646 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.430578 29072 raft_consensus.cc:1275] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:44.436117 29509 consensus_queue.cc:1048] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.440469 29646 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.441484 29646 tablet_bootstrap.cc:492] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.442274 29646 ts_tablet_manager.cc:1403] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 13:11:44.445151 29646 raft_consensus.cc:359] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.445833 29646 raft_consensus.cc:740] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.446712 29646 consensus_queue.cc:260] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.449452 29646 ts_tablet_manager.cc:1434] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:44.450260 29646 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.453557 28996 raft_consensus.cc:1275] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:44.462730 29733 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.471328 29646 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.472028 29838 consensus_queue.cc:1048] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.472373 29646 tablet_bootstrap.cc:492] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.473280 29646 ts_tablet_manager.cc:1403] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:11:44.475920 29646 raft_consensus.cc:359] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.476631 29646 raft_consensus.cc:740] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.477504 29646 consensus_queue.cc:260] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.479877 29646 ts_tablet_manager.cc:1434] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:44.480698 29646 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.482368 29733 raft_consensus.cc:1275] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Refusing update from remote peer 4f69f6a7e69e4093b7779d80aab42eb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:44.484457 29668 consensus_queue.cc:1048] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.502964 29646 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.503952 29646 tablet_bootstrap.cc:492] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.504695 29646 ts_tablet_manager.cc:1403] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.006s
I20260709 13:11:44.507100 29646 raft_consensus.cc:359] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.507817 29646 raft_consensus.cc:740] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.508617 29646 consensus_queue.cc:260] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.511013 29646 ts_tablet_manager.cc:1434] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:11:44.511842 29646 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.521108 29717 raft_consensus.cc:1275] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Refusing update from remote peer aceb6f6c95434708b96f7552ee379a8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:44.524648 29482 consensus_queue.cc:1048] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.534338 29646 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.535219 29646 tablet_bootstrap.cc:492] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.535916 29646 ts_tablet_manager.cc:1403] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 13:11:44.538427 29646 raft_consensus.cc:359] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.539135 29646 raft_consensus.cc:740] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.539839 29646 consensus_queue.cc:260] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.541981 29646 ts_tablet_manager.cc:1434] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:44.542840 29646 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.684840 29646 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.685881 29646 tablet_bootstrap.cc:492] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.686532 29646 ts_tablet_manager.cc:1403] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.144s	user 0.045s	sys 0.060s
I20260709 13:11:44.690336 29646 raft_consensus.cc:359] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:44.691067 29646 raft_consensus.cc:740] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.691756 29646 consensus_queue.cc:260] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:44.700402 29646 ts_tablet_manager.cc:1434] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:11:44.701187 29646 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
W20260709 13:11:44.710546 28894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:38499, user_credentials={real_user=slave}} blocked reactor thread for 108995us
I20260709 13:11:44.730746 29646 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.731925 29646 tablet_bootstrap.cc:492] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.732652 29646 ts_tablet_manager.cc:1403] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.001s
I20260709 13:11:44.735469 29646 raft_consensus.cc:359] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.736239 29646 raft_consensus.cc:740] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.737077 29646 consensus_queue.cc:260] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.738828 29719 raft_consensus.cc:3060] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.739382 29646 ts_tablet_manager.cc:1434] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:44.740262 29646 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.756117 29646 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.757077 29646 tablet_bootstrap.cc:492] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.757727 29646 ts_tablet_manager.cc:1403] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:11:44.760025 29646 raft_consensus.cc:359] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.760715 29646 raft_consensus.cc:740] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.761454 29646 consensus_queue.cc:260] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.763597 29646 ts_tablet_manager.cc:1434] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:44.764354 29646 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.781109 29724 raft_consensus.cc:3060] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.809252 29646 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.810168 29646 tablet_bootstrap.cc:492] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.810802 29646 ts_tablet_manager.cc:1403] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 13:11:44.813436 29720 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.813583 29646 raft_consensus.cc:359] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.814363 29646 raft_consensus.cc:740] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.815049 29646 consensus_queue.cc:260] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:44.817140 29646 ts_tablet_manager.cc:1434] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:44.818363 29646 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Bootstrap starting.
I20260709 13:11:44.866552 29646 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:44.867681 29646 tablet_bootstrap.cc:492] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Bootstrap complete.
I20260709 13:11:44.868367 29646 ts_tablet_manager.cc:1403] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.010s
I20260709 13:11:44.870888 29646 raft_consensus.cc:359] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.871572 29646 raft_consensus.cc:740] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.872344 29646 consensus_queue.cc:260] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:44.874209 29646 ts_tablet_manager.cc:1434] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:11:53.499027 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:53.552874 29000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:53.553467 29000 raft_consensus.cc:606] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:53.564152 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3867b16885df491794bbf87eb1e86929"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:53.564687 28928 raft_consensus.cc:606] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:53.569561 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:53.570081 28928 raft_consensus.cc:606] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:53.572821 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:53.573244 28928 raft_consensus.cc:606] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Received request to transfer leadership to TS 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:53.575242 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:53.575762 28928 raft_consensus.cc:606] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Received request to transfer leadership to TS 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:53.578503 28921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:53.579111 28921 raft_consensus.cc:606] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:53.580086 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:53.581377 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:53.598032 29895 raft_consensus.cc:993] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:53.598665 29885 raft_consensus.cc:1081] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:53.600018 29720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38526
I20260709 13:11:53.600453 29720 raft_consensus.cc:493] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:53.600734 29720 raft_consensus.cc:3060] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.605840 29720 raft_consensus.cc:515] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:53.608263 29720 leader_election.cc:290] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:53.608363 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:53.609208 29000 raft_consensus.cc:3055] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:53.609505 29000 raft_consensus.cc:740] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:53.610565 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32aa6e090fad4445aaffd93f96c470d6" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:53.610356 29000 consensus_queue.cc:260] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:53.612231 29000 raft_consensus.cc:3060] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.611037 29075 raft_consensus.cc:3060] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.621274 29000 raft_consensus.cc:2468] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:53.621938 29075 raft_consensus.cc:2468] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:53.622918 29643 leader_election.cc:304] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:53.631419 29901 raft_consensus.cc:2804] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:53.640879 29901 raft_consensus.cc:697] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:53.642140 29901 consensus_queue.cc:237] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:53.991766 28748 catalog_manager.cc:5697] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.182830 29075 raft_consensus.cc:1275] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.183701 29914 raft_consensus.cc:993] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:54.184198 29914 raft_consensus.cc:1081] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Signalling peer 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:54.188462 29907 raft_consensus.cc:993] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:54.188982 29914 raft_consensus.cc:1081] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Signalling peer 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:54.188886 29901 consensus_queue.cc:1048] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:54.210719 29069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977"
dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:47246
I20260709 13:11:54.211212 29069 raft_consensus.cc:493] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.211516 29069 raft_consensus.cc:3060] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.220463 29914 raft_consensus.cc:993] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.221259 29907 raft_consensus.cc:1081] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.222254 29069 raft_consensus.cc:515] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:54.223554 29910 raft_consensus.cc:993] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.224040 29068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4"
dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:47246
I20260709 13:11:54.224623 29068 raft_consensus.cc:493] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.224969 29068 raft_consensus.cc:3060] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.224133 29910 raft_consensus.cc:1081] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.235312 29068 raft_consensus.cc:515] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:54.243793 29069 leader_election.cc:290] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:54.249931 29068 leader_election.cc:290] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:54.250690 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.253201 28928 raft_consensus.cc:3055] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:54.253574 28928 raft_consensus.cc:740] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:54.254184 29912 raft_consensus.cc:993] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.254693 29912 raft_consensus.cc:1081] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.254472 28928 consensus_queue.cc:260] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:54.255380 28928 raft_consensus.cc:3060] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.252095 29720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:54.260059 29720 raft_consensus.cc:493] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.260566 29720 raft_consensus.cc:3060] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.251380 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.261219 28921 raft_consensus.cc:3055] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:54.261586 28921 raft_consensus.cc:740] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:54.262421 28921 consensus_queue.cc:260] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:54.263392 28921 raft_consensus.cc:3060] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.266372 29719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3867b16885df491794bbf87eb1e86929"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:54.266901 29719 raft_consensus.cc:493] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.267256 29719 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.252645 29733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:54.268006 29733 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.268476 29733 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.276441 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ead15c3afd4bffac3533ab972efba4" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:54.277078 28998 raft_consensus.cc:3060] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.279533 29719 raft_consensus.cc:515] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.280532 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d383bc02730e4f5fba0c090fd15c5977" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:54.281097 29000 raft_consensus.cc:3060] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.284404 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:54.284986 28997 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.292363 28997 raft_consensus.cc:2468] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:54.294040 29643 leader_election.cc:304] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:54.294620 28998 raft_consensus.cc:2468] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:54.296329 29000 raft_consensus.cc:2468] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:54.298661 29042 leader_election.cc:304] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:54.299530 29918 raft_consensus.cc:2804] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.300005 29002 raft_consensus.cc:1240] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Rejecting Update request from peer 4f69f6a7e69e4093b7779d80aab42eb4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:54.292761 29719 leader_election.cc:290] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:54.301069 29042 leader_election.cc:304] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:54.301964 29897 raft_consensus.cc:2804] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.302456 29897 raft_consensus.cc:697] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:54.300007 29918 raft_consensus.cc:697] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:54.303328 29897 consensus_queue.cc:237] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:54.303900 28921 raft_consensus.cc:2468] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:54.304039 29918 consensus_queue.cc:237] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:54.306489 29720 raft_consensus.cc:515] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.307403 28928 raft_consensus.cc:2468] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:54.316255 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867b16885df491794bbf87eb1e86929" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.316771 28928 raft_consensus.cc:3055] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.317051 28928 raft_consensus.cc:740] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:54.317843 28928 consensus_queue.cc:260] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.320549 28928 raft_consensus.cc:3060] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.303007 29733 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.319329 29720 leader_election.cc:290] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:54.329937 28928 raft_consensus.cc:2468] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:54.335356 29733 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 4 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:54.337709 29901 raft_consensus.cc:2804] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.338172 29901 raft_consensus.cc:697] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:54.344458 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.344707 29002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c8976eac9c455aa167b1de76150656" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:54.345270 29002 raft_consensus.cc:3060] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.346489 29901 consensus_queue.cc:237] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.345094 28921 raft_consensus.cc:3055] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:54.348047 28921 raft_consensus.cc:740] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:54.352068 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.352771 28928 raft_consensus.cc:3055] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:54.353152 28928 raft_consensus.cc:740] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:54.358621 28921 consensus_queue.cc:260] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.359700 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e35b460c6a457091d81b9da6ad5c56" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:54.360050 28921 raft_consensus.cc:3060] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.360306 28997 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.360692 29002 raft_consensus.cc:2468] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:54.361850 29643 leader_election.cc:304] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:54.361660 28748 catalog_manager.cc:5697] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.362782 29927 raft_consensus.cc:2804] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.363252 29927 raft_consensus.cc:697] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:54.359127 28998 raft_consensus.cc:1275] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.364172 29927 consensus_queue.cc:237] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.364168 28748 catalog_manager.cc:5697] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.367713 28921 raft_consensus.cc:2468] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:54.370193 28997 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 4.
I20260709 13:11:54.386255 28928 consensus_queue.cc:260] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.395023 28928 raft_consensus.cc:3060] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.397145 29643 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:54.389226 29926 consensus_queue.cc:1048] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:54.400913 29926 raft_consensus.cc:2804] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:54.401355 29926 raft_consensus.cc:697] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 4 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:54.402338 29926 consensus_queue.cc:237] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.409148 28928 raft_consensus.cc:2468] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 4.
I20260709 13:11:54.440517 28748 catalog_manager.cc:5697] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 2 to 3, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.442149 28748 catalog_manager.cc:5697] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.443555 28748 catalog_manager.cc:5697] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 3 to 4, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 4 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.627465 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:54.671926 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:54.718575 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:54.719063 28928 raft_consensus.cc:606] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:54.721526 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:54.722072 28928 raft_consensus.cc:606] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:54.722476 29920 raft_consensus.cc:993] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.723073 29920 raft_consensus.cc:1081] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.724607 29733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:54.724869 28997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:54.725265 29733 raft_consensus.cc:493] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.725512 28997 raft_consensus.cc:606] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:54.725680 29733 raft_consensus.cc:3060] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.726917 28928 raft_consensus.cc:1275] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.728082 29926 consensus_queue.cc:1048] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.728364 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:54.728904 28928 raft_consensus.cc:606] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:54.733067 28921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:54.733596 28921 raft_consensus.cc:606] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:54.736346 29733 raft_consensus.cc:515] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.737072 28997 raft_consensus.cc:1275] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.738431 29733 leader_election.cc:290] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:54.739573 29901 consensus_queue.cc:1048] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.741150 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:54.741698 28997 raft_consensus.cc:3060] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.745867 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ac272a33ca49f2b3a823dba78768e5" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.746429 28928 raft_consensus.cc:3055] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:54.746731 28928 raft_consensus.cc:740] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:54.747534 28928 consensus_queue.cc:260] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.748670 28928 raft_consensus.cc:3060] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.750456 28998 raft_consensus.cc:1275] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.752440 28927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a"
dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:11:54.752960 28927 raft_consensus.cc:606] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:54.754755 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:54.755424 28928 raft_consensus.cc:2468] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:54.757170 29643 leader_election.cc:304] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:54.757505 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:54.758832 29901 consensus_queue.cc:1048] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.761687 29901 raft_consensus.cc:2804] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.763904 29901 raft_consensus.cc:697] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:54.765094 29901 consensus_queue.cc:237] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:54.763541 28997 raft_consensus.cc:2468] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:54.781189 28997 raft_consensus.cc:1275] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.783761 29897 consensus_queue.cc:1048] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.791605 29920 raft_consensus.cc:993] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.792824 29920 raft_consensus.cc:1081] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.797098 29719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:54.797719 29719 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.798084 29719 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.811523 28921 raft_consensus.cc:1275] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.812635 29902 raft_consensus.cc:993] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.819161 29917 raft_consensus.cc:1081] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:54.823590 28921 raft_consensus.cc:1275] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.823783 29717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38526
I20260709 13:11:54.824450 29717 raft_consensus.cc:493] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.824790 29717 raft_consensus.cc:3060] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.825342 29921 consensus_queue.cc:1048] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.826150 28748 catalog_manager.cc:5697] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.827515 29934 consensus_queue.cc:1048] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:54.836521 29717 raft_consensus.cc:515] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:54.839689 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:54.840211 28998 raft_consensus.cc:3055] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:54.840512 28998 raft_consensus.cc:740] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:54.841249 28998 consensus_queue.cc:260] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:54.842269 28998 raft_consensus.cc:3060] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.849067 28998 raft_consensus.cc:2468] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:54.853202 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31bd89e5e6ee4b6e92d1ad1ea58721bb" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.853852 28922 raft_consensus.cc:3060] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.822574 29719 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:54.853497 29643 leader_election.cc:304] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:54.855808 29934 raft_consensus.cc:2804] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.856287 29934 raft_consensus.cc:697] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:54.857101 29934 consensus_queue.cc:237] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:54.861490 28922 raft_consensus.cc:2468] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:54.863972 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:54.864542 29068 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.852159 29717 leader_election.cc:290] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:54.864574 29719 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:54.875216 29068 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:54.876048 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1edbded562c47dcb0e8bf5320a0b28a" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:54.876559 29641 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:54.876646 28922 raft_consensus.cc:3055] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.877359 28922 raft_consensus.cc:740] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:54.877602 29932 raft_consensus.cc:2804] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.878126 29932 raft_consensus.cc:697] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:54.878137 28922 consensus_queue.cc:260] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:54.879411 28922 raft_consensus.cc:3060] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.879034 29932 consensus_queue.cc:237] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:54.879772 28749 catalog_manager.cc:5697] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.884716 28922 raft_consensus.cc:2468] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:54.890121 28998 raft_consensus.cc:1275] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.891296 29946 consensus_queue.cc:1048] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.896601 28749 catalog_manager.cc:5697] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 2 to 3, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.901247 28922 raft_consensus.cc:1275] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.903276 29897 consensus_queue.cc:1048] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.920562 28998 raft_consensus.cc:1275] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:54.921651 29932 consensus_queue.cc:1048] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.930603 28922 raft_consensus.cc:1275] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 4 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:54.932435 29934 consensus_queue.cc:1048] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:55.052654 29912 raft_consensus.cc:993] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:55.053047 29910 raft_consensus.cc:1081] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:55.054422 29717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:55.054955 29717 raft_consensus.cc:493] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:55.055281 29717 raft_consensus.cc:3060] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:55.060387 29717 raft_consensus.cc:515] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:11:55.060653 28781 debug-util.cc:398] Leaking SignalData structure 0x7b0800009c80 after lost signal to thread 21778
W20260709 13:11:55.061586 28781 debug-util.cc:398] Leaking SignalData structure 0x7b0800266ce0 after lost signal to thread 28784
I20260709 13:11:55.062655 29717 leader_election.cc:290] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:55.062795 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
W20260709 13:11:55.062824 28781 debug-util.cc:398] Leaking SignalData structure 0x7b0800308a40 after lost signal to thread 28952
I20260709 13:11:55.063639 29068 raft_consensus.cc:3060] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:55.064446 28781 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad0a0 after lost signal to thread 29026
W20260709 13:11:55.065570 28781 debug-util.cc:398] Leaking SignalData structure 0x7b0800307340 after lost signal to thread 29100
W20260709 13:11:55.066716 28781 debug-util.cc:398] Leaking SignalData structure 0x7b080032bbe0 after lost signal to thread 29795
I20260709 13:11:55.070020 29068 raft_consensus.cc:2468] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:55.071523 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cfc847797b84ec4be004a36829f8488" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:55.071622 29641 leader_election.cc:304] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:55.072242 28922 raft_consensus.cc:3055] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:55.072561 29932 raft_consensus.cc:2804] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:55.072613 28922 raft_consensus.cc:740] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:55.073228 29932 raft_consensus.cc:697] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:55.073805 28922 consensus_queue.cc:260] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:55.074139 29932 consensus_queue.cc:237] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:55.075207 28922 raft_consensus.cc:3060] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:55.087595 28922 raft_consensus.cc:2468] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:55.089282 28749 catalog_manager.cc:5697] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.107213 29920 raft_consensus.cc:993] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:55.107700 29912 raft_consensus.cc:1081] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:55.109234 29717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:55.109843 29717 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:55.110827 29717 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.116855 29717 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:55.121147 29717 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Requested vote from peers 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:11:55.121253 29068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:55.121833 29068 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.128835 29068 raft_consensus.cc:2468] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:55.131356 29641 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:55.132073 29932 raft_consensus.cc:2804] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:55.132529 29932 raft_consensus.cc:697] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:55.133344 29932 consensus_queue.cc:237] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:55.134366 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9f352e256845538a894cae38c64fa8" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:55.141512 28922 raft_consensus.cc:3055] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:55.144299 28922 raft_consensus.cc:740] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:55.145000 28922 consensus_queue.cc:260] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:11:55.146169 28922 raft_consensus.cc:3060] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.145505 28749 catalog_manager.cc:5697] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 2 to 3, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.152601 28922 raft_consensus.cc:2468] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:55.172442 28922 raft_consensus.cc:1275] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:55.173610 29934 consensus_queue.cc:1048] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.184163 28998 raft_consensus.cc:1275] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:55.185475 29901 consensus_queue.cc:1048] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.193249 29910 raft_consensus.cc:993] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:55.193692 29910 raft_consensus.cc:1081] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:55.195799 29717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38542
I20260709 13:11:55.196389 29717 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:55.196767 29717 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.214056 29717 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:55.220260 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:55.221225 28922 raft_consensus.cc:3055] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:55.221362 29717 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:55.221583 28922 raft_consensus.cc:740] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f69f6a7e69e4093b7779d80aab42eb4, State: Running, Role: LEADER
I20260709 13:11:55.227983 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635cf54d22ac4cdabf0f6db66801dbfc" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:55.228538 28997 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.232270 28922 consensus_queue.cc:260] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:55.233533 28922 raft_consensus.cc:3060] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.245494 28997 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:55.247051 28922 raft_consensus.cc:2468] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:55.254334 29643 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:55.256421 29901 raft_consensus.cc:2804] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:55.257771 29901 raft_consensus.cc:697] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:55.259011 29901 consensus_queue.cc:237] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:55.275830 28749 catalog_manager.cc:5697] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 2 to 3, leader changed from 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.277561 28922 raft_consensus.cc:1275] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:55.279281 29934 consensus_queue.cc:1048] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.296044 28997 raft_consensus.cc:1275] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:55.297436 29932 consensus_queue.cc:1048] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.354470 29068 raft_consensus.cc:1275] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:55.355953 29932 consensus_queue.cc:1048] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:55.368541 28928 raft_consensus.cc:1275] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:55.371313 29934 consensus_queue.cc:1048] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:55.546424 29069 raft_consensus.cc:1275] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:55.547901 29934 consensus_queue.cc:1048] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:55.580670 28921 raft_consensus.cc:1275] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:55.582813 29934 consensus_queue.cc:1048] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:55.589205 28928 raft_consensus.cc:1275] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:55.590721 29934 consensus_queue.cc:1048] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.619450 29069 raft_consensus.cc:1275] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:55.620826 29901 consensus_queue.cc:1048] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.748186 28921 raft_consensus.cc:1275] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:55.749672 29901 consensus_queue.cc:1048] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.759528 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:55.769618 28997 raft_consensus.cc:1275] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:55.842669 29927 consensus_queue.cc:1048] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:55.868919 28892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 44129.6us
I20260709 13:11:55.919605 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:56.067507 28997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05512d8f790140339c5f183c562dc66e"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:56.068305 28997 raft_consensus.cc:606] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:56.073205 28997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12e40825a515491787d337419dfac76a"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:56.073709 28997 raft_consensus.cc:606] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 LEADER]: Received request to transfer leadership to TS 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:56.076238 28997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4571f43feac9476eac9fa165998239fa"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:56.076903 28997 raft_consensus.cc:606] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:56.079519 28997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:56.080015 28997 raft_consensus.cc:606] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:56.082499 28997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:56.082933 28997 raft_consensus.cc:606] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:56.083931 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:56.085407 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:56.254272 29971 raft_consensus.cc:993] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:56.254896 29971 raft_consensus.cc:1081] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 LEADER]: Signalling peer 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:56.257072 29970 raft_consensus.cc:993] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:56.257315 29072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12e40825a515491787d337419dfac76a"
dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:11:56.257560 29902 raft_consensus.cc:1081] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:56.257934 29072 raft_consensus.cc:493] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.258337 29072 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.261744 29717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05512d8f790140339c5f183c562dc66e"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38526
I20260709 13:11:56.262385 29717 raft_consensus.cc:493] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.262781 29717 raft_consensus.cc:3060] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.262836 29924 raft_consensus.cc:993] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:56.264552 29924 raft_consensus.cc:1081] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:56.272675 29072 raft_consensus.cc:515] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:56.273967 29719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4571f43feac9476eac9fa165998239fa"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38526
I20260709 13:11:56.276564 29719 raft_consensus.cc:493] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.276934 29719 raft_consensus.cc:3060] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.277701 29072 leader_election.cc:290] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:11:56.278584 28997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:56.279131 28997 raft_consensus.cc:3055] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:56.272500 29717 raft_consensus.cc:515] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:56.279413 28997 raft_consensus.cc:740] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:56.281561 29717 leader_election.cc:290] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:56.282660 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:56.282765 28997 consensus_queue.cc:260] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:56.283239 29000 raft_consensus.cc:3055] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:56.283561 29000 raft_consensus.cc:740] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:56.284085 28997 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.284217 29719 raft_consensus.cc:515] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:56.284487 29000 consensus_queue.cc:260] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:56.285681 29000 raft_consensus.cc:3060] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.286727 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:56.287457 28998 raft_consensus.cc:3055] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:56.287837 28998 raft_consensus.cc:740] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:56.288764 28998 consensus_queue.cc:260] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:56.290182 28998 raft_consensus.cc:3060] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.292495 29719 leader_election.cc:290] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:56.294279 29072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571f43feac9476eac9fa165998239fa" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:56.295900 29072 raft_consensus.cc:3060] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.298812 29717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e40825a515491787d337419dfac76a" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
I20260709 13:11:56.299351 29717 raft_consensus.cc:3060] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.303442 28997 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 4.
I20260709 13:11:56.304800 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05512d8f790140339c5f183c562dc66e" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:56.299373 28998 raft_consensus.cc:2468] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:56.304678 29042 leader_election.cc:304] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:56.306622 29915 raft_consensus.cc:2804] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:56.306751 29643 leader_election.cc:304] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:56.307127 29915 raft_consensus.cc:697] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 4 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:56.307400 28921 raft_consensus.cc:3060] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.308194 29915 consensus_queue.cc:237] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:56.308655 29977 raft_consensus.cc:2804] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:56.311221 29977 raft_consensus.cc:697] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:56.311105 29717 raft_consensus.cc:2468] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 4.
I20260709 13:11:56.312330 29977 consensus_queue.cc:237] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:56.316448 28921 raft_consensus.cc:2468] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:56.318264 29643 leader_election.cc:304] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:56.319314 29934 raft_consensus.cc:2804] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:56.319849 29934 raft_consensus.cc:697] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:56.320732 29934 consensus_queue.cc:237] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:11:56.337164 28747 catalog_manager.cc:5697] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 3 to 4, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 4 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.341524 28749 catalog_manager.cc:5697] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.323189 29000 raft_consensus.cc:2468] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:56.352944 29072 raft_consensus.cc:2468] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:56.402611 28749 catalog_manager.cc:5697] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.409981 29924 raft_consensus.cc:993] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:56.410462 29970 raft_consensus.cc:1081] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:56.411945 29069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765"
dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:11:56.412427 29069 raft_consensus.cc:493] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.412762 29069 raft_consensus.cc:3060] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.419562 29069 raft_consensus.cc:515] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:56.421669 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:56.422235 28921 raft_consensus.cc:3060] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.422401 29069 leader_election.cc:290] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:56.423991 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f85562ef38442c0b5fb6d5e97520765" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:56.424578 29000 raft_consensus.cc:3055] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:56.424862 29000 raft_consensus.cc:740] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:56.425582 29000 consensus_queue.cc:260] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:56.426739 29000 raft_consensus.cc:3060] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.429080 28921 raft_consensus.cc:2468] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:56.432848 29042 leader_election.cc:304] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, 4f69f6a7e69e4093b7779d80aab42eb4; no voters: 
I20260709 13:11:56.433570 29897 raft_consensus.cc:2804] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:56.434022 29897 raft_consensus.cc:697] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:56.434823 29897 consensus_queue.cc:237] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:56.436355 29000 raft_consensus.cc:2468] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:56.447049 28747 catalog_manager.cc:5697] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.580403 29924 raft_consensus.cc:993] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:56.580909 29924 raft_consensus.cc:1081] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:56.582368 29069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c"
dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:11:56.582906 29069 raft_consensus.cc:493] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.583236 29069 raft_consensus.cc:3060] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.590306 29069 raft_consensus.cc:515] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:56.592240 29069 leader_election.cc:290] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:56.592782 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:56.593097 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed5593d39e541d6b2eb401c3bc41f9c" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:56.593406 28921 raft_consensus.cc:3060] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.593644 29000 raft_consensus.cc:3055] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:56.593957 29000 raft_consensus.cc:740] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:56.594705 29000 consensus_queue.cc:260] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:56.595745 29000 raft_consensus.cc:3060] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:56.602777 29000 raft_consensus.cc:2468] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:56.603595 28921 raft_consensus.cc:2468] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:56.604233 29042 leader_election.cc:304] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:56.605319 29915 raft_consensus.cc:2804] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:56.605824 29915 raft_consensus.cc:697] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:56.606602 29915 consensus_queue.cc:237] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:56.641264 28747 catalog_manager.cc:5697] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.701862 29069 raft_consensus.cc:1275] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:56.703173 29977 consensus_queue.cc:1048] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:56.705825 29000 raft_consensus.cc:1275] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:56.708014 29977 consensus_queue.cc:1048] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:56.775936 29000 raft_consensus.cc:1275] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:56.778357 29987 consensus_queue.cc:1048] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.778929 29719 raft_consensus.cc:1275] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 4 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:56.784911 29987 consensus_queue.cc:1048] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.884058 28921 raft_consensus.cc:1275] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:56.885136 29977 consensus_queue.cc:1048] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:56.901551 28997 raft_consensus.cc:1275] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:56.912045 29977 consensus_queue.cc:1048] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:56.953212 29000 raft_consensus.cc:1275] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:56.954717 29987 consensus_queue.cc:1048] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:56.964834 28921 raft_consensus.cc:1275] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:56.966301 29915 consensus_queue.cc:1048] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.086279 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:57.096453 29000 raft_consensus.cc:1275] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.098050 29988 consensus_queue.cc:1048] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.118189 28921 raft_consensus.cc:1275] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.119619 29988 consensus_queue.cc:1048] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.188383 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:57.243296 29000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:57.243947 29000 raft_consensus.cc:606] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:57.247267 29000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bd18196206443bb8d02853f289677a9"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:57.247974 29000 raft_consensus.cc:606] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:57.253661 29000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d34c5f0983b472d988e26619d914252"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:57.254277 29000 raft_consensus.cc:606] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS 1b99cdfeeb2f418fa34b0ac78532b59c
I20260709 13:11:57.256825 29000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789"
dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
mode: GRACEFUL
new_leader_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38646
I20260709 13:11:57.257380 29000 raft_consensus.cc:606] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Received request to transfer leadership to TS c2d8ce5db69d488bac364452e3c87684
I20260709 13:11:57.258412 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:57.259734 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:57.271193 30002 raft_consensus.cc:993] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:57.271901 30002 raft_consensus.cc:1081] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer 1b99cdfeeb2f418fa34b0ac78532b59c to start an election
I20260709 13:11:57.273411 29069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d34c5f0983b472d988e26619d914252"
dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:11:57.273931 29069 raft_consensus.cc:493] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.274292 29069 raft_consensus.cc:3060] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.288160 29069 raft_consensus.cc:515] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:57.289945 29069 leader_election.cc:290] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Requested vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:11:57.291150 28922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d34c5f0983b472d988e26619d914252" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f69f6a7e69e4093b7779d80aab42eb4"
I20260709 13:11:57.291421 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d34c5f0983b472d988e26619d914252" candidate_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:57.291752 28922 raft_consensus.cc:3060] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.292086 29000 raft_consensus.cc:3055] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.292405 29000 raft_consensus.cc:740] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:57.293061 29000 consensus_queue.cc:260] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:57.294024 29000 raft_consensus.cc:3060] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.298804 28922 raft_consensus.cc:2468] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:57.300825 29000 raft_consensus.cc:2468] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b99cdfeeb2f418fa34b0ac78532b59c in term 2.
I20260709 13:11:57.303232 29042 leader_election.cc:304] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, aceb6f6c95434708b96f7552ee379a8e; no voters: 
I20260709 13:11:57.304343 29897 raft_consensus.cc:2804] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.304816 29897 raft_consensus.cc:697] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Becoming Leader. State: Replica: 1b99cdfeeb2f418fa34b0ac78532b59c, State: Running, Role: LEADER
I20260709 13:11:57.305675 29897 consensus_queue.cc:237] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:11:57.317481 28748 catalog_manager.cc:5697] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196). New cstate: current_term: 2 leader_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.423000 30002 raft_consensus.cc:993] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:57.423527 29924 raft_consensus.cc:1081] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:57.425458 29719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bd18196206443bb8d02853f289677a9"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38526
I20260709 13:11:57.425907 29719 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.426192 29719 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.434458 29719 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.436201 29719 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:57.436920 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:57.437314 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd18196206443bb8d02853f289677a9" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:57.437568 29000 raft_consensus.cc:3055] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:57.437877 29000 raft_consensus.cc:740] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:57.437881 29069 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.439432 29000 consensus_queue.cc:260] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.440634 29000 raft_consensus.cc:3060] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.445112 29069 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:57.445680 29000 raft_consensus.cc:2468] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 3.
I20260709 13:11:57.446233 29641 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:57.447006 29934 raft_consensus.cc:2804] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:57.447419 29934 raft_consensus.cc:697] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:57.448074 29934 consensus_queue.cc:237] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.459795 28749 catalog_manager.cc:5697] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 2 to 3, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 3 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.536485 30002 raft_consensus.cc:993] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:57.536988 29924 raft_consensus.cc:1081] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:57.538748 29719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38526
I20260709 13:11:57.539299 29719 raft_consensus.cc:493] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.539606 29719 raft_consensus.cc:3060] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.548511 29719 raft_consensus.cc:515] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.550406 29719 leader_election.cc:290] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:57.551031 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:57.551716 29000 raft_consensus.cc:3055] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.552027 29000 raft_consensus.cc:740] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:57.553391 29000 consensus_queue.cc:260] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.553812 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4840a88b2d49ce845b056aa75275ae" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:57.554462 29000 raft_consensus.cc:3060] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.554486 29069 raft_consensus.cc:3060] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.565824 29000 raft_consensus.cc:2468] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:57.567027 29643 leader_election.cc:304] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:57.567816 29901 raft_consensus.cc:2804] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.568302 29901 raft_consensus.cc:697] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:57.569146 29901 consensus_queue.cc:237] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.575549 29069 raft_consensus.cc:2468] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:57.632189 28749 catalog_manager.cc:5697] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.694959 28922 raft_consensus.cc:1275] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.714918 29924 raft_consensus.cc:993] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e: : Instructing follower c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:57.715997 29924 raft_consensus.cc:1081] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Signalling peer c2d8ce5db69d488bac364452e3c87684 to start an election
I20260709 13:11:57.718448 29720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789"
dest_uuid: "c2d8ce5db69d488bac364452e3c87684"
 from {username='slave'} at 127.0.0.1:38526
I20260709 13:11:57.719238 29720 raft_consensus.cc:493] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.719713 29720 raft_consensus.cc:3060] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.777714 29987 consensus_queue.cc:1048] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:11:57.795392 29720 raft_consensus.cc:515] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.804077 29720 leader_election.cc:290] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Requested vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), 1b99cdfeeb2f418fa34b0ac78532b59c (127.21.67.196:39417)
I20260709 13:11:57.808960 29069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c"
I20260709 13:11:57.809788 29069 raft_consensus.cc:3060] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:57.819432 28968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:38231, user_credentials={real_user=slave}} blocked reactor thread for 48116.3us
I20260709 13:11:57.820585 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4e8cf7700c469ab85e6216b8225789" candidate_uuid: "c2d8ce5db69d488bac364452e3c87684" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aceb6f6c95434708b96f7552ee379a8e"
I20260709 13:11:57.821434 29000 raft_consensus.cc:3055] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.821813 29000 raft_consensus.cc:740] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aceb6f6c95434708b96f7552ee379a8e, State: Running, Role: LEADER
I20260709 13:11:57.822824 29000 consensus_queue.cc:260] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.831521 29000 raft_consensus.cc:3060] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.866125 29000 raft_consensus.cc:2468] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:57.867928 29643 leader_election.cc:304] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684; no voters: 
I20260709 13:11:57.869554 29934 raft_consensus.cc:2804] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.870115 29934 raft_consensus.cc:697] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Becoming Leader. State: Replica: c2d8ce5db69d488bac364452e3c87684, State: Running, Role: LEADER
I20260709 13:11:57.871279 29934 consensus_queue.cc:237] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:11:57.901881 28749 catalog_manager.cc:5697] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 reported cstate change: term changed from 1 to 2, leader changed from aceb6f6c95434708b96f7552ee379a8e (127.21.67.195) to c2d8ce5db69d488bac364452e3c87684 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "c2d8ce5db69d488bac364452e3c87684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.908053 28997 raft_consensus.cc:1275] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer 1b99cdfeeb2f418fa34b0ac78532b59c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.911813 29987 consensus_queue.cc:1048] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.902148 29069 raft_consensus.cc:2468] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d8ce5db69d488bac364452e3c87684 in term 2.
I20260709 13:11:57.933897 29069 raft_consensus.cc:1275] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:57.936066 29901 consensus_queue.cc:1048] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:57.997684 28998 raft_consensus.cc:1275] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:58.000747 29977 consensus_queue.cc:1048] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:58.063335 28998 raft_consensus.cc:1275] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:58.065472 29977 consensus_queue.cc:1048] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.082849 29069 raft_consensus.cc:1275] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:58.086177 29901 consensus_queue.cc:1048] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.260720 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:58.301501 21775 tablet_server.cc:179] TabletServer@127.21.67.193:43757 shutting down...
W20260709 13:11:58.311877 28894 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 260 similar messages]
I20260709 13:11:58.313984 28998 raft_consensus.cc:1275] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:58.318058 30027 consensus_queue.cc:1048] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:58.319715 28894 consensus_peers.cc:597] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.330256 28968 consensus_peers.cc:597] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.349221 28894 consensus_peers.cc:597] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.351588 29072 raft_consensus.cc:1275] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Refusing update from remote peer c2d8ce5db69d488bac364452e3c87684: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:58.358238 29901 consensus_queue.cc:1048] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:58.366386 29042 consensus_peers.cc:597] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.372256 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:58.373334 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.374356 21775 raft_consensus.cc:2243] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.375028 21775 raft_consensus.cc:2272] T eb4e8cf7700c469ab85e6216b8225789 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.378410 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.379740 21775 raft_consensus.cc:2243] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.380263 21775 raft_consensus.cc:2272] T e7c6c665d7f64081a51c8c1b8167b26e P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.382766 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.383430 21775 raft_consensus.cc:2243] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.383934 21775 raft_consensus.cc:2272] T 5954e889e23845479415928960eb44ab P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.386298 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.386898 21775 raft_consensus.cc:2243] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.387359 21775 raft_consensus.cc:2272] T b8acd4f604914312a15bf2dcf21f7e21 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.389663 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.390292 21775 raft_consensus.cc:2243] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.390744 21775 raft_consensus.cc:2272] T e1766cdfb35f400dbee45175e8278150 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.393126 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.393894 21775 raft_consensus.cc:2243] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.394353 21775 raft_consensus.cc:2272] T 095c41dda35e41798dda1b4bdca1e55e P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.397065 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.397907 21775 raft_consensus.cc:2243] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.398948 21775 raft_consensus.cc:2272] T f6e35b460c6a457091d81b9da6ad5c56 P c2d8ce5db69d488bac364452e3c87684 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.402318 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.403069 21775 raft_consensus.cc:2243] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.403578 21775 raft_consensus.cc:2272] T a2f04d827ff541d9ad5feb028f6fec84 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.406472 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.407171 21775 raft_consensus.cc:2243] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.407680 21775 raft_consensus.cc:2272] T e1b93b33daae4eadbaab3085ddf2e1da P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.410704 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.411538 21775 raft_consensus.cc:2243] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.412214 21775 raft_consensus.cc:2272] T b65a86245d1042e3b9c4cbea4a2aa661 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.412313 28894 consensus_peers.cc:597] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.415342 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.416293 21775 raft_consensus.cc:2243] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.417279 21775 raft_consensus.cc:2272] T 2bd18196206443bb8d02853f289677a9 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.419544 29042 consensus_peers.cc:597] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.420727 21775 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:58.421386 29042 consensus_peers.cc:597] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.421574 21775 raft_consensus.cc:2243] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.422569 21775 raft_consensus.cc:2272] T 05512d8f790140339c5f183c562dc66e P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.425448 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.426065 21775 raft_consensus.cc:2243] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.426877 21775 raft_consensus.cc:2272] T 1f4840a88b2d49ce845b056aa75275ae P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.430576 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.431272 21775 raft_consensus.cc:2243] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.432395 21775 raft_consensus.cc:2272] T 0f9f352e256845538a894cae38c64fa8 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.435038 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.435858 21775 raft_consensus.cc:2243] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.436777 21775 raft_consensus.cc:2272] T 3867b16885df491794bbf87eb1e86929 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.439805 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.441249 21775 raft_consensus.cc:2243] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.441754 21775 raft_consensus.cc:2272] T 2f9cd3f2da964526b25e30af018cd9ef P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.444705 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.445230 21775 raft_consensus.cc:2243] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.445701 21775 raft_consensus.cc:2272] T 12e40825a515491787d337419dfac76a P c2d8ce5db69d488bac364452e3c87684 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.448268 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.448988 21775 raft_consensus.cc:2243] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.449473 21775 raft_consensus.cc:2272] T ca028d51a9934f5f93f321e1f06fb783 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.452443 21775 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:58.452900 28968 consensus_peers.cc:597] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.453210 21775 raft_consensus.cc:2243] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.453845 21775 raft_consensus.cc:2272] T 8071ad308999465eb78a22785db01b62 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.454021 28894 consensus_peers.cc:597] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.456369 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.457060 21775 raft_consensus.cc:2243] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.457485 21775 raft_consensus.cc:2272] T 875112fc0fc4410eb1a079bb5771d060 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.459784 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.460477 21775 raft_consensus.cc:2243] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.460934 21775 raft_consensus.cc:2272] T 56d98016c79645be808873970bf26945 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.464152 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.464818 21775 raft_consensus.cc:2243] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.465849 21775 raft_consensus.cc:2272] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.467195 29042 consensus_peers.cc:597] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.468729 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.469372 21775 raft_consensus.cc:2243] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.469839 21775 raft_consensus.cc:2272] T cd251d5537f14f37a55ab6d63637d34a P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.472997 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.474252 21775 raft_consensus.cc:2243] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.474763 21775 raft_consensus.cc:2272] T b8550ef17e8a41acbcdfe5eab4042fc2 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.477769 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.478528 21775 raft_consensus.cc:2243] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.479270 21775 raft_consensus.cc:2272] T b1edbded562c47dcb0e8bf5320a0b28a P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.490471 29042 consensus_peers.cc:597] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.490862 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.491808 21775 raft_consensus.cc:2243] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.492331 21775 raft_consensus.cc:2272] T abe7b1ea920e462e8b046d5d41f6bd8c P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.495319 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.496070 21775 raft_consensus.cc:2243] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.496702 21775 raft_consensus.cc:2272] T ea8542c2d49442dd8176393fb85f499e P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.499770 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.500551 21775 raft_consensus.cc:2243] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.501650 21775 raft_consensus.cc:2272] T c8c8976eac9c455aa167b1de76150656 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.504660 21775 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:58.505420 28968 consensus_peers.cc:597] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.505496 21775 raft_consensus.cc:2243] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.506227 21775 raft_consensus.cc:2272] T 7fa926f9b106492fa4f9170584cdc0d0 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.506969 28894 consensus_peers.cc:597] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.509479 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.510403 21775 raft_consensus.cc:2243] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.511013 21775 raft_consensus.cc:2272] T 70244d272ca8458a91edd4e2388bcbe0 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.512702 29042 consensus_peers.cc:597] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.514490 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.515357 21775 raft_consensus.cc:2243] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.515861 21775 raft_consensus.cc:2272] T 8d4e7fd2f04240aa908640daf9fc53df P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.519057 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.519932 21775 raft_consensus.cc:2243] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.521147 21775 raft_consensus.cc:2272] T 3cfc847797b84ec4be004a36829f8488 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.523311 28968 consensus_peers.cc:597] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.524343 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.525148 21775 raft_consensus.cc:2243] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.525722 21775 raft_consensus.cc:2272] T b955d423ccbf49f092ae423e2778518b P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.528564 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.529291 21775 raft_consensus.cc:2243] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.529878 21775 raft_consensus.cc:2272] T e0bb4f426f62474ea61c0ccd22e639f3 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.532943 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.533696 21775 raft_consensus.cc:2243] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.534680 21775 raft_consensus.cc:2272] T 635cf54d22ac4cdabf0f6db66801dbfc P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.537396 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.538177 21775 raft_consensus.cc:2243] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.538725 21775 raft_consensus.cc:2272] T cfe3bfc02d2a4c048cdf83ee4991fa10 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.542050 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.542779 21775 raft_consensus.cc:2243] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.543985 21775 raft_consensus.cc:2272] T 01ac272a33ca49f2b3a823dba78768e5 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.547060 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.547809 21775 raft_consensus.cc:2243] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.548262 21775 raft_consensus.cc:2272] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P c2d8ce5db69d488bac364452e3c87684 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.550938 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.551625 21775 raft_consensus.cc:2243] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:58.551813 28894 consensus_peers.cc:597] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.552258 21775 raft_consensus.cc:2272] T baf6422e395e4363ba3daf68501ad7b3 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.554997 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.555769 21775 raft_consensus.cc:2243] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.556278 21775 raft_consensus.cc:2272] T 78523bc7e80a431c8097160346435949 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.558892 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.559559 21775 raft_consensus.cc:2243] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.560117 21775 raft_consensus.cc:2272] T 999b5645c9a5429d89ef42071b72ff41 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.562966 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.563666 21775 raft_consensus.cc:2243] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.564659 21775 raft_consensus.cc:2272] T 4571f43feac9476eac9fa165998239fa P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.567477 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.568186 21775 raft_consensus.cc:2243] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.568750 21775 raft_consensus.cc:2272] T f5265c21310c410993aea23cd9588704 P c2d8ce5db69d488bac364452e3c87684 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.570063 28894 consensus_peers.cc:597] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.571713 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.572633 21775 raft_consensus.cc:2243] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.573854 21775 raft_consensus.cc:2272] T 32aa6e090fad4445aaffd93f96c470d6 P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.576731 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:58.577382 21775 raft_consensus.cc:2243] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.577958 21775 raft_consensus.cc:2272] T 22dcb234db264bc5be97cd38c312274b P c2d8ce5db69d488bac364452e3c87684 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.607062 28894 consensus_peers.cc:597] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.615468 29042 consensus_peers.cc:597] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.622776 28968 consensus_peers.cc:597] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.625555 28894 consensus_peers.cc:597] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.631134 28894 consensus_peers.cc:597] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.637524 28968 consensus_peers.cc:597] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.674295 21775 tablet_server.cc:196] TabletServer@127.21.67.193:43757 shutdown complete.
W20260709 13:11:58.688319 28968 consensus_peers.cc:597] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.699471 28894 consensus_peers.cc:597] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.701318 28968 consensus_peers.cc:597] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.708410 28894 consensus_peers.cc:597] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.780264 28968 consensus_peers.cc:597] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.800355 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
W20260709 13:11:58.800341 28894 consensus_peers.cc:597] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.805080 28968 consensus_peers.cc:597] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.822643 28968 consensus_peers.cc:597] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.833604 28968 consensus_peers.cc:597] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.858484 28968 consensus_peers.cc:597] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e -> Peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Couldn't send request to peer c2d8ce5db69d488bac364452e3c87684. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.865967 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:58.869464 21775 tablet_replica.cc:333] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.870633 21775 raft_consensus.cc:2243] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.872197 21775 raft_consensus.cc:2272] T abe7b1ea920e462e8b046d5d41f6bd8c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.874720 21775 tablet_replica.cc:333] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.875281 21775 raft_consensus.cc:2243] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.875860 21775 raft_consensus.cc:2272] T ab59da765c8447b186cb5d144d71bab8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.878276 21775 tablet_replica.cc:333] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.878965 21775 raft_consensus.cc:2243] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.879453 21775 raft_consensus.cc:2272] T 70244d272ca8458a91edd4e2388bcbe0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.882408 21775 tablet_replica.cc:333] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.883484 21775 raft_consensus.cc:2243] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.884485 21775 raft_consensus.cc:2272] T 8d4e7fd2f04240aa908640daf9fc53df P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.887025 21775 tablet_replica.cc:333] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.887919 21775 raft_consensus.cc:2243] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.888878 21775 raft_consensus.cc:2272] T f5265c21310c410993aea23cd9588704 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.891613 21775 tablet_replica.cc:333] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.892481 21775 raft_consensus.cc:2243] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.893055 21775 raft_consensus.cc:2272] T c8c8976eac9c455aa167b1de76150656 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.895956 21775 tablet_replica.cc:333] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.896770 21775 raft_consensus.cc:2243] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.897760 21775 raft_consensus.cc:2272] T ea8542c2d49442dd8176393fb85f499e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.902361 21775 tablet_replica.cc:333] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.903131 21775 raft_consensus.cc:2243] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.903685 21775 raft_consensus.cc:2272] T 4f85562ef38442c0b5fb6d5e97520765 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.906167 21775 tablet_replica.cc:333] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.906828 21775 raft_consensus.cc:2243] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.907295 21775 raft_consensus.cc:2272] T 635cf54d22ac4cdabf0f6db66801dbfc P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.909864 21775 tablet_replica.cc:333] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.910621 21775 raft_consensus.cc:2243] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.911473 21775 raft_consensus.cc:2272] T e0bb4f426f62474ea61c0ccd22e639f3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.914108 21775 tablet_replica.cc:333] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.916333 21775 raft_consensus.cc:2243] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.916837 21775 raft_consensus.cc:2272] T 72f5cdde3e8541db925706bec3e9bdfe P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.919694 21775 tablet_replica.cc:333] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.920486 21775 raft_consensus.cc:2243] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.921128 21775 raft_consensus.cc:2272] T baf6422e395e4363ba3daf68501ad7b3 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.927022 21775 tablet_replica.cc:333] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.928035 21775 raft_consensus.cc:2243] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.929358 21775 raft_consensus.cc:2272] T 78523bc7e80a431c8097160346435949 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.932628 21775 tablet_replica.cc:333] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.933634 21775 raft_consensus.cc:2243] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.934824 21775 raft_consensus.cc:2272] T b65a86245d1042e3b9c4cbea4a2aa661 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.938194 21775 tablet_replica.cc:333] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
W20260709 13:11:58.939139 28968 consensus_peers.cc:597] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.939393 21775 raft_consensus.cc:2243] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.940786 21775 raft_consensus.cc:2272] T e1b93b33daae4eadbaab3085ddf2e1da P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.944451 21775 tablet_replica.cc:333] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.945325 21775 raft_consensus.cc:2243] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.946053 21775 raft_consensus.cc:2272] T 05512d8f790140339c5f183c562dc66e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.949952 21775 tablet_replica.cc:333] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.950965 21775 raft_consensus.cc:2243] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.952571 21775 raft_consensus.cc:2272] T 999b5645c9a5429d89ef42071b72ff41 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.956173 21775 tablet_replica.cc:333] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.957125 21775 raft_consensus.cc:2243] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.958467 21775 raft_consensus.cc:2272] T ca028d51a9934f5f93f321e1f06fb783 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.964076 21775 tablet_replica.cc:333] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.965067 21775 raft_consensus.cc:2243] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.966266 21775 raft_consensus.cc:2272] T 7fa926f9b106492fa4f9170584cdc0d0 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.969780 21775 tablet_replica.cc:333] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.970901 21775 raft_consensus.cc:2243] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.971501 21775 raft_consensus.cc:2272] T 305b8e0e7bf241b881fcd9238c779010 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.976210 21775 tablet_replica.cc:333] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.977011 21775 raft_consensus.cc:2243] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:58.977888 28968 consensus_peers.cc:597] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.978215 21775 raft_consensus.cc:2272] T b8acd4f604914312a15bf2dcf21f7e21 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.982071 21775 tablet_replica.cc:333] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.982963 21775 raft_consensus.cc:2243] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.983645 21775 raft_consensus.cc:2272] T e1766cdfb35f400dbee45175e8278150 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.986920 21775 tablet_replica.cc:333] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.987958 21775 raft_consensus.cc:2243] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.988644 21775 raft_consensus.cc:2272] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.992444 21775 tablet_replica.cc:333] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.993391 21775 raft_consensus.cc:2243] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.994073 21775 raft_consensus.cc:2272] T 5954e889e23845479415928960eb44ab P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.997876 21775 tablet_replica.cc:333] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:58.998778 21775 raft_consensus.cc:2243] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.999487 21775 raft_consensus.cc:2272] T b8550ef17e8a41acbcdfe5eab4042fc2 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:59.001358 28966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.196:39417, user_credentials={real_user=slave}} blocked reactor thread for 76842.4us
I20260709 13:11:59.003090 21775 tablet_replica.cc:333] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.003898 21775 raft_consensus.cc:2243] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.005698 21775 raft_consensus.cc:2272] T b1edbded562c47dcb0e8bf5320a0b28a P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.007856 21775 tablet_replica.cc:333] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.008530 21775 raft_consensus.cc:2243] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.009068 21775 raft_consensus.cc:2272] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:59.010723 28968 consensus_peers.cc:597] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.011732 21775 tablet_replica.cc:333] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.012547 21775 raft_consensus.cc:2243] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.013221 21775 raft_consensus.cc:2272] T 3867b16885df491794bbf87eb1e86929 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.015914 21775 tablet_replica.cc:333] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.016635 21775 raft_consensus.cc:2243] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.017190 21775 raft_consensus.cc:2272] T 2f9cd3f2da964526b25e30af018cd9ef P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.020704 21775 tablet_replica.cc:333] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.021330 21775 raft_consensus.cc:2243] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.021744 21775 raft_consensus.cc:2272] T 6d34c5f0983b472d988e26619d914252 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.023826 21775 tablet_replica.cc:333] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.024616 21775 raft_consensus.cc:2243] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.025146 21775 raft_consensus.cc:2272] T 0f9f352e256845538a894cae38c64fa8 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:59.026592 29042 consensus_peers.cc:597] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.027227 29042 consensus_peers.cc:597] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.027607 21775 tablet_replica.cc:333] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.028376 21775 raft_consensus.cc:2243] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.028872 21775 raft_consensus.cc:2272] T d383bc02730e4f5fba0c090fd15c5977 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.031502 21775 tablet_replica.cc:333] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.032150 21775 raft_consensus.cc:2243] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.032615 21775 raft_consensus.cc:2272] T d327b0d2f19b4bcb89a2d313b3f61582 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.034780 21775 tablet_replica.cc:333] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.035291 21775 raft_consensus.cc:2243] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.035796 21775 raft_consensus.cc:2272] T fed5593d39e541d6b2eb401c3bc41f9c P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.038041 21775 tablet_replica.cc:333] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.038585 21775 raft_consensus.cc:2243] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.039520 21775 raft_consensus.cc:2272] T 73566428eabe4cb9aa1cb835c62e071e P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.042011 21775 tablet_replica.cc:333] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.042721 21775 raft_consensus.cc:2243] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.043200 21775 raft_consensus.cc:2272] T f1ead15c3afd4bffac3533ab972efba4 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.045452 21775 tablet_replica.cc:333] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.045960 21775 raft_consensus.cc:2243] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.046715 21775 raft_consensus.cc:2272] T a2f04d827ff541d9ad5feb028f6fec84 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.048753 21775 tablet_replica.cc:333] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.049247 21775 raft_consensus.cc:2243] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.049710 21775 raft_consensus.cc:2272] T f6e35b460c6a457091d81b9da6ad5c56 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.051582 21775 tablet_replica.cc:333] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.052110 21775 raft_consensus.cc:2243] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.052480 21775 raft_consensus.cc:2272] T bf65c49499e9410a82ebb36901c05a87 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.054975 21775 tablet_replica.cc:333] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.055604 21775 raft_consensus.cc:2243] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.056164 21775 raft_consensus.cc:2272] T 3cfc847797b84ec4be004a36829f8488 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.058624 21775 tablet_replica.cc:333] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.059234 21775 raft_consensus.cc:2243] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.059865 21775 raft_consensus.cc:2272] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.061757 21775 tablet_replica.cc:333] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.062211 21775 raft_consensus.cc:2243] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.062597 21775 raft_consensus.cc:2272] T e7a49b8cb161469c804c3693d6642483 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.064497 21775 tablet_replica.cc:333] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.064999 21775 raft_consensus.cc:2243] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.065490 21775 raft_consensus.cc:2272] T 01ac272a33ca49f2b3a823dba78768e5 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.067950 21775 tablet_replica.cc:333] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4: stopping tablet replica
I20260709 13:11:59.068480 21775 raft_consensus.cc:2243] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.069420 21775 raft_consensus.cc:2272] T 63f1135e78c645c5abf8555c620907d9 P 4f69f6a7e69e4093b7779d80aab42eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:59.091517 29042 consensus_peers.cc:597] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.136287 29042 consensus_peers.cc:597] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.166680 28968 consensus_peers.cc:597] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.170701 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
W20260709 13:11:59.172726 29042 consensus_peers.cc:597] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.197470 29042 consensus_peers.cc:597] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.224138 28968 consensus_peers.cc:597] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.238955 29042 consensus_peers.cc:597] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.279215 28968 consensus_peers.cc:597] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.283376 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
W20260709 13:11:59.286550 29042 consensus_peers.cc:597] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.319823 28968 consensus_peers.cc:597] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.320637 29042 consensus_peers.cc:597] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Couldn't send request to peer 4f69f6a7e69e4093b7779d80aab42eb4. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.341703 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:59.342691 21775 tablet_replica.cc:333] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.343811 21775 raft_consensus.cc:2243] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.344403 21775 raft_consensus.cc:2272] T b955d423ccbf49f092ae423e2778518b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.346416 21775 tablet_replica.cc:333] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.346977 21775 raft_consensus.cc:2243] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.347453 21775 raft_consensus.cc:2272] T 1f4840a88b2d49ce845b056aa75275ae P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.349347 21775 tablet_replica.cc:333] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.349913 21775 raft_consensus.cc:2243] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.350678 21775 raft_consensus.cc:2272] T ab59da765c8447b186cb5d144d71bab8 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.352725 21775 tablet_replica.cc:333] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.353355 21775 raft_consensus.cc:2243] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.354292 21775 raft_consensus.cc:2272] T 56d98016c79645be808873970bf26945 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.356854 21775 tablet_replica.cc:333] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.357659 21775 raft_consensus.cc:2243] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.358584 21775 raft_consensus.cc:2272] T 70244d272ca8458a91edd4e2388bcbe0 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.362524 21775 tablet_replica.cc:333] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.363104 21775 raft_consensus.cc:2243] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.363556 21775 raft_consensus.cc:2272] T f5265c21310c410993aea23cd9588704 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.365796 21775 tablet_replica.cc:333] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.366322 21775 raft_consensus.cc:2243] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.367038 21775 raft_consensus.cc:2272] T baf6422e395e4363ba3daf68501ad7b3 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.369019 21775 tablet_replica.cc:333] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.369529 21775 raft_consensus.cc:2243] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.370296 21775 raft_consensus.cc:2272] T 72f5cdde3e8541db925706bec3e9bdfe P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.372736 21775 tablet_replica.cc:333] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.373498 21775 raft_consensus.cc:2243] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.373977 21775 raft_consensus.cc:2272] T eb4e8cf7700c469ab85e6216b8225789 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.376439 21775 tablet_replica.cc:333] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.377281 21775 raft_consensus.cc:2243] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.377856 21775 raft_consensus.cc:2272] T c8c8976eac9c455aa167b1de76150656 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.380635 21775 tablet_replica.cc:333] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.381441 21775 raft_consensus.cc:2243] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.382023 21775 raft_consensus.cc:2272] T 4f85562ef38442c0b5fb6d5e97520765 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.384922 21775 tablet_replica.cc:333] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
W20260709 13:11:59.385056 29042 consensus_peers.cc:597] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.385744 21775 raft_consensus.cc:2243] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.386380 21775 raft_consensus.cc:2272] T 4571f43feac9476eac9fa165998239fa P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.389297 21775 tablet_replica.cc:333] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.390102 21775 raft_consensus.cc:2243] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.390686 21775 raft_consensus.cc:2272] T 999b5645c9a5429d89ef42071b72ff41 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.393560 21775 tablet_replica.cc:333] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.394378 21775 raft_consensus.cc:2243] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.395325 21775 raft_consensus.cc:2272] T 875112fc0fc4410eb1a079bb5771d060 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.398044 21775 tablet_replica.cc:333] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.398804 21775 raft_consensus.cc:2243] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:59.398999 29042 consensus_peers.cc:597] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.399472 21775 raft_consensus.cc:2272] T 8071ad308999465eb78a22785db01b62 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.402113 21775 tablet_replica.cc:333] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.402899 21775 raft_consensus.cc:2243] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.403438 21775 raft_consensus.cc:2272] T 2bd18196206443bb8d02853f289677a9 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.406068 21775 tablet_replica.cc:333] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.406873 21775 raft_consensus.cc:2243] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.407426 21775 raft_consensus.cc:2272] T 05512d8f790140339c5f183c562dc66e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.410398 21775 tablet_replica.cc:333] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.411201 21775 raft_consensus.cc:2243] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.411759 21775 raft_consensus.cc:2272] T fed5593d39e541d6b2eb401c3bc41f9c P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.414397 21775 tablet_replica.cc:333] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.415246 21775 raft_consensus.cc:2243] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.415843 21775 raft_consensus.cc:2272] T 73566428eabe4cb9aa1cb835c62e071e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.418881 21775 tablet_replica.cc:333] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.419693 21775 raft_consensus.cc:2243] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.420233 21775 raft_consensus.cc:2272] T 32aa6e090fad4445aaffd93f96c470d6 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.422861 21775 tablet_replica.cc:333] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.423753 21775 raft_consensus.cc:2243] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.424790 21775 raft_consensus.cc:2272] T 22dcb234db264bc5be97cd38c312274b P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.427436 21775 tablet_replica.cc:333] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.428207 21775 raft_consensus.cc:2243] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.428753 21775 raft_consensus.cc:2272] T 3867b16885df491794bbf87eb1e86929 P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.431392 21775 tablet_replica.cc:333] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.432183 21775 raft_consensus.cc:2243] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.432693 21775 raft_consensus.cc:2272] T 6d34c5f0983b472d988e26619d914252 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.435434 21775 tablet_replica.cc:333] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.436249 21775 raft_consensus.cc:2243] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.437321 21775 raft_consensus.cc:2272] T 2f9cd3f2da964526b25e30af018cd9ef P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.440083 21775 tablet_replica.cc:333] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.440868 21775 raft_consensus.cc:2243] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.441421 21775 raft_consensus.cc:2272] T 12e40825a515491787d337419dfac76a P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.444185 21775 tablet_replica.cc:333] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.444952 21775 raft_consensus.cc:2243] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.445538 21775 raft_consensus.cc:2272] T 095c41dda35e41798dda1b4bdca1e55e P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.448341 21775 tablet_replica.cc:333] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.449083 21775 raft_consensus.cc:2243] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.449625 21775 raft_consensus.cc:2272] T d67b0d4cd04d4ca4beaa3eb4072622a9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.452318 21775 tablet_replica.cc:333] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.453022 21775 raft_consensus.cc:2243] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.453832 21775 raft_consensus.cc:2272] T e1766cdfb35f400dbee45175e8278150 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.456521 21775 tablet_replica.cc:333] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.457314 21775 raft_consensus.cc:2243] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:59.458263 21775 raft_consensus.cc:2272] T e7c6c665d7f64081a51c8c1b8167b26e P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:59.458568 29042 consensus_peers.cc:597] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.461014 21775 tablet_replica.cc:333] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:11:59.461874 21775 raft_consensus.cc:2243] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:59.462419 21775 raft_consensus.cc:2272] T d383bc02730e4f5fba0c090fd15c5977 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.203035 30044 raft_consensus.cc:493] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.203593 30044 raft_consensus.cc:515] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.205807 30044 leader_election.cc:290] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:12:00.214044 21775 tablet_replica.cc:333] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.214937 21775 raft_consensus.cc:2243] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.215451 21775 raft_consensus.cc:2272] T d327b0d2f19b4bcb89a2d313b3f61582 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.220635 30043 raft_consensus.cc:493] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.221170 30043 raft_consensus.cc:515] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:12:00.225857 30046 raft_consensus.cc:493] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.225977 30042 raft_consensus.cc:493] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.226457 30046 raft_consensus.cc:515] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:12:00.226697 30042 raft_consensus.cc:515] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:12:00.228052 30043 leader_election.cc:290] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:12:00.225966 21775 tablet_replica.cc:333] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.232132 21775 raft_consensus.cc:2243] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.232666 30046 leader_election.cc:290] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.232812 21775 raft_consensus.cc:2272] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.234894 30042 leader_election.cc:290] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.235932 21775 tablet_replica.cc:333] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.237023 21775 raft_consensus.cc:2243] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.245491 21775 raft_consensus.cc:2272] T bf65c49499e9410a82ebb36901c05a87 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.252095 21775 tablet_replica.cc:333] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.261102 21775 raft_consensus.cc:2243] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.264755 30054 raft_consensus.cc:493] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.268519 21775 raft_consensus.cc:2272] T f1ead15c3afd4bffac3533ab972efba4 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.269428 30044 raft_consensus.cc:493] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.273650 30044 raft_consensus.cc:515] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.280683 30047 raft_consensus.cc:493] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.280923 30044 leader_election.cc:290] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.281219 30047 raft_consensus.cc:515] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.283180 30047 leader_election.cc:290] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:12:00.283710 30047 raft_consensus.cc:493] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.284145 30047 raft_consensus.cc:515] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.287053 30047 leader_election.cc:290] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.287019 30043 raft_consensus.cc:493] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.287590 30048 raft_consensus.cc:493] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.287922 30043 raft_consensus.cc:515] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.288105 30048 raft_consensus.cc:515] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.288293 30051 raft_consensus.cc:493] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.288992 30051 raft_consensus.cc:515] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.289896 30043 leader_election.cc:290] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:12:00.290004 30048 leader_election.cc:290] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:12:00.293123 21775 tablet_replica.cc:333] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.293968 30051 leader_election.cc:290] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:12:00.294217 21775 raft_consensus.cc:2243] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.295187 21775 raft_consensus.cc:2272] T 305b8e0e7bf241b881fcd9238c779010 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.303861 30051 raft_consensus.cc:493] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.304513 30051 raft_consensus.cc:515] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.306970 30051 leader_election.cc:290] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.267557 30054 raft_consensus.cc:515] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } }
I20260709 13:12:00.314388 30044 raft_consensus.cc:493] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.314600 30051 raft_consensus.cc:493] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.314934 30044 raft_consensus.cc:515] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.315340 30051 raft_consensus.cc:515] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.316955 30044 leader_election.cc:290] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.317932 30051 leader_election.cc:290] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.317971 30043 raft_consensus.cc:493] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.318809 30043 raft_consensus.cc:515] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.319556 30054 leader_election.cc:290] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.320612 30043 leader_election.cc:290] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
I20260709 13:12:00.321269 30043 raft_consensus.cc:493] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.321741 30055 raft_consensus.cc:493] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.321712 30043 raft_consensus.cc:515] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.322439 30055 raft_consensus.cc:515] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.323733 30043 leader_election.cc:290] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.324476 30047 raft_consensus.cc:493] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.324945 30043 raft_consensus.cc:493] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c2d8ce5db69d488bac364452e3c87684)
I20260709 13:12:00.324950 30047 raft_consensus.cc:515] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.325382 30055 leader_election.cc:290] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.325577 30043 raft_consensus.cc:515] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.326047 30055 raft_consensus.cc:493] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.326997 30047 leader_election.cc:290] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.326617 30055 raft_consensus.cc:515] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.327416 30043 leader_election.cc:290] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.327477 30047 raft_consensus.cc:493] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.333410 21775 tablet_replica.cc:333] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.334205 21775 raft_consensus.cc:2243] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.328092 30047 raft_consensus.cc:515] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:12:00.337671 30047 leader_election.cc:290] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
I20260709 13:12:00.338543 30055 leader_election.cc:290] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
W20260709 13:12:00.338822 28968 leader_election.cc:336] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.339362 21775 raft_consensus.cc:2272] T b8acd4f604914312a15bf2dcf21f7e21 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:00.339321 28968 leader_election.cc:336] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.348104 28968 leader_election.cc:336] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.348459 28968 leader_election.cc:304] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
W20260709 13:12:00.349025 28968 raft_consensus.cc:2686] T f6e35b460c6a457091d81b9da6ad5c56 P aceb6f6c95434708b96f7552ee379a8e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:12:00.349738 28968 leader_election.cc:336] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.350154 28968 leader_election.cc:304] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.350802 30048 raft_consensus.cc:2749] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:00.351050 28968 leader_election.cc:336] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
W20260709 13:12:00.351708 28968 leader_election.cc:336] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.359536 30052 raft_consensus.cc:493] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.360070 30052 raft_consensus.cc:515] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
W20260709 13:12:00.355243 28968 leader_election.cc:336] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.360996 28968 leader_election.cc:304] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.361613 30048 raft_consensus.cc:2749] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.361992 30052 leader_election.cc:290] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.359395 30045 raft_consensus.cc:493] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
W20260709 13:12:00.361800 28968 leader_election.cc:336] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.363399 28968 leader_election.cc:304] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aceb6f6c95434708b96f7552ee379a8e; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.363085 30045 raft_consensus.cc:515] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.364099 30048 raft_consensus.cc:2749] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.367744 30045 leader_election.cc:290] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
I20260709 13:12:00.365684 21775 tablet_replica.cc:333] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.368889 21775 raft_consensus.cc:2243] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.369917 21775 raft_consensus.cc:2272] T 5954e889e23845479415928960eb44ab P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.387877 21775 tablet_replica.cc:333] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.388633 21775 raft_consensus.cc:2243] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.389204 21775 raft_consensus.cc:2272] T 31bd89e5e6ee4b6e92d1ad1ea58721bb P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.392139 21775 tablet_replica.cc:333] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.392872 21775 raft_consensus.cc:2243] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.393792 21775 raft_consensus.cc:2272] T e7a49b8cb161469c804c3693d6642483 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.396539 21775 tablet_replica.cc:333] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.397270 21775 raft_consensus.cc:2243] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.397819 21775 raft_consensus.cc:2272] T 01ac272a33ca49f2b3a823dba78768e5 P aceb6f6c95434708b96f7552ee379a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.400525 21775 tablet_replica.cc:333] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.401254 21775 raft_consensus.cc:2243] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.401787 21775 raft_consensus.cc:2272] T 635cf54d22ac4cdabf0f6db66801dbfc P aceb6f6c95434708b96f7552ee379a8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.404434 21775 tablet_replica.cc:333] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
I20260709 13:12:00.405181 21775 raft_consensus.cc:2243] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.406168 21775 raft_consensus.cc:2272] T cfe3bfc02d2a4c048cdf83ee4991fa10 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.409191 21775 tablet_replica.cc:333] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
W20260709 13:12:00.409191 29042 leader_election.cc:336] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.410020 29042 leader_election.cc:336] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.410069 21775 raft_consensus.cc:2243] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:00.410468 29042 leader_election.cc:336] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.410748 21775 raft_consensus.cc:2272] T 63f1135e78c645c5abf8555c620907d9 P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:00.410959 29042 leader_election.cc:336] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.411535 29042 leader_election.cc:336] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.411948 29042 leader_election.cc:336] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.412307 29042 leader_election.cc:336] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.412747 29042 leader_election.cc:336] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.413090 29042 leader_election.cc:336] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.413429 29042 leader_election.cc:336] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.413702 21775 tablet_replica.cc:333] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e: stopping tablet replica
W20260709 13:12:00.413774 29042 leader_election.cc:336] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.414381 29042 leader_election.cc:336] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.414584 21775 raft_consensus.cc:2243] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:00.414716 29042 leader_election.cc:336] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.415149 29042 leader_election.cc:336] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.415235 21775 raft_consensus.cc:2272] T cd251d5537f14f37a55ab6d63637d34a P aceb6f6c95434708b96f7552ee379a8e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:00.415822 29042 leader_election.cc:336] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.417430 29042 leader_election.cc:336] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
W20260709 13:12:00.417810 29042 leader_election.cc:336] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.418099 29042 leader_election.cc:304] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.418741 30045 raft_consensus.cc:2749] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.418884 29042 leader_election.cc:336] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.419324 29042 leader_election.cc:304] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.420034 30045 raft_consensus.cc:2749] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.420213 29042 leader_election.cc:336] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.420717 29042 leader_election.cc:304] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.421363 30045 raft_consensus.cc:2749] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.421530 29042 leader_election.cc:336] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.421975 29042 leader_election.cc:304] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.422698 30045 raft_consensus.cc:2749] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.422940 29042 leader_election.cc:336] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.423432 29042 leader_election.cc:304] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.424180 30045 raft_consensus.cc:2749] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.424295 29042 leader_election.cc:336] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.424749 29042 leader_election.cc:304] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.425506 30045 raft_consensus.cc:2749] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.425669 29042 leader_election.cc:336] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.426108 29042 leader_election.cc:304] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.426692 30045 raft_consensus.cc:2749] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:00.426853 29042 leader_election.cc:336] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.427294 29042 leader_election.cc:304] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.427971 30045 raft_consensus.cc:2749] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.428144 29042 leader_election.cc:336] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.428552 29042 leader_election.cc:304] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.429139 30045 raft_consensus.cc:2749] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:00.429332 29042 leader_election.cc:336] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
W20260709 13:12:00.429833 29042 leader_election.cc:336] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.430191 29042 leader_election.cc:304] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.430790 30045 raft_consensus.cc:2749] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.437604 29042 consensus_peers.cc:597] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.438125 29042 consensus_peers.cc:597] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.438557 29042 leader_election.cc:336] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.438978 29042 leader_election.cc:336] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.439605 29042 leader_election.cc:336] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.440027 29042 leader_election.cc:304] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.440665 30052 raft_consensus.cc:493] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aceb6f6c95434708b96f7552ee379a8e)
I20260709 13:12:00.441143 30052 raft_consensus.cc:515] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.441912 30045 raft_consensus.cc:2749] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.443122 30052 leader_election.cc:290] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
W20260709 13:12:00.443910 29042 leader_election.cc:336] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.444337 29042 leader_election.cc:304] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
W20260709 13:12:00.446391 29042 consensus_peers.cc:597] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.446882 29042 leader_election.cc:336] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:00.447253 29042 leader_election.cc:304] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.447976 30052 raft_consensus.cc:2749] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.448321 29042 consensus_peers.cc:597] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:00.448594 30052 raft_consensus.cc:2749] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.448863 29042 consensus_peers.cc:597] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.449404 29042 leader_election.cc:336] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:00.449777 29042 leader_election.cc:304] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:12:00.450371 30052 raft_consensus.cc:2749] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.450718 29042 consensus_peers.cc:597] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.451265 29042 consensus_peers.cc:597] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.451707 29042 consensus_peers.cc:597] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.452158 29042 leader_election.cc:336] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:00.452456 29042 leader_election.cc:304] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.453194 30045 raft_consensus.cc:2749] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.453701 29042 consensus_peers.cc:597] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c -> Peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Couldn't send request to peer aceb6f6c95434708b96f7552ee379a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.454173 29042 leader_election.cc:336] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:00.454450 29042 leader_election.cc:304] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.455004 30045 raft_consensus.cc:2749] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.455364 29042 leader_election.cc:336] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:00.455801 29042 leader_election.cc:304] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.456425 30045 raft_consensus.cc:2749] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:00.456923 29042 leader_election.cc:336] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:00.457319 29042 leader_election.cc:304] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.457875 30045 raft_consensus.cc:2749] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.458210 29042 leader_election.cc:336] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:00.458616 29042 leader_election.cc:304] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:12:00.459252 30045 raft_consensus.cc:2749] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:00.461989 29042 leader_election.cc:336] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:00.462738 29042 leader_election.cc:336] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.463075 29042 leader_election.cc:304] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.463642 30045 raft_consensus.cc:2749] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:00.508847 30045 raft_consensus.cc:493] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aceb6f6c95434708b96f7552ee379a8e)
I20260709 13:12:00.509434 30045 raft_consensus.cc:515] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.511618 30045 leader_election.cc:290] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
W20260709 13:12:00.517038 29042 leader_election.cc:336] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Network error: Client connection negotiation failed: client connection to 127.21.67.195:38499: connect: Connection refused (error 111)
W20260709 13:12:00.518044 29042 leader_election.cc:336] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.518505 29042 leader_election.cc:304] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.519183 30045 raft_consensus.cc:2749] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:00.535974 30045 raft_consensus.cc:493] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f69f6a7e69e4093b7779d80aab42eb4)
I20260709 13:12:00.536449 30045 raft_consensus.cc:515] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } } peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } }
I20260709 13:12:00.538429 30045 leader_election.cc:290] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757), 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231)
W20260709 13:12:00.543486 29042 leader_election.cc:336] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
W20260709 13:12:00.544559 29042 leader_election.cc:336] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
I20260709 13:12:00.544939 29042 leader_election.cc:304] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.545572 30045 raft_consensus.cc:2749] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.552968 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:12:00.620111 21775 tablet_server.cc:179] TabletServer@127.21.67.196:0 shutting down...
I20260709 13:12:00.631037 30045 raft_consensus.cc:493] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aceb6f6c95434708b96f7552ee379a8e)
I20260709 13:12:00.631603 30045 raft_consensus.cc:515] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f69f6a7e69e4093b7779d80aab42eb4" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38231 } } peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } }
I20260709 13:12:00.633553 30045 leader_election.cc:290] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231), aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499)
W20260709 13:12:00.640618 29042 leader_election.cc:336] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f69f6a7e69e4093b7779d80aab42eb4 (127.21.67.194:38231): Network error: Client connection negotiation failed: client connection to 127.21.67.194:38231: connect: Connection refused (error 111)
W20260709 13:12:00.641315 29042 leader_election.cc:336] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Network error: Client connection negotiation failed: client connection to 127.21.67.195:38499: connect: Connection refused (error 111)
I20260709 13:12:00.641700 29042 leader_election.cc:304] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: 4f69f6a7e69e4093b7779d80aab42eb4, aceb6f6c95434708b96f7552ee379a8e
I20260709 13:12:00.642588 30045 raft_consensus.cc:2749] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:00.647375 30045 raft_consensus.cc:493] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aceb6f6c95434708b96f7552ee379a8e)
I20260709 13:12:00.647873 30045 raft_consensus.cc:515] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aceb6f6c95434708b96f7552ee379a8e" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 38499 } } peers { permanent_uuid: "1b99cdfeeb2f418fa34b0ac78532b59c" member_type: VOTER last_known_addr { host: "127.21.67.196" port: 39417 } } peers { permanent_uuid: "c2d8ce5db69d488bac364452e3c87684" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 43757 } }
I20260709 13:12:00.651851 30045 leader_election.cc:290] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499), c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757)
W20260709 13:12:00.656411 29042 leader_election.cc:336] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aceb6f6c95434708b96f7552ee379a8e (127.21.67.195:38499): Network error: Client connection negotiation failed: client connection to 127.21.67.195:38499: connect: Connection refused (error 111)
W20260709 13:12:00.657251 29042 leader_election.cc:336] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c2d8ce5db69d488bac364452e3c87684 (127.21.67.193:43757): Network error: Client connection negotiation failed: client connection to 127.21.67.193:43757: connect: Connection refused (error 111)
I20260709 13:12:00.657580 29042 leader_election.cc:304] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b99cdfeeb2f418fa34b0ac78532b59c; no voters: aceb6f6c95434708b96f7552ee379a8e, c2d8ce5db69d488bac364452e3c87684
I20260709 13:12:00.658159 30045 raft_consensus.cc:2749] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:00.675102 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:00.675959 21775 tablet_replica.cc:333] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.676622 21775 raft_consensus.cc:2243] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.677069 21775 raft_consensus.cc:2272] T 1f4840a88b2d49ce845b056aa75275ae P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.678965 21775 tablet_replica.cc:333] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.679610 21775 raft_consensus.cc:2243] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.680081 21775 raft_consensus.cc:2272] T abe7b1ea920e462e8b046d5d41f6bd8c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.682801 21775 tablet_replica.cc:333] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.683852 21775 raft_consensus.cc:2243] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.684479 21775 raft_consensus.cc:2272] T ab59da765c8447b186cb5d144d71bab8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.687434 21775 tablet_replica.cc:333] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.688320 21775 raft_consensus.cc:2243] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.688982 21775 raft_consensus.cc:2272] T e7a49b8cb161469c804c3693d6642483 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.692549 21775 tablet_replica.cc:333] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.693354 21775 raft_consensus.cc:2243] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.694118 21775 raft_consensus.cc:2272] T 3a1ac826ae3d4a50b9a1fdec1e9a2e69 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.696331 21775 tablet_replica.cc:333] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.696947 21775 raft_consensus.cc:2243] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.697379 21775 raft_consensus.cc:2272] T 305b8e0e7bf241b881fcd9238c779010 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.699920 21775 tablet_replica.cc:333] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.700654 21775 raft_consensus.cc:2243] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.701138 21775 raft_consensus.cc:2272] T 56d98016c79645be808873970bf26945 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.703135 21775 tablet_replica.cc:333] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.703785 21775 raft_consensus.cc:2243] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.704246 21775 raft_consensus.cc:2272] T 8d4e7fd2f04240aa908640daf9fc53df P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.706339 21775 tablet_replica.cc:333] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.706894 21775 raft_consensus.cc:2243] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.707286 21775 raft_consensus.cc:2272] T 4571f43feac9476eac9fa165998239fa P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.709022 21775 tablet_replica.cc:333] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.709533 21775 raft_consensus.cc:2243] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.709916 21775 raft_consensus.cc:2272] T eb4e8cf7700c469ab85e6216b8225789 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.711598 21775 tablet_replica.cc:333] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.712196 21775 raft_consensus.cc:2243] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.712610 21775 raft_consensus.cc:2272] T ea8542c2d49442dd8176393fb85f499e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.714365 21775 tablet_replica.cc:333] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.714888 21775 raft_consensus.cc:2243] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.715593 21775 raft_consensus.cc:2272] T 4f85562ef38442c0b5fb6d5e97520765 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.717475 21775 tablet_replica.cc:333] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.717980 21775 raft_consensus.cc:2243] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.718652 21775 raft_consensus.cc:2272] T fed5593d39e541d6b2eb401c3bc41f9c P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.720523 21775 tablet_replica.cc:333] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.721046 21775 raft_consensus.cc:2243] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.721495 21775 raft_consensus.cc:2272] T 73566428eabe4cb9aa1cb835c62e071e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.723405 21775 tablet_replica.cc:333] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.723996 21775 raft_consensus.cc:2243] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.724658 21775 raft_consensus.cc:2272] T 32aa6e090fad4445aaffd93f96c470d6 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.727249 21775 tablet_replica.cc:333] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.728009 21775 raft_consensus.cc:2243] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.728470 21775 raft_consensus.cc:2272] T 22dcb234db264bc5be97cd38c312274b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.730253 21775 tablet_replica.cc:333] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.730715 21775 raft_consensus.cc:2243] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.731047 21775 raft_consensus.cc:2272] T 72f5cdde3e8541db925706bec3e9bdfe P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.732729 21775 tablet_replica.cc:333] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.733134 21775 raft_consensus.cc:2243] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.733438 21775 raft_consensus.cc:2272] T 78523bc7e80a431c8097160346435949 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.735100 21775 tablet_replica.cc:333] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.735567 21775 raft_consensus.cc:2243] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.736296 21775 raft_consensus.cc:2272] T 8071ad308999465eb78a22785db01b62 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.737924 21775 tablet_replica.cc:333] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.738361 21775 raft_consensus.cc:2243] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.738688 21775 raft_consensus.cc:2272] T 875112fc0fc4410eb1a079bb5771d060 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.740342 21775 tablet_replica.cc:333] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.740792 21775 raft_consensus.cc:2243] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.741114 21775 raft_consensus.cc:2272] T ca028d51a9934f5f93f321e1f06fb783 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.742668 21775 tablet_replica.cc:333] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.743144 21775 raft_consensus.cc:2243] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.743868 21775 raft_consensus.cc:2272] T 6d34c5f0983b472d988e26619d914252 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.745832 21775 tablet_replica.cc:333] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.746516 21775 raft_consensus.cc:2243] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.747378 21775 raft_consensus.cc:2272] T 12e40825a515491787d337419dfac76a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.749687 21775 tablet_replica.cc:333] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.750240 21775 raft_consensus.cc:2243] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.750653 21775 raft_consensus.cc:2272] T 7fa926f9b106492fa4f9170584cdc0d0 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.752848 21775 tablet_replica.cc:333] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.753528 21775 raft_consensus.cc:2243] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.754462 21775 raft_consensus.cc:2272] T 095c41dda35e41798dda1b4bdca1e55e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.756431 21775 tablet_replica.cc:333] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.756968 21775 raft_consensus.cc:2243] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.757679 21775 raft_consensus.cc:2272] T d67b0d4cd04d4ca4beaa3eb4072622a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.759413 21775 tablet_replica.cc:333] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.759966 21775 raft_consensus.cc:2243] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.760655 21775 raft_consensus.cc:2272] T cd251d5537f14f37a55ab6d63637d34a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.762362 21775 tablet_replica.cc:333] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.762838 21775 raft_consensus.cc:2243] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.763247 21775 raft_consensus.cc:2272] T b1edbded562c47dcb0e8bf5320a0b28a P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.764912 21775 tablet_replica.cc:333] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.765375 21775 raft_consensus.cc:2243] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.766047 21775 raft_consensus.cc:2272] T b8550ef17e8a41acbcdfe5eab4042fc2 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.767795 21775 tablet_replica.cc:333] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.768255 21775 raft_consensus.cc:2243] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.768651 21775 raft_consensus.cc:2272] T e7c6c665d7f64081a51c8c1b8167b26e P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.770362 21775 tablet_replica.cc:333] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.770836 21775 raft_consensus.cc:2243] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.771214 21775 raft_consensus.cc:2272] T 63f1135e78c645c5abf8555c620907d9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.772861 21775 tablet_replica.cc:333] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.773355 21775 raft_consensus.cc:2243] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.773753 21775 raft_consensus.cc:2272] T b65a86245d1042e3b9c4cbea4a2aa661 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.775478 21775 tablet_replica.cc:333] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.775992 21775 raft_consensus.cc:2243] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.776371 21775 raft_consensus.cc:2272] T e1b93b33daae4eadbaab3085ddf2e1da P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.778069 21775 tablet_replica.cc:333] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.778546 21775 raft_consensus.cc:2243] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.778913 21775 raft_consensus.cc:2272] T 2bd18196206443bb8d02853f289677a9 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.780670 21775 tablet_replica.cc:333] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.781152 21775 raft_consensus.cc:2243] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.781602 21775 raft_consensus.cc:2272] T 0f9f352e256845538a894cae38c64fa8 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.783257 21775 tablet_replica.cc:333] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.783752 21775 raft_consensus.cc:2243] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.784449 21775 raft_consensus.cc:2272] T d383bc02730e4f5fba0c090fd15c5977 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.786235 21775 tablet_replica.cc:333] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.786713 21775 raft_consensus.cc:2243] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.787390 21775 raft_consensus.cc:2272] T d327b0d2f19b4bcb89a2d313b3f61582 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.789186 21775 tablet_replica.cc:333] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.789733 21775 raft_consensus.cc:2243] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.790123 21775 raft_consensus.cc:2272] T bf65c49499e9410a82ebb36901c05a87 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.791759 21775 tablet_replica.cc:333] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.792232 21775 raft_consensus.cc:2243] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.792918 21775 raft_consensus.cc:2272] T f1ead15c3afd4bffac3533ab972efba4 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.794561 21775 tablet_replica.cc:333] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.795012 21775 raft_consensus.cc:2243] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.795408 21775 raft_consensus.cc:2272] T a2f04d827ff541d9ad5feb028f6fec84 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.797047 21775 tablet_replica.cc:333] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.797520 21775 raft_consensus.cc:2243] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.798230 21775 raft_consensus.cc:2272] T b955d423ccbf49f092ae423e2778518b P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.800076 21775 tablet_replica.cc:333] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.800547 21775 raft_consensus.cc:2243] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.800911 21775 raft_consensus.cc:2272] T 3cfc847797b84ec4be004a36829f8488 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.802606 21775 tablet_replica.cc:333] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.803086 21775 raft_consensus.cc:2243] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.803476 21775 raft_consensus.cc:2272] T e0bb4f426f62474ea61c0ccd22e639f3 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.805207 21775 tablet_replica.cc:333] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c: stopping tablet replica
I20260709 13:12:00.805651 21775 raft_consensus.cc:2243] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.806046 21775 raft_consensus.cc:2272] T cfe3bfc02d2a4c048cdf83ee4991fa10 P 1b99cdfeeb2f418fa34b0ac78532b59c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:01.178297 29097 debug-util.cc:398] Leaking SignalData structure 0x7b08002492a0 after lost signal to thread 21778
W20260709 13:12:01.179333 29097 debug-util.cc:398] Leaking SignalData structure 0x7b080003a900 after lost signal to thread 28784
W20260709 13:12:01.179833 29097 debug-util.cc:398] Leaking SignalData structure 0x7b080015e9e0 after lost signal to thread 29026
W20260709 13:12:01.180739 29097 debug-util.cc:398] Leaking SignalData structure 0x7b0800294fa0 after lost signal to thread 29100
W20260709 13:12:01.866742 21775 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 29097)
W20260709 13:12:02.867332 21775 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 29097)
W20260709 13:12:03.867815 21775 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 29097)
I20260709 13:12:03.958065 21775 tablet_server.cc:196] TabletServer@127.21.67.196:0 shutdown complete.
I20260709 13:12:04.016806 21775 master.cc:562] Master@127.21.67.254:35781 shutting down...
I20260709 13:12:04.039325 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:04.039906 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:04.040251 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5b5fde7f865343ec9838244d59ac14b1: stopping tablet replica
I20260709 13:12:04.080288 21775 master.cc:584] Master@127.21.67.254:35781 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37280 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:12:04.171952 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:36973
I20260709 13:12:04.173059 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.178448 30065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.178700 30066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.180225 30068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.184465 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:04.186896 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:04.187071 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.187289 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602724187252 us; error 0 us; skew 500 ppm
I20260709 13:12:04.188006 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.190286 21775 webserver.cc:533] Webserver started at http://127.21.67.254:33205/ using document root <none> and password file <none>
I20260709 13:12:04.190760 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.190943 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.191237 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.192400 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "24216bbb77524d1b91e0086b4cac0728"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.196482 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:12:04.199520 30073 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.200253 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:04.200524 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "24216bbb77524d1b91e0086b4cac0728"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.200786 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.216048 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.217170 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.254112 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:36973
I20260709 13:12:04.254212 30124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:36973 every 8 connection(s)
I20260709 13:12:04.258138 30125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.268218 30125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728: Bootstrap starting.
I20260709 13:12:04.272821 30125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.276748 30125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728: No bootstrap required, opened a new log
I20260709 13:12:04.278743 30125 raft_consensus.cc:359] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24216bbb77524d1b91e0086b4cac0728" member_type: VOTER }
I20260709 13:12:04.279078 30125 raft_consensus.cc:385] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.279266 30125 raft_consensus.cc:740] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24216bbb77524d1b91e0086b4cac0728, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.279784 30125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24216bbb77524d1b91e0086b4cac0728" member_type: VOTER }
I20260709 13:12:04.280192 30125 raft_consensus.cc:399] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:04.280380 30125 raft_consensus.cc:493] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:04.280578 30125 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.284632 30125 raft_consensus.cc:515] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24216bbb77524d1b91e0086b4cac0728" member_type: VOTER }
I20260709 13:12:04.285046 30125 leader_election.cc:304] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24216bbb77524d1b91e0086b4cac0728; no voters: 
I20260709 13:12:04.286053 30125 leader_election.cc:290] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:04.286372 30128 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.287691 30128 raft_consensus.cc:697] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 1 LEADER]: Becoming Leader. State: Replica: 24216bbb77524d1b91e0086b4cac0728, State: Running, Role: LEADER
I20260709 13:12:04.288344 30128 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24216bbb77524d1b91e0086b4cac0728" member_type: VOTER }
I20260709 13:12:04.289008 30125 sys_catalog.cc:565] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:04.293125 30130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24216bbb77524d1b91e0086b4cac0728. Latest consensus state: current_term: 1 leader_uuid: "24216bbb77524d1b91e0086b4cac0728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24216bbb77524d1b91e0086b4cac0728" member_type: VOTER } }
I20260709 13:12:04.293708 30130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:04.295440 30135 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:04.295017 30129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24216bbb77524d1b91e0086b4cac0728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24216bbb77524d1b91e0086b4cac0728" member_type: VOTER } }
I20260709 13:12:04.299847 30129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:04.301100 30135 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:04.304997 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:04.309362 30135 catalog_manager.cc:1383] Generated new cluster ID: f94a2e48942f4645b44d73ffab33ce7b
I20260709 13:12:04.309616 30135 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:04.321322 30135 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:04.322492 30135 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:04.333699 30135 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728: Generated new TSK 0
I20260709 13:12:04.334236 30135 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:04.338522 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.344154 30146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.345908 30147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.346982 30149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.347795 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:04.348733 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:04.348939 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.349114 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602724349070 us; error 0 us; skew 500 ppm
I20260709 13:12:04.349624 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.351786 21775 webserver.cc:533] Webserver started at http://127.21.67.193:35103/ using document root <none> and password file <none>
I20260709 13:12:04.352246 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.352437 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.352694 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.353704 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.357906 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:04.361029 30154 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.361680 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:04.361969 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.362231 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.379920 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.381031 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.382391 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:04.384529 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:04.384747 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.384994 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:04.385182 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.423893 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:46835
I20260709 13:12:04.423998 30216 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:46835 every 8 connection(s)
I20260709 13:12:04.428903 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.436054 30221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.436201 30222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.439913 30224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.440398 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:04.441361 30217 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36973
I20260709 13:12:04.441720 30217 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:04.441807 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:04.442116 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.442294 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602724442275 us; error 0 us; skew 500 ppm
I20260709 13:12:04.442474 30217 heartbeater.cc:507] Master 127.21.67.254:36973 requested a full tablet report, sending...
I20260709 13:12:04.442937 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.444875 30090 ts_manager.cc:194] Registered new tserver with Master: 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835)
I20260709 13:12:04.445808 21775 webserver.cc:533] Webserver started at http://127.21.67.194:42773/ using document root <none> and password file <none>
I20260709 13:12:04.446521 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.446758 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.447042 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.447312 30090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33232
I20260709 13:12:04.448437 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.453151 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:04.456199 30229 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.456845 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:04.457130 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.457398 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.477778 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.478787 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.480173 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:04.482225 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:04.482393 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.482685 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:04.482849 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.522753 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:37573
I20260709 13:12:04.522862 30291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:37573 every 8 connection(s)
I20260709 13:12:04.527565 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.534304 30295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.535192 30296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.537976 30299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.539136 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:04.539968 30292 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36973
I20260709 13:12:04.540158 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:04.540351 30292 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:04.540483 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.540809 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602724540791 us; error 0 us; skew 500 ppm
I20260709 13:12:04.541282 30292 heartbeater.cc:507] Master 127.21.67.254:36973 requested a full tablet report, sending...
I20260709 13:12:04.541380 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.543642 30090 ts_manager.cc:194] Registered new tserver with Master: 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:04.544384 21775 webserver.cc:533] Webserver started at http://127.21.67.195:45945/ using document root <none> and password file <none>
I20260709 13:12:04.545080 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.545364 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.545584 30090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33244
I20260709 13:12:04.545696 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.547401 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.552070 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:04.555342 30303 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.556160 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:04.556455 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:04.556756 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.574604 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.575785 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.577121 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:04.579298 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:04.579536 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.579794 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:04.579979 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.621368 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:46117
I20260709 13:12:04.621462 30365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:46117 every 8 connection(s)
I20260709 13:12:04.635167 30366 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36973
I20260709 13:12:04.635485 30366 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:04.636174 30366 heartbeater.cc:507] Master 127.21.67.254:36973 requested a full tablet report, sending...
I20260709 13:12:04.637931 30090 ts_manager.cc:194] Registered new tserver with Master: afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:04.638207 21775 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013486514s
I20260709 13:12:04.639703 30090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33252
I20260709 13:12:04.661859 30090 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33254:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:04.664841 30090 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:04.742062 30257 tablet_service.cc:1511] Processing CreateTablet for tablet 64d29a8f233a44dca891c2fba97f473f (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:04.743965 30254 tablet_service.cc:1511] Processing CreateTablet for tablet 123b403c3039473cb295e8138de90ff9 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:04.744829 30256 tablet_service.cc:1511] Processing CreateTablet for tablet 6596bd77c3c04197a6df5f6236730f5f (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:04.746271 30253 tablet_service.cc:1511] Processing CreateTablet for tablet 5b29056ff5c849fe86832f7ec263e1fa (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:04.746992 30255 tablet_service.cc:1511] Processing CreateTablet for tablet e3d73d90a2f1478e91e89a4ca784ea17 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:04.743597 30257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d29a8f233a44dca891c2fba97f473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.748421 30255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d73d90a2f1478e91e89a4ca784ea17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.748567 30327 tablet_service.cc:1511] Processing CreateTablet for tablet 5b29056ff5c849fe86832f7ec263e1fa (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:04.749958 30327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b29056ff5c849fe86832f7ec263e1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.751055 30252 tablet_service.cc:1511] Processing CreateTablet for tablet a226958748884844a17465eba80f3043 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:04.751966 30253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b29056ff5c849fe86832f7ec263e1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.753317 30331 tablet_service.cc:1511] Processing CreateTablet for tablet 64d29a8f233a44dca891c2fba97f473f (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:04.753705 30330 tablet_service.cc:1511] Processing CreateTablet for tablet 6596bd77c3c04197a6df5f6236730f5f (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:04.754583 30331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d29a8f233a44dca891c2fba97f473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.756093 30329 tablet_service.cc:1511] Processing CreateTablet for tablet e3d73d90a2f1478e91e89a4ca784ea17 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:04.756235 30179 tablet_service.cc:1511] Processing CreateTablet for tablet 123b403c3039473cb295e8138de90ff9 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:04.756839 30180 tablet_service.cc:1511] Processing CreateTablet for tablet e3d73d90a2f1478e91e89a4ca784ea17 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:04.757467 30329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d73d90a2f1478e91e89a4ca784ea17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.757637 30179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123b403c3039473cb295e8138de90ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.757809 30181 tablet_service.cc:1511] Processing CreateTablet for tablet 6596bd77c3c04197a6df5f6236730f5f (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:04.758190 30252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a226958748884844a17465eba80f3043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.759399 30328 tablet_service.cc:1511] Processing CreateTablet for tablet 123b403c3039473cb295e8138de90ff9 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:04.760102 30182 tablet_service.cc:1511] Processing CreateTablet for tablet 64d29a8f233a44dca891c2fba97f473f (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:04.760831 30178 tablet_service.cc:1511] Processing CreateTablet for tablet 5b29056ff5c849fe86832f7ec263e1fa (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:04.761871 30254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123b403c3039473cb295e8138de90ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.759490 30177 tablet_service.cc:1511] Processing CreateTablet for tablet a226958748884844a17465eba80f3043 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:04.763756 30178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b29056ff5c849fe86832f7ec263e1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.763991 30256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6596bd77c3c04197a6df5f6236730f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.764451 30180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d73d90a2f1478e91e89a4ca784ea17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.760849 30328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123b403c3039473cb295e8138de90ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.767972 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a226958748884844a17465eba80f3043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.768589 30330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6596bd77c3c04197a6df5f6236730f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.771984 30182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d29a8f233a44dca891c2fba97f473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.780692 30181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6596bd77c3c04197a6df5f6236730f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.789412 30326 tablet_service.cc:1511] Processing CreateTablet for tablet a226958748884844a17465eba80f3043 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:04.790827 30326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a226958748884844a17465eba80f3043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.790546 30251 tablet_service.cc:1511] Processing CreateTablet for tablet ce45573deda84cebba1517b6017f0adb (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:04.792435 30251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce45573deda84cebba1517b6017f0adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.805913 30250 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab90f8e9d1141a3acbb54fc31e2e213 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:04.808741 30250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab90f8e9d1141a3acbb54fc31e2e213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.816429 30176 tablet_service.cc:1511] Processing CreateTablet for tablet ce45573deda84cebba1517b6017f0adb (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:04.818154 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce45573deda84cebba1517b6017f0adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.848930 30381 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:04.852557 30325 tablet_service.cc:1511] Processing CreateTablet for tablet ce45573deda84cebba1517b6017f0adb (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:04.854122 30325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce45573deda84cebba1517b6017f0adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.869390 30179 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab90f8e9d1141a3acbb54fc31e2e213 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:04.870659 30179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab90f8e9d1141a3acbb54fc31e2e213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.870332 30326 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab90f8e9d1141a3acbb54fc31e2e213 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:04.871949 30326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab90f8e9d1141a3acbb54fc31e2e213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.877235 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 710c86f75eb842a4a93d3308e33faf37 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:04.878497 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710c86f75eb842a4a93d3308e33faf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.882869 30382 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:04.892652 30253 tablet_service.cc:1511] Processing CreateTablet for tablet 710c86f75eb842a4a93d3308e33faf37 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:04.893997 30253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710c86f75eb842a4a93d3308e33faf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.897418 30328 tablet_service.cc:1511] Processing CreateTablet for tablet 710c86f75eb842a4a93d3308e33faf37 (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:04.898689 30328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710c86f75eb842a4a93d3308e33faf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.905696 30181 tablet_service.cc:1511] Processing CreateTablet for tablet fa59dae0321d4c8ab8b726a3c33fb4db (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:04.906972 30181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa59dae0321d4c8ab8b726a3c33fb4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.920960 30256 tablet_service.cc:1511] Processing CreateTablet for tablet fa59dae0321d4c8ab8b726a3c33fb4db (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:04.922708 30256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa59dae0321d4c8ab8b726a3c33fb4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.926120 30383 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:04.936621 30330 tablet_service.cc:1511] Processing CreateTablet for tablet fa59dae0321d4c8ab8b726a3c33fb4db (DEFAULT_TABLE table=test-workload [id=1070eadb29c94389a55c20a2c8743cfa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:04.945142 30330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa59dae0321d4c8ab8b726a3c33fb4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.960798 30381 tablet_bootstrap.cc:654] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.961949 30383 tablet_bootstrap.cc:654] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.960981 30382 tablet_bootstrap.cc:654] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.986616 30381 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:04.987084 30381 ts_tablet_manager.cc:1403] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.139s	user 0.007s	sys 0.013s
I20260709 13:12:04.988063 30383 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:04.988569 30383 ts_tablet_manager.cc:1403] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.016s
I20260709 13:12:04.989604 30381 raft_consensus.cc:359] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:04.990217 30381 raft_consensus.cc:385] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.990301 30382 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:04.990670 30381 raft_consensus.cc:740] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.990913 30382 ts_tablet_manager.cc:1403] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.108s	user 0.005s	sys 0.018s
I20260709 13:12:04.991557 30383 raft_consensus.cc:359] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:04.992237 30383 raft_consensus.cc:385] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.991640 30381 consensus_queue.cc:260] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:04.992511 30383 raft_consensus.cc:740] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.993592 30383 consensus_queue.cc:260] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:04.994009 30217 heartbeater.cc:499] Master 127.21.67.254:36973 was elected leader, sending a full tablet report...
I20260709 13:12:04.993988 30382 raft_consensus.cc:359] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:04.994553 30381 ts_tablet_manager.cc:1434] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:04.994908 30382 raft_consensus.cc:385] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.995265 30382 raft_consensus.cc:740] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.996025 30382 consensus_queue.cc:260] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:04.998577 30292 heartbeater.cc:499] Master 127.21.67.254:36973 was elected leader, sending a full tablet report...
I20260709 13:12:04.998893 30382 ts_tablet_manager.cc:1434] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:04.999934 30382 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.002946 30366 heartbeater.cc:499] Master 127.21.67.254:36973 was elected leader, sending a full tablet report...
I20260709 13:12:05.003235 30383 ts_tablet_manager.cc:1434] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:12:05.004334 30383 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.006515 30382 tablet_bootstrap.cc:654] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.009327 30383 tablet_bootstrap.cc:654] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.015190 30383 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.015704 30383 ts_tablet_manager.cc:1403] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:12:05.017897 30381 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.020081 30382 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.020643 30382 ts_tablet_manager.cc:1403] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:12:05.023510 30382 raft_consensus.cc:359] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.024267 30382 raft_consensus.cc:385] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.024590 30382 raft_consensus.cc:740] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.018855 30383 raft_consensus.cc:359] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.025094 30383 raft_consensus.cc:385] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.025460 30382 consensus_queue.cc:260] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.025835 30383 raft_consensus.cc:740] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
W20260709 13:12:05.026913 30293 tablet.cc:2406] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:05.028477 30381 tablet_bootstrap.cc:654] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.029165 30382 ts_tablet_manager.cc:1434] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:05.030296 30382 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.033746 30383 consensus_queue.cc:260] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.036265 30383 ts_tablet_manager.cc:1434] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:12:05.036626 30382 tablet_bootstrap.cc:654] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.037314 30383 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.040225 30381 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.040812 30381 ts_tablet_manager.cc:1403] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:12:05.043889 30381 raft_consensus.cc:359] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.044610 30381 raft_consensus.cc:385] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.044934 30381 raft_consensus.cc:740] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.045926 30383 tablet_bootstrap.cc:654] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.045749 30381 consensus_queue.cc:260] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.050966 30381 ts_tablet_manager.cc:1434] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:05.051954 30381 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.052454 30382 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.053185 30382 ts_tablet_manager.cc:1403] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.008s
I20260709 13:12:05.057142 30382 raft_consensus.cc:359] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.058207 30382 raft_consensus.cc:385] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.058569 30381 tablet_bootstrap.cc:654] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.058773 30382 raft_consensus.cc:740] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.060014 30382 consensus_queue.cc:260] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.067837 30382 ts_tablet_manager.cc:1434] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:12:05.069128 30382 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.077710 30382 tablet_bootstrap.cc:654] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.078013 30381 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.078554 30381 ts_tablet_manager.cc:1403] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.008s
I20260709 13:12:05.081604 30383 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.081200 30381 raft_consensus.cc:359] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.081983 30381 raft_consensus.cc:385] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.082104 30383 ts_tablet_manager.cc:1403] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.016s
I20260709 13:12:05.082329 30381 raft_consensus.cc:740] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.083114 30381 consensus_queue.cc:260] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.083505 30382 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.084115 30382 ts_tablet_manager.cc:1403] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:12:05.085191 30381 ts_tablet_manager.cc:1434] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:12:05.085369 30383 raft_consensus.cc:359] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.086242 30381 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.087052 30382 raft_consensus.cc:359] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.087790 30382 raft_consensus.cc:385] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.088088 30382 raft_consensus.cc:740] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.088792 30382 consensus_queue.cc:260] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.086354 30383 raft_consensus.cc:385] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.089744 30383 raft_consensus.cc:740] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.090556 30383 consensus_queue.cc:260] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.092496 30381 tablet_bootstrap.cc:654] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.095192 30388 raft_consensus.cc:493] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.095698 30388 raft_consensus.cc:515] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.096680 30382 ts_tablet_manager.cc:1434] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:12:05.097704 30382 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.098299 30388 leader_election.cc:290] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.100323 30388 raft_consensus.cc:493] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.100811 30388 raft_consensus.cc:515] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.095707 30383 ts_tablet_manager.cc:1434] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:12:05.103451 30388 leader_election.cc:290] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.103710 30383 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.110221 30383 tablet_bootstrap.cc:654] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.115998 30192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.116324 30382 tablet_bootstrap.cc:654] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.117565 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123b403c3039473cb295e8138de90ff9" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.119982 30191 raft_consensus.cc:2468] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 0.
W20260709 13:12:05.121274 30307 leader_election.cc:343] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.123049 30307 leader_election.cc:304] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:05.125422 30388 raft_consensus.cc:2804] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.125854 30388 raft_consensus.cc:493] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.126266 30388 raft_consensus.cc:3060] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.136554 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.138037 30388 raft_consensus.cc:515] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
W20260709 13:12:05.138409 30304 leader_election.cc:343] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.138340 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123b403c3039473cb295e8138de90ff9" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.140437 30266 raft_consensus.cc:2468] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 0.
I20260709 13:12:05.140071 30304 leader_election.cc:304] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:05.144115 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123b403c3039473cb295e8138de90ff9" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:05.144757 30191 raft_consensus.cc:3060] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.154148 30191 raft_consensus.cc:2468] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 1.
I20260709 13:12:05.155953 30401 raft_consensus.cc:2749] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.157420 30381 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.157413 30383 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.157671 30382 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.158128 30383 ts_tablet_manager.cc:1403] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.004s
I20260709 13:12:05.158653 30388 leader_election.cc:290] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.158013 30381 ts_tablet_manager.cc:1403] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.018s
I20260709 13:12:05.160050 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123b403c3039473cb295e8138de90ff9" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:05.160632 30266 raft_consensus.cc:3060] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.160928 30383 raft_consensus.cc:359] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.161491 30383 raft_consensus.cc:385] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.161679 30383 raft_consensus.cc:740] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.161916 30381 raft_consensus.cc:359] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.162222 30383 consensus_queue.cc:260] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.162635 30381 raft_consensus.cc:385] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.162967 30381 raft_consensus.cc:740] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.158167 30382 ts_tablet_manager.cc:1403] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.018s
I20260709 13:12:05.164490 30307 leader_election.cc:304] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:05.165359 30388 raft_consensus.cc:2804] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.165889 30388 raft_consensus.cc:697] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:05.165560 30381 consensus_queue.cc:260] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.166812 30388 consensus_queue.cc:237] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.167289 30382 raft_consensus.cc:359] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.168089 30382 raft_consensus.cc:385] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.168398 30382 raft_consensus.cc:740] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.169157 30382 consensus_queue.cc:260] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.171912 30382 ts_tablet_manager.cc:1434] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:05.173321 30382 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.174603 30381 ts_tablet_manager.cc:1434] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:12:05.176309 30383 ts_tablet_manager.cc:1434] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:05.177758 30383 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.179025 30381 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.179736 30389 raft_consensus.cc:493] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.180224 30389 raft_consensus.cc:515] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.182840 30389 leader_election.cc:290] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.185931 30381 tablet_bootstrap.cc:654] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.186738 30383 tablet_bootstrap.cc:654] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.194041 30382 tablet_bootstrap.cc:654] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.168659 30266 raft_consensus.cc:2468] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 1.
I20260709 13:12:05.199563 30387 raft_consensus.cc:493] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.200075 30387 raft_consensus.cc:515] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.206988 30383 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.207688 30383 ts_tablet_manager.cc:1403] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 13:12:05.210556 30401 raft_consensus.cc:493] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.211462 30387 leader_election.cc:290] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.213006 30401 raft_consensus.cc:515] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.214462 30383 raft_consensus.cc:359] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.222350 30383 raft_consensus.cc:385] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.222728 30383 raft_consensus.cc:740] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.223497 30383 consensus_queue.cc:260] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.226187 30401 leader_election.cc:290] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835)
I20260709 13:12:05.226429 30383 ts_tablet_manager.cc:1434] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:05.227421 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.235025 30191 raft_consensus.cc:2468] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 0.
I20260709 13:12:05.235504 30383 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.227952 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.238633 30381 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.239159 30381 ts_tablet_manager.cc:1403] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.006s
W20260709 13:12:05.240612 30304 leader_election.cc:343] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.242156 30381 raft_consensus.cc:359] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.243316 30381 raft_consensus.cc:385] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.243583 30381 raft_consensus.cc:740] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.244441 30381 consensus_queue.cc:260] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.244458 30383 tablet_bootstrap.cc:654] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.251302 30382 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.251777 30382 ts_tablet_manager.cc:1403] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.011s
I20260709 13:12:05.254134 30381 ts_tablet_manager.cc:1434] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:12:05.254575 30382 raft_consensus.cc:359] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.255317 30382 raft_consensus.cc:385] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.258270 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.258534 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
W20260709 13:12:05.260138 30155 leader_election.cc:343] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:05.260639 30233 leader_election.cc:343] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.267614 30389 raft_consensus.cc:493] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.264150 30381 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.268180 30389 raft_consensus.cc:515] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.270263 30389 leader_election.cc:290] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.270799 30088 catalog_manager.cc:5697] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 1 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.271945 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.272573 30191 raft_consensus.cc:2468] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 0.
I20260709 13:12:05.273739 30233 leader_election.cc:304] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.274581 30389 raft_consensus.cc:2804] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.274479 30307 leader_election.cc:304] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 5c0dfa0bd1a44137854ddecf0145b71d
I20260709 13:12:05.275022 30389 raft_consensus.cc:493] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.275389 30401 raft_consensus.cc:2804] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.275836 30401 raft_consensus.cc:493] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.276162 30401 raft_consensus.cc:3060] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.276297 30381 tablet_bootstrap.cc:654] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.275394 30389 raft_consensus.cc:3060] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.279949 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.255599 30382 raft_consensus.cc:740] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.282449 30382 consensus_queue.cc:260] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.285944 30388 raft_consensus.cc:493] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.286425 30388 raft_consensus.cc:515] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.288851 30340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.289608 30340 raft_consensus.cc:2468] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 0.
I20260709 13:12:05.289884 30381 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.290371 30381 ts_tablet_manager.cc:1403] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.006s
I20260709 13:12:05.290495 30339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.292073 30233 leader_election.cc:304] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:05.292358 30401 raft_consensus.cc:515] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.295377 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
W20260709 13:12:05.297888 30307 leader_election.cc:343] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.297837 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.299160 30266 raft_consensus.cc:2468] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 0.
I20260709 13:12:05.300606 30341 raft_consensus.cc:2393] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97ce280fdc1e413c915b4666c0ceb5a3 in current term 1: Already voted for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in this term.
I20260709 13:12:05.300923 30304 leader_election.cc:304] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:05.297896 30388 leader_election.cc:290] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.302379 30406 raft_consensus.cc:2804] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.302856 30406 raft_consensus.cc:493] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.303265 30406 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.304842 30382 ts_tablet_manager.cc:1434] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.006s
I20260709 13:12:05.309018 30389 raft_consensus.cc:515] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.306144 30382 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.314625 30158 leader_election.cc:304] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:05.313575 30389 leader_election.cc:290] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
W20260709 13:12:05.313714 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:05.316749 30387 raft_consensus.cc:3060] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.317346 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:05.317898 30191 raft_consensus.cc:3060] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.318243 30383 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.318759 30383 ts_tablet_manager.cc:1403] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.015s
I20260709 13:12:05.319449 30406 raft_consensus.cc:515] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.321534 30406 leader_election.cc:290] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.322477 30401 leader_election.cc:290] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835)
I20260709 13:12:05.322546 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:05.323289 30266 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.323467 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
W20260709 13:12:05.323606 30233 leader_election.cc:343] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.324905 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:05.325372 30192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:05.326002 30415 raft_consensus.cc:2804] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.326426 30415 raft_consensus.cc:493] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.326620 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:05.327371 30387 raft_consensus.cc:2749] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.299274 30381 raft_consensus.cc:359] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
W20260709 13:12:05.328238 30304 leader_election.cc:343] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:05.328459 30307 leader_election.cc:343] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.328217 30381 raft_consensus.cc:385] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.329175 30381 raft_consensus.cc:740] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.329447 30382 tablet_bootstrap.cc:654] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.330725 30266 raft_consensus.cc:2468] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 1.
I20260709 13:12:05.326818 30415 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.321789 30383 raft_consensus.cc:359] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.332034 30304 leader_election.cc:304] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:05.332759 30383 raft_consensus.cc:385] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.336882 30401 raft_consensus.cc:2804] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.337393 30401 raft_consensus.cc:697] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:05.338245 30401 consensus_queue.cc:237] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.341130 30190 raft_consensus.cc:2468] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 1.
I20260709 13:12:05.336153 30383 raft_consensus.cc:740] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.343633 30383 consensus_queue.cc:260] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.345013 30341 raft_consensus.cc:3060] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.351486 30191 raft_consensus.cc:2468] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 1.
I20260709 13:12:05.342342 30381 consensus_queue.cc:260] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.355854 30415 raft_consensus.cc:515] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.356238 30233 leader_election.cc:304] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.357064 30382 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.357595 30382 ts_tablet_manager.cc:1403] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.004s
I20260709 13:12:05.357954 30415 leader_election.cc:290] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.358526 30415 raft_consensus.cc:2804] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.360540 30415 raft_consensus.cc:697] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:05.360493 30382 raft_consensus.cc:359] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.361449 30382 raft_consensus.cc:385] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.361779 30382 raft_consensus.cc:740] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.361639 30415 consensus_queue.cc:237] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.362619 30382 consensus_queue.cc:260] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.360810 30307 leader_election.cc:304] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 5c0dfa0bd1a44137854ddecf0145b71d
I20260709 13:12:05.363831 30401 raft_consensus.cc:2804] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.364329 30401 raft_consensus.cc:697] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:05.364177 30087 catalog_manager.cc:5697] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 1 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.365113 30382 ts_tablet_manager.cc:1434] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 13:12:05.365198 30401 consensus_queue.cc:237] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.365957 30381 ts_tablet_manager.cc:1434] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.003s
I20260709 13:12:05.366287 30382 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.368618 30339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:05.369221 30339 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.373227 30382 tablet_bootstrap.cc:654] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.373827 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
W20260709 13:12:05.380853 30233 leader_election.cc:343] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.376148 30381 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.387568 30339 raft_consensus.cc:2468] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 1.
I20260709 13:12:05.395774 30233 leader_election.cc:304] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:05.396154 30088 catalog_manager.cc:5697] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 1 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.397303 30389 raft_consensus.cc:2804] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.394227 30416 raft_consensus.cc:493] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.399013 30416 raft_consensus.cc:515] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.403048 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596bd77c3c04197a6df5f6236730f5f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.403877 30190 raft_consensus.cc:2468] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 0.
I20260709 13:12:05.407859 30381 tablet_bootstrap.cc:654] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.407822 30233 leader_election.cc:304] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.413445 30415 raft_consensus.cc:2804] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.418162 30415 raft_consensus.cc:493] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.418524 30415 raft_consensus.cc:3060] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.413488 30416 leader_election.cc:290] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.421196 30341 raft_consensus.cc:2468] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 1.
I20260709 13:12:05.419100 30389 raft_consensus.cc:697] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:05.423552 30339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596bd77c3c04197a6df5f6236730f5f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
W20260709 13:12:05.424801 30233 leader_election.cc:343] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.425683 30383 ts_tablet_manager.cc:1434] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 13:12:05.426148 30382 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.426591 30382 ts_tablet_manager.cc:1403] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.028s
I20260709 13:12:05.426640 30383 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.427059 30087 catalog_manager.cc:5697] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 1 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.429956 30382 raft_consensus.cc:359] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.430636 30382 raft_consensus.cc:385] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.430908 30382 raft_consensus.cc:740] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.431725 30382 consensus_queue.cc:260] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.432384 30389 consensus_queue.cc:237] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.435417 30382 ts_tablet_manager.cc:1434] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:12:05.436363 30382 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.436745 30383 tablet_bootstrap.cc:654] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.442119 30382 tablet_bootstrap.cc:654] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.441980 30415 raft_consensus.cc:515] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.446973 30415 leader_election.cc:290] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.447795 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596bd77c3c04197a6df5f6236730f5f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:05.448110 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596bd77c3c04197a6df5f6236730f5f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:05.448287 30190 raft_consensus.cc:3060] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:05.449280 30233 leader_election.cc:343] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.449908 30382 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.450352 30382 ts_tablet_manager.cc:1403] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:12:05.451169 30383 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.451640 30383 ts_tablet_manager.cc:1403] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.002s
I20260709 13:12:05.452988 30382 raft_consensus.cc:359] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.453653 30382 raft_consensus.cc:385] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.453924 30382 raft_consensus.cc:740] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.454365 30190 raft_consensus.cc:2468] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 1.
I20260709 13:12:05.454625 30382 consensus_queue.cc:260] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.455428 30233 leader_election.cc:304] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:05.456223 30415 raft_consensus.cc:2804] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.456295 30381 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.456768 30382 ts_tablet_manager.cc:1434] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:05.456790 30415 raft_consensus.cc:697] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:05.457855 30382 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d: Bootstrap starting.
I20260709 13:12:05.457050 30381 ts_tablet_manager.cc:1403] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.008s
I20260709 13:12:05.457872 30415 consensus_queue.cc:237] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.461074 30381 raft_consensus.cc:359] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.461786 30381 raft_consensus.cc:385] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.462056 30381 raft_consensus.cc:740] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.454391 30383 raft_consensus.cc:359] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.462036 30087 catalog_manager.cc:5697] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 1 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.463229 30383 raft_consensus.cc:385] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.463207 30381 consensus_queue.cc:260] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.463860 30382 tablet_bootstrap.cc:654] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.463804 30383 raft_consensus.cc:740] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.464900 30383 consensus_queue.cc:260] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.465654 30381 ts_tablet_manager.cc:1434] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:05.466750 30381 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.471241 30383 ts_tablet_manager.cc:1434] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:12:05.472391 30383 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.474923 30382 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d: No bootstrap required, opened a new log
I20260709 13:12:05.474931 30381 tablet_bootstrap.cc:654] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.475528 30382 ts_tablet_manager.cc:1403] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:12:05.478636 30383 tablet_bootstrap.cc:654] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.478538 30382 raft_consensus.cc:359] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.479499 30382 raft_consensus.cc:385] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.479905 30382 raft_consensus.cc:740] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.490960 30382 consensus_queue.cc:260] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.493566 30382 ts_tablet_manager.cc:1434] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:05.496711 30381 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.497165 30381 ts_tablet_manager.cc:1403] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.011s
I20260709 13:12:05.497521 30383 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.497982 30383 ts_tablet_manager.cc:1403] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:12:05.499313 30381 raft_consensus.cc:359] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.499888 30381 raft_consensus.cc:385] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.500099 30381 raft_consensus.cc:740] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.500623 30383 raft_consensus.cc:359] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.500800 30381 consensus_queue.cc:260] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.501442 30383 raft_consensus.cc:385] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.501793 30383 raft_consensus.cc:740] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.502640 30383 consensus_queue.cc:260] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.503387 30381 ts_tablet_manager.cc:1434] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:05.504360 30381 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.504670 30383 ts_tablet_manager.cc:1434] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:05.505635 30383 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.509898 30381 tablet_bootstrap.cc:654] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.511102 30383 tablet_bootstrap.cc:654] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.517551 30381 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.517982 30381 ts_tablet_manager.cc:1403] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:12:05.520062 30381 raft_consensus.cc:359] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.520752 30381 raft_consensus.cc:385] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.521122 30381 raft_consensus.cc:740] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.520694 30087 catalog_manager.cc:5697] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 1 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.521726 30381 consensus_queue.cc:260] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.522310 30383 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.522809 30383 ts_tablet_manager.cc:1403] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.008s
I20260709 13:12:05.523180 30381 ts_tablet_manager.cc:1434] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:05.523960 30381 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:05.527558 30383 raft_consensus.cc:359] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.528576 30381 tablet_bootstrap.cc:654] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.529716 30383 raft_consensus.cc:385] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.533890 30381 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: No bootstrap required, opened a new log
I20260709 13:12:05.533998 30383 raft_consensus.cc:740] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.534307 30381 ts_tablet_manager.cc:1403] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:05.534917 30383 consensus_queue.cc:260] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.536578 30381 raft_consensus.cc:359] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.537297 30381 raft_consensus.cc:385] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.537582 30381 raft_consensus.cc:740] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.538224 30381 consensus_queue.cc:260] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.540210 30381 ts_tablet_manager.cc:1434] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:05.536953 30383 ts_tablet_manager.cc:1434] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:12:05.541172 30383 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17: Bootstrap starting.
I20260709 13:12:05.546444 30383 tablet_bootstrap.cc:654] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.550454 30383 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17: No bootstrap required, opened a new log
I20260709 13:12:05.550884 30383 ts_tablet_manager.cc:1403] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:05.552753 30383 raft_consensus.cc:359] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.553205 30383 raft_consensus.cc:385] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.553416 30383 raft_consensus.cc:740] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.554001 30383 consensus_queue.cc:260] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.555567 30383 ts_tablet_manager.cc:1434] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:12:05.599148 30387 raft_consensus.cc:493] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.599627 30387 raft_consensus.cc:515] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.601364 30387 leader_election.cc:290] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.601958 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.602416 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.602535 30266 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 0.
I20260709 13:12:05.603044 30341 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 0.
I20260709 13:12:05.603611 30155 leader_election.cc:304] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.604394 30387 raft_consensus.cc:2804] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.604751 30387 raft_consensus.cc:493] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.605020 30387 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.609838 30387 raft_consensus.cc:515] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.611389 30387 leader_election.cc:290] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.612006 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:05.612344 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:05.612490 30266 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.612849 30341 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.615742 30387 raft_consensus.cc:493] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.616207 30387 raft_consensus.cc:515] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.618146 30341 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 1.
I20260709 13:12:05.618827 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.619243 30158 leader_election.cc:304] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:05.619442 30267 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 0.
I20260709 13:12:05.619766 30401 consensus_queue.cc:1048] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.620034 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.617936 30266 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 1.
I20260709 13:12:05.620589 30155 leader_election.cc:304] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.620748 30341 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 0.
I20260709 13:12:05.622447 30438 raft_consensus.cc:2804] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.622853 30439 raft_consensus.cc:2804] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.623080 30387 leader_election.cc:290] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.623564 30439 raft_consensus.cc:493] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.624199 30439 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.625675 30438 raft_consensus.cc:697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: Becoming Leader. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Running, Role: LEADER
I20260709 13:12:05.626577 30438 consensus_queue.cc:237] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.632350 30439 raft_consensus.cc:515] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.635434 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:05.635516 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:05.636000 30266 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.636293 30341 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.644889 30341 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 1.
I20260709 13:12:05.645440 30266 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 1.
I20260709 13:12:05.645959 30158 leader_election.cc:304] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:05.646768 30439 leader_election.cc:290] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.647145 30438 raft_consensus.cc:2804] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.647861 30438 raft_consensus.cc:697] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: Becoming Leader. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Running, Role: LEADER
I20260709 13:12:05.648972 30438 consensus_queue.cc:237] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.651856 30087 catalog_manager.cc:5697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.654760 30439 raft_consensus.cc:493] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.655236 30439 raft_consensus.cc:515] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.658293 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.658457 30439 leader_election.cc:290] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.658895 30267 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 0.
I20260709 13:12:05.660333 30155 leader_election.cc:304] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.660473 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.661082 30341 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 0.
I20260709 13:12:05.661479 30406 consensus_queue.cc:1048] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.661131 30439 raft_consensus.cc:2804] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.662907 30439 raft_consensus.cc:493] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.663374 30439 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.670409 30439 raft_consensus.cc:515] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.673046 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:05.673610 30267 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.674000 30439 leader_election.cc:290] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.673288 30087 catalog_manager.cc:5697] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.674235 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:05.674867 30341 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.680622 30267 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 1.
I20260709 13:12:05.681694 30155 leader_election.cc:304] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.681810 30341 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ce280fdc1e413c915b4666c0ceb5a3 in term 1.
I20260709 13:12:05.682483 30439 raft_consensus.cc:2804] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.682960 30439 raft_consensus.cc:697] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: Becoming Leader. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Running, Role: LEADER
I20260709 13:12:05.683796 30439 consensus_queue.cc:237] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.684237 30406 raft_consensus.cc:493] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.684739 30406 raft_consensus.cc:515] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.687167 30406 leader_election.cc:290] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.687872 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596bd77c3c04197a6df5f6236730f5f" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.688046 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596bd77c3c04197a6df5f6236730f5f" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.688625 30190 raft_consensus.cc:2393] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in current term 1: Already voted for candidate 5c0dfa0bd1a44137854ddecf0145b71d in this term.
I20260709 13:12:05.689860 30307 leader_election.cc:304] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:05.690618 30406 raft_consensus.cc:3060] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.696374 30406 raft_consensus.cc:2749] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.696611 30090 catalog_manager.cc:5697] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.703042 30415 raft_consensus.cc:493] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.703464 30415 raft_consensus.cc:515] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:05.706182 30415 leader_election.cc:290] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117), 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835)
I20260709 13:12:05.706730 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.707129 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.707857 30190 raft_consensus.cc:2393] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c0dfa0bd1a44137854ddecf0145b71d in current term 1: Already voted for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in this term.
I20260709 13:12:05.708685 30233 leader_election.cc:304] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d; no voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:05.709291 30415 raft_consensus.cc:3060] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.713805 30415 raft_consensus.cc:2749] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.720829 30406 consensus_queue.cc:1048] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.731979 30190 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.739471 30406 consensus_queue.cc:1048] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.775252 30415 consensus_queue.cc:1048] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.786736 30425 consensus_queue.cc:1048] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.801631 30406 raft_consensus.cc:493] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.802006 30406 raft_consensus.cc:515] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.803557 30406 leader_election.cc:290] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.804054 30425 raft_consensus.cc:493] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.804237 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.804601 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" is_pre_election: true
I20260709 13:12:05.804589 30425 raft_consensus.cc:515] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.804905 30190 raft_consensus.cc:2468] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 0.
I20260709 13:12:05.805611 30267 raft_consensus.cc:2468] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 0.
I20260709 13:12:05.805970 30307 leader_election.cc:304] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:05.806806 30406 raft_consensus.cc:2804] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.807169 30425 leader_election.cc:290] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.807207 30406 raft_consensus.cc:493] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.807367 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" is_pre_election: true
I20260709 13:12:05.808040 30406 raft_consensus.cc:3060] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.808230 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:05.808254 30190 raft_consensus.cc:2468] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 0.
I20260709 13:12:05.809499 30233 leader_election.cc:304] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:05.810115 30425 raft_consensus.cc:2804] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.810489 30425 raft_consensus.cc:493] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.810799 30425 raft_consensus.cc:3060] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.815014 30406 raft_consensus.cc:515] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.816282 30341 raft_consensus.cc:2393] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c0dfa0bd1a44137854ddecf0145b71d in current term 1: Already voted for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in this term.
I20260709 13:12:05.817830 30190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:05.818126 30425 raft_consensus.cc:515] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.818362 30406 leader_election.cc:290] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:05.818404 30190 raft_consensus.cc:3060] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.819396 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:05.820214 30267 raft_consensus.cc:2393] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in current term 1: Already voted for candidate 5c0dfa0bd1a44137854ddecf0145b71d in this term.
I20260709 13:12:05.820749 30191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:05.821055 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa59dae0321d4c8ab8b726a3c33fb4db" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:05.821789 30341 raft_consensus.cc:2393] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c0dfa0bd1a44137854ddecf0145b71d in current term 1: Already voted for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in this term.
I20260709 13:12:05.820871 30425 leader_election.cc:290] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:05.822642 30233 leader_election.cc:304] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d; no voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:05.823314 30425 raft_consensus.cc:2749] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.824994 30190 raft_consensus.cc:2468] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 1.
I20260709 13:12:05.825809 30307 leader_election.cc:304] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 5c0dfa0bd1a44137854ddecf0145b71d
I20260709 13:12:05.826424 30406 raft_consensus.cc:2804] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.826821 30406 raft_consensus.cc:697] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:05.827517 30406 consensus_queue.cc:237] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:05.834280 30090 catalog_manager.cc:5697] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 1 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.840806 30406 consensus_queue.cc:1048] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.841017 30191 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.849041 30425 consensus_queue.cc:1048] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.851598 30451 consensus_queue.cc:1048] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.865026 30425 consensus_queue.cc:1048] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.888067 30415 consensus_queue.cc:1048] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.898824 30425 consensus_queue.cc:1048] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.980273 21775 ts_manager.cc:295] Set tserver state for 97ce280fdc1e413c915b4666c0ceb5a3 to MAINTENANCE_MODE
I20260709 13:12:05.980939 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
I20260709 13:12:06.000284 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:06.001093 21775 tablet_replica.cc:333] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.001983 21775 raft_consensus.cc:2243] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.002573 21775 raft_consensus.cc:2272] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.005270 21775 tablet_replica.cc:333] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.005836 21775 raft_consensus.cc:2243] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.006385 21775 pending_rounds.cc:70] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Trying to abort 1 pending ops.
I20260709 13:12:06.006573 21775 pending_rounds.cc:77] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636764269948928 op_type: NO_OP noop_request { }
I20260709 13:12:06.006865 21775 raft_consensus.cc:2889] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:06.007140 21775 raft_consensus.cc:2272] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.009213 21775 tablet_replica.cc:333] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.009739 21775 raft_consensus.cc:2243] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.010290 21775 pending_rounds.cc:70] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Trying to abort 1 pending ops.
I20260709 13:12:06.010488 21775 pending_rounds.cc:77] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636764175478784 op_type: NO_OP noop_request { }
I20260709 13:12:06.010735 21775 raft_consensus.cc:2889] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:06.011008 21775 raft_consensus.cc:2272] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.013027 21775 tablet_replica.cc:333] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.013576 21775 raft_consensus.cc:2243] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.013943 21775 raft_consensus.cc:2272] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.016108 21775 tablet_replica.cc:333] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.016603 21775 raft_consensus.cc:2243] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.016935 21775 raft_consensus.cc:2272] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.018481 21775 tablet_replica.cc:333] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.018987 21775 raft_consensus.cc:2243] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.019361 21775 raft_consensus.cc:2272] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.021390 21775 tablet_replica.cc:333] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.021876 21775 raft_consensus.cc:2243] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.022423 21775 pending_rounds.cc:70] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Trying to abort 1 pending ops.
I20260709 13:12:06.022596 21775 pending_rounds.cc:77] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636764409303040 op_type: NO_OP noop_request { }
I20260709 13:12:06.022858 21775 raft_consensus.cc:2889] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:06.023123 21775 raft_consensus.cc:2272] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.025029 21775 tablet_replica.cc:333] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.025527 21775 raft_consensus.cc:2243] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.025905 21775 raft_consensus.cc:2272] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.027818 21775 tablet_replica.cc:333] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.028294 21775 raft_consensus.cc:2243] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.028705 21775 raft_consensus.cc:2272] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.030551 21775 tablet_replica.cc:333] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: stopping tablet replica
I20260709 13:12:06.031083 21775 raft_consensus.cc:2243] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.031453 21775 raft_consensus.cc:2272] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.062244 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
W20260709 13:12:06.071009 30307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111) [suppressed 187 similar messages]
W20260709 13:12:06.074278 30307 consensus_peers.cc:597] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.203503 30307 consensus_peers.cc:597] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.224901 30307 consensus_peers.cc:597] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.312937 30388 consensus_queue.cc:1048] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:06.317103 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:06.342092 30233 consensus_peers.cc:597] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.365167 30233 consensus_peers.cc:597] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.375098 30307 consensus_peers.cc:597] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.378698 30233 consensus_peers.cc:597] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.312600 30415 raft_consensus.cc:493] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.313032 30415 raft_consensus.cc:515] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.314525 30415 leader_election.cc:290] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:07.315910 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:07.316610 30341 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 1.
I20260709 13:12:07.317612 30233 leader_election.cc:304] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
W20260709 13:12:07.318069 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:07.318394 30415 raft_consensus.cc:2804] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:07.318429 30233 leader_election.cc:336] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111)
I20260709 13:12:07.318804 30415 raft_consensus.cc:493] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.319145 30415 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:07.325201 30415 raft_consensus.cc:515] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.326653 30415 leader_election.cc:290] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:07.327947 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:07.328526 30341 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:07.329906 30233 leader_election.cc:336] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111)
I20260709 13:12:07.333081 30341 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 2.
I20260709 13:12:07.334019 30233 leader_election.cc:304] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:07.334619 30415 raft_consensus.cc:2804] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:07.335022 30415 raft_consensus.cc:697] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:07.335736 30415 consensus_queue.cc:237] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.342434 30087 catalog_manager.cc:5697] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 1 to 2, leader changed from 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193) to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 2 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.768038 30415 raft_consensus.cc:493] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.768878 30415 raft_consensus.cc:515] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.771359 30415 leader_election.cc:290] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:07.773681 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:07.774852 30341 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 1.
W20260709 13:12:07.776111 30233 leader_election.cc:336] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111)
I20260709 13:12:07.776993 30233 leader_election.cc:304] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:07.777637 30415 raft_consensus.cc:2804] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:07.777935 30415 raft_consensus.cc:493] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.778183 30415 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:07.786648 30415 raft_consensus.cc:515] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.788611 30415 leader_election.cc:290] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:07.790258 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:07.790831 30341 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:07.791344 30233 leader_election.cc:336] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111)
I20260709 13:12:07.798779 30341 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 2.
I20260709 13:12:07.799640 30233 leader_election.cc:304] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:07.800254 30415 raft_consensus.cc:2804] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:07.800694 30415 raft_consensus.cc:697] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:07.802134 30415 consensus_queue.cc:237] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.812810 30087 catalog_manager.cc:5697] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 1 to 2, leader changed from 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193) to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 2 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.846786 30415 raft_consensus.cc:493] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.847458 30415 raft_consensus.cc:515] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.849071 30415 leader_election.cc:290] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:07.850608 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" is_pre_election: true
I20260709 13:12:07.851383 30341 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 1.
I20260709 13:12:07.852448 30233 leader_election.cc:304] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:07.853076 30415 raft_consensus.cc:2804] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:07.853101 30233 leader_election.cc:336] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111)
I20260709 13:12:07.853402 30415 raft_consensus.cc:493] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.853797 30415 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:07.860551 30415 raft_consensus.cc:515] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.862111 30415 leader_election.cc:290] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:07.863469 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:07.864069 30341 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:07.865505 30233 leader_election.cc:336] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111)
I20260709 13:12:07.869673 30341 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 2.
I20260709 13:12:07.870795 30233 leader_election.cc:304] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 97ce280fdc1e413c915b4666c0ceb5a3
I20260709 13:12:07.871421 30415 raft_consensus.cc:2804] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:07.871879 30415 raft_consensus.cc:697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:07.872963 30415 consensus_queue.cc:237] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:07.879071 30087 catalog_manager.cc:5697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 1 to 2, leader changed from 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193) to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 2 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.904917 30341 raft_consensus.cc:1275] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:07.906039 30415 consensus_queue.cc:1048] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:07.921373 30233 consensus_peers.cc:597] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.285727 30233 consensus_peers.cc:597] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.319495 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:08.384840 30341 raft_consensus.cc:1275] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:08.386226 30415 consensus_queue.cc:1048] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:08.392580 30233 consensus_peers.cc:597] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.422237 30341 raft_consensus.cc:1275] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:08.423492 30389 consensus_queue.cc:1048] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:08.450824 30307 consensus_peers.cc:597] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.626622 30307 consensus_peers.cc:597] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.664435 30307 consensus_peers.cc:597] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.772663 30233 consensus_peers.cc:597] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.777773 30307 consensus_peers.cc:597] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.939826 30233 consensus_peers.cc:597] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.018532 30233 consensus_peers.cc:597] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.320472 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:10.301533 30233 consensus_peers.cc:597] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.321337 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:10.591908 30233 consensus_peers.cc:597] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.873967 30233 consensus_peers.cc:597] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.023105 30307 consensus_peers.cc:597] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.080375 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:11.088272 30486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:11.088716 30485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:11.090883 30488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:11.092533 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:11.093953 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:11.094192 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:11.094375 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602731094358 us; error 0 us; skew 500 ppm
I20260709 13:12:11.095037 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:11.097708 21775 webserver.cc:533] Webserver started at http://127.21.67.193:35103/ using document root <none> and password file <none>
I20260709 13:12:11.098244 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:11.098446 21775 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:11.102344 21775 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:11.106269 30493 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:11.106998 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:12:11.107290 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-zkvt"
I20260709 13:12:11.107645 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:12:11.113958 30307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111) [suppressed 95 similar messages]
W20260709 13:12:11.116209 30307 consensus_peers.cc:597] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.124658 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:11.126094 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:11.127525 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:11.131036 30500 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:12:11.149325 30307 consensus_peers.cc:597] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.180030 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:12:11.180397 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:12:11.180716 21775 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:12:11.185722 30500 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.198511 30500 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.199368 30500 tablet_bootstrap.cc:492] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.199934 30500 ts_tablet_manager.cc:1403] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:12:11.201977 30500 raft_consensus.cc:359] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.202478 30500 raft_consensus.cc:740] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.203148 30500 consensus_queue.cc:260] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.205322 30500 ts_tablet_manager.cc:1434] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:11.205958 30500 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.217686 30500 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.217959 21775 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:12:11.218258 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.038s	user 0.032s	sys 0.004s
I20260709 13:12:11.218472 30500 tablet_bootstrap.cc:492] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.219056 30500 ts_tablet_manager.cc:1403] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:12:11.221091 30500 raft_consensus.cc:359] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:11.221602 30500 raft_consensus.cc:740] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.222261 30500 consensus_queue.cc:260] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:11.223875 30500 ts_tablet_manager.cc:1434] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:12:11.224532 30500 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.237404 30500 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.238186 30500 tablet_bootstrap.cc:492] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.238835 30500 ts_tablet_manager.cc:1403] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:12:11.241317 30500 raft_consensus.cc:359] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.241839 30500 raft_consensus.cc:740] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.242555 30500 consensus_queue.cc:260] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.244311 30500 ts_tablet_manager.cc:1434] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:12:11.244974 30500 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.256302 30500 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:12:11.256979 30500 tablet_bootstrap.cc:492] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.257545 30500 ts_tablet_manager.cc:1403] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:12:11.260180 30500 raft_consensus.cc:359] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.260821 30500 raft_consensus.cc:740] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.261415 30500 consensus_queue.cc:260] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.262938 30500 ts_tablet_manager.cc:1434] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:11.263772 30500 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.276903 30500 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.277638 30500 tablet_bootstrap.cc:492] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.278177 30500 ts_tablet_manager.cc:1403] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:12:11.280242 30500 raft_consensus.cc:359] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.280755 30500 raft_consensus.cc:740] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.281383 30500 consensus_queue.cc:260] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.281865 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:46835
I20260709 13:12:11.281998 30562 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:46835 every 8 connection(s)
I20260709 13:12:11.283572 30500 ts_tablet_manager.cc:1434] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:11.284353 30500 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.297407 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:11.309521 30500 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.311012 30500 tablet_bootstrap.cc:492] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.311968 30500 ts_tablet_manager.cc:1403] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
W20260709 13:12:11.322405 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:11.322026 30500 raft_consensus.cc:359] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.323015 30500 raft_consensus.cc:740] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.324141 30500 consensus_queue.cc:260] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.326474 30500 ts_tablet_manager.cc:1434] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:11.327841 30500 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.337288 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
mode: GRACEFUL
new_leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:50008
I20260709 13:12:11.338073 30267 raft_consensus.cc:606] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Received request to transfer leadership to TS afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:11.338166 30563 heartbeater.cc:344] Connected to a master server at 127.21.67.254:36973
I20260709 13:12:11.338683 30563 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:11.339824 30563 heartbeater.cc:507] Master 127.21.67.254:36973 requested a full tablet report, sending...
I20260709 13:12:11.341554 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
mode: GRACEFUL
new_leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:50008
I20260709 13:12:11.342163 30267 raft_consensus.cc:606] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Received request to transfer leadership to TS afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:11.343263 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:11.343613 30500 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:12:11.343871 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:11.344583 30500 tablet_bootstrap.cc:492] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.344719 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:11.345399 30500 ts_tablet_manager.cc:1403] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:12:11.345873 30090 ts_manager.cc:194] Re-registered known tserver with Master: 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835)
I20260709 13:12:11.347967 30500 raft_consensus.cc:359] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.348780 30500 raft_consensus.cc:740] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.349426 30500 consensus_queue.cc:260] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.351374 30500 ts_tablet_manager.cc:1434] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:11.352144 30500 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.354832 30090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33258
I20260709 13:12:11.358350 30563 heartbeater.cc:499] Master 127.21.67.254:36973 was elected leader, sending a full tablet report...
I20260709 13:12:11.365420 30500 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.366076 30500 tablet_bootstrap.cc:492] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.366654 30500 ts_tablet_manager.cc:1403] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:12:11.368399 30500 raft_consensus.cc:359] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.368849 30500 raft_consensus.cc:740] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.369374 30500 consensus_queue.cc:260] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.370692 30500 ts_tablet_manager.cc:1434] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:11.371409 30500 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.381937 30500 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:12:11.382632 30500 tablet_bootstrap.cc:492] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.383217 30500 ts_tablet_manager.cc:1403] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:11.385463 30500 raft_consensus.cc:359] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.386276 30500 raft_consensus.cc:740] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.386840 30500 consensus_queue.cc:260] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.388311 30500 ts_tablet_manager.cc:1434] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:11.389276 30500 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap starting.
I20260709 13:12:11.401968 30500 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.402751 30500 tablet_bootstrap.cc:492] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Bootstrap complete.
I20260709 13:12:11.403373 30500 ts_tablet_manager.cc:1403] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:12:11.405772 30500 raft_consensus.cc:359] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.406219 30500 raft_consensus.cc:740] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ce280fdc1e413c915b4666c0ceb5a3, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.406729 30500 consensus_queue.cc:260] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.408413 30500 ts_tablet_manager.cc:1434] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:12:11.431403 30537 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.437522 30537 pending_rounds.cc:85] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting all ops after (but not including) 0
I20260709 13:12:11.437709 30537 pending_rounds.cc:107] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:12:11.437901 30537 raft_consensus.cc:2889] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:11.537215 30415 raft_consensus.cc:993] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d: : Instructing follower afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:11.537807 30577 raft_consensus.cc:1081] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Signalling peer afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:11.539284 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:12:11.539844 30341 raft_consensus.cc:493] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:11.540148 30341 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:11.545768 30341 raft_consensus.cc:515] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.547853 30341 leader_election.cc:290] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:11.548098 30537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:11.548550 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:11.549351 30267 raft_consensus.cc:3055] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:11.549763 30267 raft_consensus.cc:740] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:11.548806 30537 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:11.550576 30267 consensus_queue.cc:260] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.552002 30267 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:11.552500 30577 raft_consensus.cc:993] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d: : Instructing follower afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:11.552975 30577 raft_consensus.cc:1081] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Signalling peer afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:11.554432 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:12:11.554983 30341 raft_consensus.cc:493] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:11.555469 30341 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:11.556183 30537 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:11.557150 30307 leader_election.cc:304] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:11.557881 30388 raft_consensus.cc:2804] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:11.560149 30388 raft_consensus.cc:697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:11.560351 30267 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:11.561021 30388 consensus_queue.cc:237] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.561950 30341 raft_consensus.cc:515] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.563531 30341 leader_election.cc:290] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:11.564570 30537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:11.564601 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710c86f75eb842a4a93d3308e33faf37" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:11.565376 30537 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:11.565464 30267 raft_consensus.cc:3055] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:11.565968 30267 raft_consensus.cc:740] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:11.566752 30267 consensus_queue.cc:260] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.567826 30267 raft_consensus.cc:3060] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:11.569969 30090 catalog_manager.cc:5697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 2 to 3, leader changed from 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194) to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 3 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.571974 30537 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:11.572520 30267 raft_consensus.cc:2468] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:11.573083 30307 leader_election.cc:304] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:11.573982 30388 raft_consensus.cc:2804] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:11.577695 30388 raft_consensus.cc:697] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:11.578918 30388 consensus_queue.cc:237] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:11.594408 30087 catalog_manager.cc:5697] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 2 to 3, leader changed from 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194) to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 3 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.947817 30537 raft_consensus.cc:1275] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:11.948979 30388 consensus_queue.cc:1048] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.949426 30388 consensus_queue.cc:1243] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Peer 97ce280fdc1e413c915b4666c0ceb5a3 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:12:11.951282 30537 pending_rounds.cc:85] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting all ops after (but not including) 0
I20260709 13:12:11.951588 30537 pending_rounds.cc:107] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:12:11.951915 30537 raft_consensus.cc:2889] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:11.952314 30267 raft_consensus.cc:1275] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:11.954106 30388 consensus_queue.cc:1048] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:11.968293 30536 raft_consensus.cc:1275] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:11.971045 30581 consensus_queue.cc:1048] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.971637 30581 consensus_queue.cc:1243] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Peer 97ce280fdc1e413c915b4666c0ceb5a3 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:12:11.978279 30536 pending_rounds.cc:85] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting all ops after (but not including) 0
I20260709 13:12:11.978576 30536 pending_rounds.cc:107] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:12:11.978828 30536 raft_consensus.cc:2889] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:11.991938 30267 raft_consensus.cc:1275] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:11.994040 30388 consensus_queue.cc:1048] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:12.323386 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:12.354941 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:12.371701 30341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
mode: GRACEFUL
new_leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:59928
I20260709 13:12:12.372166 30341 raft_consensus.cc:606] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Received request to transfer leadership to TS 5c0dfa0bd1a44137854ddecf0145b71d
I20260709 13:12:12.374410 30341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
mode: GRACEFUL
new_leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:59928
I20260709 13:12:12.374805 30341 raft_consensus.cc:606] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Received request to transfer leadership to TS 5c0dfa0bd1a44137854ddecf0145b71d
I20260709 13:12:12.375711 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:12.376137 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:12.376647 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:12.392215 30581 raft_consensus.cc:993] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17: : Instructing follower 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:12.392673 30388 raft_consensus.cc:1081] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Signalling peer 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:12.393996 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:49988
I20260709 13:12:12.394385 30267 raft_consensus.cc:493] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:12.394618 30267 raft_consensus.cc:3060] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.399751 30267 raft_consensus.cc:515] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:12.401549 30267 leader_election.cc:290] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Requested vote from peers afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117), 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835)
I20260709 13:12:12.402108 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:12.402616 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d29a8f233a44dca891c2fba97f473f" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:12.403219 30581 raft_consensus.cc:993] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17: : Instructing follower 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:12.402727 30341 raft_consensus.cc:3055] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:12.403851 30536 raft_consensus.cc:3060] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.404038 30388 raft_consensus.cc:1081] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Signalling peer 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:12.404038 30341 raft_consensus.cc:740] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:12.405058 30341 consensus_queue.cc:260] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:12.405836 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:49988
I20260709 13:12:12.406116 30341 raft_consensus.cc:3060] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.406474 30267 raft_consensus.cc:493] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:12.407006 30267 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.410988 30341 raft_consensus.cc:2468] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 2.
I20260709 13:12:12.411939 30536 raft_consensus.cc:2468] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 2.
I20260709 13:12:12.412041 30233 leader_election.cc:304] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:12.412963 30587 raft_consensus.cc:2804] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:12.413420 30587 raft_consensus.cc:697] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:12.413910 30267 raft_consensus.cc:515] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:12.414281 30587 consensus_queue.cc:237] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } }
I20260709 13:12:12.415545 30267 leader_election.cc:290] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:12.416391 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:12.416560 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:12.416890 30536 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.417131 30341 raft_consensus.cc:3055] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:12.417629 30341 raft_consensus.cc:740] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:12.420087 30341 consensus_queue.cc:260] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:12.421334 30341 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.422684 30536 raft_consensus.cc:2468] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 2.
I20260709 13:12:12.422034 30090 catalog_manager.cc:5697] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 1 to 2, leader changed from afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195) to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 2 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.423619 30233 leader_election.cc:304] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:12.424294 30587 raft_consensus.cc:2804] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:12.424703 30587 raft_consensus.cc:697] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:12.425479 30587 consensus_queue.cc:237] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:12.427976 30341 raft_consensus.cc:2468] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 2.
I20260709 13:12:12.441256 30090 catalog_manager.cc:5697] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 1 to 2, leader changed from afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195) to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 2 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.814235 30341 raft_consensus.cc:1275] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:12.815302 30415 consensus_queue.cc:1048] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:12.824209 30536 raft_consensus.cc:1275] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:12.825598 30415 consensus_queue.cc:1048] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:12.851970 30536 raft_consensus.cc:1275] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:12.853024 30415 consensus_queue.cc:1048] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:12.860705 30341 raft_consensus.cc:1275] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:12.861905 30587 consensus_queue.cc:1048] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:13.324172 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:13.383224 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:13.389876 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
mode: GRACEFUL
new_leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:50008
I20260709 13:12:13.390358 30267 raft_consensus.cc:606] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Received request to transfer leadership to TS afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:13.392638 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
mode: GRACEFUL
new_leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:50008
I20260709 13:12:13.393013 30267 raft_consensus.cc:606] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Received request to transfer leadership to TS afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:13.393915 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:13.394294 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:13.394749 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:13.401109 30577 raft_consensus.cc:993] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d: : Instructing follower afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:13.401610 30587 raft_consensus.cc:1081] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Signalling peer afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:13.402853 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:12:13.403250 30341 raft_consensus.cc:493] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:13.403517 30341 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:13.407837 30341 raft_consensus.cc:515] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:13.409164 30341 leader_election.cc:290] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 2 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:13.409858 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:13.410207 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:13.410473 30536 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:13.410826 30267 raft_consensus.cc:3055] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:13.411150 30267 raft_consensus.cc:740] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:13.412036 30267 consensus_queue.cc:260] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:13.413321 30267 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:13.417550 30536 raft_consensus.cc:2468] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 2.
I20260709 13:12:13.418730 30307 leader_election.cc:304] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:13.419426 30581 raft_consensus.cc:2804] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:13.420070 30267 raft_consensus.cc:2468] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 2.
I20260709 13:12:13.420450 30581 raft_consensus.cc:697] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:13.421496 30581 consensus_queue.cc:237] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:13.427901 30089 catalog_manager.cc:5697] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 1 to 2, leader changed from 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194) to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 2 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.763238 30587 raft_consensus.cc:993] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d: : Instructing follower afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:13.763631 30577 raft_consensus.cc:1081] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Signalling peer afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:13.764938 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:12:13.765331 30341 raft_consensus.cc:493] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:13.765545 30341 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.769825 30341 raft_consensus.cc:515] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:13.771106 30341 leader_election.cc:290] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:13.771981 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:13.772181 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d73d90a2f1478e91e89a4ca784ea17" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:13.772621 30536 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.772758 30267 raft_consensus.cc:3055] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:13.773157 30267 raft_consensus.cc:740] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:13.773887 30267 consensus_queue.cc:260] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:13.775002 30267 raft_consensus.cc:3060] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.779345 30536 raft_consensus.cc:2468] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:13.780402 30307 leader_election.cc:304] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:13.781105 30581 raft_consensus.cc:2804] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:13.781544 30581 raft_consensus.cc:697] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:13.781646 30267 raft_consensus.cc:2468] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:13.782424 30581 consensus_queue.cc:237] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:13.788539 30089 catalog_manager.cc:5697] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 2 to 3, leader changed from 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194) to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 3 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.845023 30267 raft_consensus.cc:1275] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:13.846036 30581 consensus_queue.cc:1048] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:13.860116 30536 raft_consensus.cc:1275] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:13.861287 30620 consensus_queue.cc:1048] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:14.325017 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:14.341387 30266 raft_consensus.cc:1275] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.342537 30618 consensus_queue.cc:1048] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.351254 30536 raft_consensus.cc:1275] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.352730 30620 consensus_queue.cc:1048] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.400862 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:14.407833 30341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
mode: GRACEFUL
new_leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:59928
I20260709 13:12:14.408309 30341 raft_consensus.cc:606] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Received request to transfer leadership to TS 5c0dfa0bd1a44137854ddecf0145b71d
I20260709 13:12:14.410501 30341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
mode: GRACEFUL
new_leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:59928
I20260709 13:12:14.410904 30341 raft_consensus.cc:606] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 LEADER]: Received request to transfer leadership to TS 5c0dfa0bd1a44137854ddecf0145b71d
I20260709 13:12:14.411741 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:14.412135 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:14.412607 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:14.474035 30581 raft_consensus.cc:993] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17: : Instructing follower 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:14.474478 30620 raft_consensus.cc:1081] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 LEADER]: Signalling peer 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:14.475898 30266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:49988
I20260709 13:12:14.476310 30266 raft_consensus.cc:493] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:14.476554 30266 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:14.482189 30266 raft_consensus.cc:515] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:14.483649 30266 leader_election.cc:290] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 3 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:14.484414 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:14.484669 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce45573deda84cebba1517b6017f0adb" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:14.485388 30341 raft_consensus.cc:3055] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:14.485476 30536 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:14.485653 30341 raft_consensus.cc:740] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:14.486275 30341 consensus_queue.cc:260] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:14.487088 30341 raft_consensus.cc:3060] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:14.490456 30536 raft_consensus.cc:2468] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 3.
I20260709 13:12:14.491503 30341 raft_consensus.cc:2468] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 3.
I20260709 13:12:14.491498 30233 leader_election.cc:304] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:14.492332 30577 raft_consensus.cc:2804] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:14.492703 30577 raft_consensus.cc:697] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:14.493310 30577 consensus_queue.cc:237] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:14.498790 30089 catalog_manager.cc:5697] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 2 to 3, leader changed from afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195) to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 3 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.528051 30581 raft_consensus.cc:993] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17: : Instructing follower 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:14.528427 30620 raft_consensus.cc:1081] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Signalling peer 5c0dfa0bd1a44137854ddecf0145b71d to start an election
I20260709 13:12:14.529717 30266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
 from {username='slave'} at 127.0.0.1:49988
I20260709 13:12:14.530105 30266 raft_consensus.cc:493] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:14.530351 30266 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:14.535002 30266 raft_consensus.cc:515] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:14.536523 30266 leader_election.cc:290] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 4 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195:46117)
I20260709 13:12:14.537201 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:14.537367 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab90f8e9d1141a3acbb54fc31e2e213" candidate_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
I20260709 13:12:14.537879 30536 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:14.537905 30341 raft_consensus.cc:3055] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:14.538465 30341 raft_consensus.cc:740] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:14.539201 30341 consensus_queue.cc:260] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:14.540333 30341 raft_consensus.cc:3060] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:14.544584 30536 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 4.
I20260709 13:12:14.545573 30233 leader_election.cc:304] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c0dfa0bd1a44137854ddecf0145b71d, 97ce280fdc1e413c915b4666c0ceb5a3; no voters: 
I20260709 13:12:14.546219 30577 raft_consensus.cc:2804] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:14.546644 30341 raft_consensus.cc:2468] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c0dfa0bd1a44137854ddecf0145b71d in term 4.
I20260709 13:12:14.546622 30577 raft_consensus.cc:697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 4 LEADER]: Becoming Leader. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:14.547861 30577 consensus_queue.cc:237] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:14.554175 30089 catalog_manager.cc:5697] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d reported cstate change: term changed from 3 to 4, leader changed from afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195) to 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194). New cstate: current_term: 4 leader_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.891036 30536 raft_consensus.cc:1275] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.892184 30577 consensus_queue.cc:1048] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.902014 30341 raft_consensus.cc:1275] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.903708 30577 consensus_queue.cc:1048] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:15.040074 30536 raft_consensus.cc:1275] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 4 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:15.041123 30634 consensus_queue.cc:1048] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:15.050089 30341 raft_consensus.cc:1275] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 4 FOLLOWER]: Refusing update from remote peer 5c0dfa0bd1a44137854ddecf0145b71d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:15.051405 30577 consensus_queue.cc:1048] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:15.325863 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:15.418238 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:15.426064 30266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
mode: GRACEFUL
new_leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:50008
I20260709 13:12:15.426512 30266 raft_consensus.cc:606] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Received request to transfer leadership to TS afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:15.428705 30266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a226958748884844a17465eba80f3043"
dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
mode: GRACEFUL
new_leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:50008
I20260709 13:12:15.429116 30266 raft_consensus.cc:606] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Received request to transfer leadership to TS afb83bfe01d641ab85d7f4c3fe3d3c17
I20260709 13:12:15.430025 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:15.430418 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:15.430881 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:15.788164 30634 raft_consensus.cc:993] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d: : Instructing follower afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:15.788657 30577 raft_consensus.cc:1081] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Signalling peer afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:15.789813 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:12:15.790225 30341 raft_consensus.cc:493] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.790511 30341 raft_consensus.cc:3060] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.795549 30341 raft_consensus.cc:515] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:15.797045 30341 leader_election.cc:290] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 2 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:15.797715 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:15.798161 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b29056ff5c849fe86832f7ec263e1fa" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:15.798285 30536 raft_consensus.cc:3060] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.798686 30266 raft_consensus.cc:3055] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.798983 30266 raft_consensus.cc:740] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:15.799762 30266 consensus_queue.cc:260] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:15.800678 30266 raft_consensus.cc:3060] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.802953 30536 raft_consensus.cc:2468] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 2.
I20260709 13:12:15.803937 30307 leader_election.cc:304] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:15.804536 30620 raft_consensus.cc:2804] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.805442 30620 raft_consensus.cc:697] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:15.806308 30266 raft_consensus.cc:2468] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 2.
I20260709 13:12:15.806413 30620 consensus_queue.cc:237] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:15.815507 30089 catalog_manager.cc:5697] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 1 to 2, leader changed from 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194) to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 2 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.927053 30634 raft_consensus.cc:993] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d: : Instructing follower afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:15.927498 30577 raft_consensus.cc:1081] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Signalling peer afb83bfe01d641ab85d7f4c3fe3d3c17 to start an election
I20260709 13:12:15.928715 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a226958748884844a17465eba80f3043"
dest_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:12:15.929100 30341 raft_consensus.cc:493] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.929308 30341 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.933462 30341 raft_consensus.cc:515] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:15.934698 30341 leader_election.cc:290] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Requested vote from peers 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835), 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573)
I20260709 13:12:15.935428 30536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "97ce280fdc1e413c915b4666c0ceb5a3"
I20260709 13:12:15.935714 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a226958748884844a17465eba80f3043" candidate_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5c0dfa0bd1a44137854ddecf0145b71d"
I20260709 13:12:15.936034 30536 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.936326 30266 raft_consensus.cc:3055] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:15.936610 30266 raft_consensus.cc:740] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c0dfa0bd1a44137854ddecf0145b71d, State: Running, Role: LEADER
I20260709 13:12:15.937252 30266 consensus_queue.cc:260] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:15.938138 30266 raft_consensus.cc:3060] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.940773 30536 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:15.941660 30307 leader_election.cc:304] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ce280fdc1e413c915b4666c0ceb5a3, afb83bfe01d641ab85d7f4c3fe3d3c17; no voters: 
I20260709 13:12:15.942399 30620 raft_consensus.cc:2804] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:15.942807 30620 raft_consensus.cc:697] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Becoming Leader. State: Replica: afb83bfe01d641ab85d7f4c3fe3d3c17, State: Running, Role: LEADER
I20260709 13:12:15.943485 30266 raft_consensus.cc:2468] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb83bfe01d641ab85d7f4c3fe3d3c17 in term 3.
I20260709 13:12:15.943581 30620 consensus_queue.cc:237] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } }
I20260709 13:12:15.950490 30089 catalog_manager.cc:5697] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 reported cstate change: term changed from 2 to 3, leader changed from 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194) to afb83bfe01d641ab85d7f4c3fe3d3c17 (127.21.67.195). New cstate: current_term: 3 leader_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb83bfe01d641ab85d7f4c3fe3d3c17" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 46117 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.187549 30266 raft_consensus.cc:1275] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.188766 30620 consensus_queue.cc:1048] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.202841 30536 raft_consensus.cc:1275] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.203975 30650 consensus_queue.cc:1048] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ce280fdc1e413c915b4666c0ceb5a3" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:16.326783 30138 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:16.436456 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:16.462883 21775 tablet_server.cc:179] TabletServer@127.21.67.193:46835 shutting down...
W20260709 13:12:16.466439 30307 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:12:16.470327 30307 consensus_peers.cc:597] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.477450 30266 raft_consensus.cc:1275] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Refusing update from remote peer afb83bfe01d641ab85d7f4c3fe3d3c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:16.479802 30650 consensus_queue.cc:1048] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c0dfa0bd1a44137854ddecf0145b71d" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.499573 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:16.501024 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.501641 21775 raft_consensus.cc:2243] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.502137 21775 raft_consensus.cc:2272] T ce45573deda84cebba1517b6017f0adb P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.504349 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.504892 21775 raft_consensus.cc:2243] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.505326 21775 raft_consensus.cc:2272] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.506937 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.507432 21775 raft_consensus.cc:2243] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.507892 21775 raft_consensus.cc:2272] T 710c86f75eb842a4a93d3308e33faf37 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.510030 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.510538 21775 raft_consensus.cc:2243] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.510891 21775 raft_consensus.cc:2272] T 6596bd77c3c04197a6df5f6236730f5f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.511476 30307 consensus_peers.cc:597] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.512569 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.513162 21775 raft_consensus.cc:2243] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.513546 21775 raft_consensus.cc:2272] T 64d29a8f233a44dca891c2fba97f473f P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.515194 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.515751 21775 raft_consensus.cc:2243] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.516113 21775 raft_consensus.cc:2272] T fa59dae0321d4c8ab8b726a3c33fb4db P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.517735 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.518209 21775 raft_consensus.cc:2243] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.518560 21775 raft_consensus.cc:2272] T 123b403c3039473cb295e8138de90ff9 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.520236 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.520716 21775 raft_consensus.cc:2243] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.521083 21775 raft_consensus.cc:2272] T a226958748884844a17465eba80f3043 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.522733 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.523200 21775 raft_consensus.cc:2243] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.523587 21775 raft_consensus.cc:2272] T 5b29056ff5c849fe86832f7ec263e1fa P 97ce280fdc1e413c915b4666c0ceb5a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.526268 21775 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:16.526750 21775 raft_consensus.cc:2243] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.527139 21775 raft_consensus.cc:2272] T e3d73d90a2f1478e91e89a4ca784ea17 P 97ce280fdc1e413c915b4666c0ceb5a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.554054 21775 tablet_server.cc:196] TabletServer@127.21.67.193:46835 shutdown complete.
I20260709 13:12:16.571408 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
I20260709 13:12:16.591917 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:16.592623 21775 tablet_replica.cc:333] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.593279 21775 raft_consensus.cc:2243] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.593703 21775 raft_consensus.cc:2272] T 710c86f75eb842a4a93d3308e33faf37 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.596081 21775 tablet_replica.cc:333] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.596869 21775 raft_consensus.cc:2243] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.597715 21775 raft_consensus.cc:2272] T 64d29a8f233a44dca891c2fba97f473f P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.600117 21775 tablet_replica.cc:333] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.600606 21775 raft_consensus.cc:2243] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.601298 21775 raft_consensus.cc:2272] T 5ab90f8e9d1141a3acbb54fc31e2e213 P 5c0dfa0bd1a44137854ddecf0145b71d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.603451 21775 tablet_replica.cc:333] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.603963 21775 raft_consensus.cc:2243] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.604342 21775 raft_consensus.cc:2272] T a226958748884844a17465eba80f3043 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.606755 21775 tablet_replica.cc:333] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.607215 21775 raft_consensus.cc:2243] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.607620 21775 raft_consensus.cc:2272] T 5b29056ff5c849fe86832f7ec263e1fa P 5c0dfa0bd1a44137854ddecf0145b71d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.610025 21775 tablet_replica.cc:333] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.610574 21775 raft_consensus.cc:2243] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.610952 21775 raft_consensus.cc:2272] T e3d73d90a2f1478e91e89a4ca784ea17 P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.612888 21775 tablet_replica.cc:333] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.613404 21775 raft_consensus.cc:2243] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.613807 21775 raft_consensus.cc:2272] T fa59dae0321d4c8ab8b726a3c33fb4db P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.615747 21775 tablet_replica.cc:333] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.616236 21775 raft_consensus.cc:2243] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.616645 21775 raft_consensus.cc:2272] T 123b403c3039473cb295e8138de90ff9 P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.618528 21775 tablet_replica.cc:333] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.618985 21775 raft_consensus.cc:2243] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.619746 21775 raft_consensus.cc:2272] T ce45573deda84cebba1517b6017f0adb P 5c0dfa0bd1a44137854ddecf0145b71d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.621621 21775 tablet_replica.cc:333] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d: stopping tablet replica
I20260709 13:12:16.622061 21775 raft_consensus.cc:2243] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.622761 21775 raft_consensus.cc:2272] T 6596bd77c3c04197a6df5f6236730f5f P 5c0dfa0bd1a44137854ddecf0145b71d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.637504 30304 connection.cc:573] client connection to 127.21.67.194:37573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:12:16.642285 30304 consensus_peers.cc:597] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573): Couldn't send request to peer 5c0dfa0bd1a44137854ddecf0145b71d. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:37573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.643427 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
I20260709 13:12:16.666369 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
W20260709 13:12:16.694015 30307 consensus_peers.cc:597] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 97ce280fdc1e413c915b4666c0ceb5a3 (127.21.67.193:46835): Couldn't send request to peer 97ce280fdc1e413c915b4666c0ceb5a3. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.695808 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:16.696449 21775 tablet_replica.cc:333] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.697121 21775 raft_consensus.cc:2243] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.697846 21775 raft_consensus.cc:2272] T 710c86f75eb842a4a93d3308e33faf37 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.700014 21775 tablet_replica.cc:333] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.700601 21775 raft_consensus.cc:2243] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.700989 21775 raft_consensus.cc:2272] T 5ab90f8e9d1141a3acbb54fc31e2e213 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.702955 21775 tablet_replica.cc:333] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.703469 21775 raft_consensus.cc:2243] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.703894 21775 raft_consensus.cc:2272] T 6596bd77c3c04197a6df5f6236730f5f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.705757 21775 tablet_replica.cc:333] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.706295 21775 raft_consensus.cc:2243] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.706676 21775 raft_consensus.cc:2272] T 64d29a8f233a44dca891c2fba97f473f P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.708684 21775 tablet_replica.cc:333] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.709211 21775 raft_consensus.cc:2243] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.709599 21775 raft_consensus.cc:2272] T ce45573deda84cebba1517b6017f0adb P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.711387 21775 tablet_replica.cc:333] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.711934 21775 raft_consensus.cc:2243] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.712669 21775 raft_consensus.cc:2272] T 5b29056ff5c849fe86832f7ec263e1fa P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.715415 21775 tablet_replica.cc:333] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.716295 21775 raft_consensus.cc:2243] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.717156 21775 raft_consensus.cc:2272] T a226958748884844a17465eba80f3043 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.719553 30304 consensus_peers.cc:597] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 -> Peer 5c0dfa0bd1a44137854ddecf0145b71d (127.21.67.194:37573): Couldn't send request to peer 5c0dfa0bd1a44137854ddecf0145b71d. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:37573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.720069 21775 tablet_replica.cc:333] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.720651 21775 raft_consensus.cc:2243] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.721333 21775 raft_consensus.cc:2272] T e3d73d90a2f1478e91e89a4ca784ea17 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.723130 21775 tablet_replica.cc:333] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.723614 21775 raft_consensus.cc:2243] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.724376 21775 raft_consensus.cc:2272] T fa59dae0321d4c8ab8b726a3c33fb4db P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.726334 21775 tablet_replica.cc:333] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17: stopping tablet replica
I20260709 13:12:16.726804 21775 raft_consensus.cc:2243] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.727594 21775 raft_consensus.cc:2272] T 123b403c3039473cb295e8138de90ff9 P afb83bfe01d641ab85d7f4c3fe3d3c17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.757421 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:12:16.778465 21775 master.cc:562] Master@127.21.67.254:36973 shutting down...
I20260709 13:12:16.797485 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.797992 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.798310 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P 24216bbb77524d1b91e0086b4cac0728: stopping tablet replica
I20260709 13:12:16.818285 21775 master.cc:584] Master@127.21.67.254:36973 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12689 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:12:16.861440 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:45779
I20260709 13:12:16.862526 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:16.867937 30661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:16.868028 30660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:16.868842 30663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:16.870312 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:16.871208 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:16.871397 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:16.871552 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602736871524 us; error 0 us; skew 500 ppm
I20260709 13:12:16.872174 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:16.874238 21775 webserver.cc:533] Webserver started at http://127.21.67.254:44689/ using document root <none> and password file <none>
I20260709 13:12:16.874719 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:16.874930 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:16.875200 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:16.876269 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "5495c7edc67d4f9f99a4aed5b2fdb771"
format_stamp: "Formatted at 2026-07-09 13:12:16 on dist-test-slave-zkvt"
I20260709 13:12:16.880393 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:12:16.883428 30668 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:16.884116 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:16.884393 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "5495c7edc67d4f9f99a4aed5b2fdb771"
format_stamp: "Formatted at 2026-07-09 13:12:16 on dist-test-slave-zkvt"
I20260709 13:12:16.884657 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:16.908370 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:16.909416 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:16.947484 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:45779
I20260709 13:12:16.947584 30719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:45779 every 8 connection(s)
I20260709 13:12:16.951130 30720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:16.961568 30720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771: Bootstrap starting.
I20260709 13:12:16.966219 30720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.970229 30720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771: No bootstrap required, opened a new log
I20260709 13:12:16.972256 30720 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" member_type: VOTER }
I20260709 13:12:16.972630 30720 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.972862 30720 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495c7edc67d4f9f99a4aed5b2fdb771, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.973481 30720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" member_type: VOTER }
I20260709 13:12:16.973938 30720 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:16.974157 30720 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:16.974421 30720 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.978605 30720 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" member_type: VOTER }
I20260709 13:12:16.979089 30720 leader_election.cc:304] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5495c7edc67d4f9f99a4aed5b2fdb771; no voters: 
I20260709 13:12:16.980150 30720 leader_election.cc:290] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:16.980448 30723 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.981732 30723 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 1 LEADER]: Becoming Leader. State: Replica: 5495c7edc67d4f9f99a4aed5b2fdb771, State: Running, Role: LEADER
I20260709 13:12:16.982376 30723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" member_type: VOTER }
I20260709 13:12:16.983007 30720 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:16.987617 30725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5495c7edc67d4f9f99a4aed5b2fdb771. Latest consensus state: current_term: 1 leader_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" member_type: VOTER } }
I20260709 13:12:16.988602 30725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:16.988585 30724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5495c7edc67d4f9f99a4aed5b2fdb771" member_type: VOTER } }
I20260709 13:12:16.989248 30724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:16.990729 30731 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:16.996573 30731 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:16.997828 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:17.004318 30731 catalog_manager.cc:1383] Generated new cluster ID: 94539abaf8044b1194f5d41afcdc2e6d
I20260709 13:12:17.004582 30731 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:17.035367 30731 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:17.036635 30731 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:17.050836 30731 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771: Generated new TSK 0
I20260709 13:12:17.051397 30731 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:17.063750 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:17.069169 30741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:17.070320 30742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:17.072033 21775 server_base.cc:1061] running on GCE node
W20260709 13:12:17.072432 30744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:17.073410 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:17.073612 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:17.073776 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602737073757 us; error 0 us; skew 500 ppm
I20260709 13:12:17.074287 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:17.076479 21775 webserver.cc:533] Webserver started at http://127.21.67.193:45079/ using document root <none> and password file <none>
I20260709 13:12:17.076933 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:17.077118 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:17.077389 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:17.078383 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
format_stamp: "Formatted at 2026-07-09 13:12:17 on dist-test-slave-zkvt"
I20260709 13:12:17.082472 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:17.085597 30749 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.086454 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:17.086679 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
format_stamp: "Formatted at 2026-07-09 13:12:17 on dist-test-slave-zkvt"
I20260709 13:12:17.086935 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:17.097232 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:17.098554 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:17.099962 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:17.101975 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:17.102187 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.102423 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:17.102578 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.142329 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:46015
I20260709 13:12:17.142426 30811 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:46015 every 8 connection(s)
I20260709 13:12:17.147455 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:17.154425 30816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:17.155145 30817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:17.158834 30819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:17.159006 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:17.160066 30812 heartbeater.cc:344] Connected to a master server at 127.21.67.254:45779
I20260709 13:12:17.160254 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:17.160497 30812 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:17.160553 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:17.160849 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602737160830 us; error 0 us; skew 500 ppm
I20260709 13:12:17.161410 30812 heartbeater.cc:507] Master 127.21.67.254:45779 requested a full tablet report, sending...
I20260709 13:12:17.161641 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:17.163939 30685 ts_manager.cc:194] Registered new tserver with Master: f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015)
I20260709 13:12:17.164713 21775 webserver.cc:533] Webserver started at http://127.21.67.194:43475/ using document root <none> and password file <none>
I20260709 13:12:17.165208 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:17.165407 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:17.165658 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:17.165910 30685 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42422
I20260709 13:12:17.166762 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "7def4b0a5b764aad84d0bcf265d034f8"
format_stamp: "Formatted at 2026-07-09 13:12:17 on dist-test-slave-zkvt"
I20260709 13:12:17.171439 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:17.174466 30824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.175125 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:17.175405 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "7def4b0a5b764aad84d0bcf265d034f8"
format_stamp: "Formatted at 2026-07-09 13:12:17 on dist-test-slave-zkvt"
I20260709 13:12:17.175655 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:17.189415 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:17.190521 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:17.191912 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:17.194401 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:17.194685 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.194954 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:17.195166 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.233932 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:43985
I20260709 13:12:17.234032 30886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:43985 every 8 connection(s)
I20260709 13:12:17.238561 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:17.245239 30890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:17.246023 30891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:17.248652 21775 server_base.cc:1061] running on GCE node
W20260709 13:12:17.249173 30893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:17.249701 30887 heartbeater.cc:344] Connected to a master server at 127.21.67.254:45779
I20260709 13:12:17.250154 30887 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:17.250406 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:17.250728 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:17.250909 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602737250891 us; error 0 us; skew 500 ppm
I20260709 13:12:17.250954 30887 heartbeater.cc:507] Master 127.21.67.254:45779 requested a full tablet report, sending...
I20260709 13:12:17.251533 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:17.253218 30685 ts_manager.cc:194] Registered new tserver with Master: 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985)
I20260709 13:12:17.253974 21775 webserver.cc:533] Webserver started at http://127.21.67.195:39519/ using document root <none> and password file <none>
I20260709 13:12:17.254510 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:17.254707 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:17.254738 30685 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42434
I20260709 13:12:17.255044 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:17.256456 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "6ab3967809fb4bc88c1313a565d4603a"
format_stamp: "Formatted at 2026-07-09 13:12:17 on dist-test-slave-zkvt"
I20260709 13:12:17.260613 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:17.263633 30898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.264413 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:17.264698 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "6ab3967809fb4bc88c1313a565d4603a"
format_stamp: "Formatted at 2026-07-09 13:12:17 on dist-test-slave-zkvt"
I20260709 13:12:17.264969 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:17.276948 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:17.278055 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:17.279390 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:17.281548 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:17.281765 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.281988 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:17.282161 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:17.321511 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:42323
I20260709 13:12:17.321614 30960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:42323 every 8 connection(s)
I20260709 13:12:17.334646 30961 heartbeater.cc:344] Connected to a master server at 127.21.67.254:45779
I20260709 13:12:17.335103 30961 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:17.335927 30961 heartbeater.cc:507] Master 127.21.67.254:45779 requested a full tablet report, sending...
I20260709 13:12:17.337836 30685 ts_manager.cc:194] Registered new tserver with Master: 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:17.337926 21775 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013390568s
I20260709 13:12:17.339175 30685 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42438
I20260709 13:12:17.361580 30685 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42446:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:17.363631 30685 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:17.411484 30852 tablet_service.cc:1511] Processing CreateTablet for tablet d476f8b7e0c943f18a0c55a3490fe135 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=03ccac2beb394fa9819198811a85f631]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:17.412928 30852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d476f8b7e0c943f18a0c55a3490fe135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.414767 30776 tablet_service.cc:1511] Processing CreateTablet for tablet df9d28fd9c5e44c1aa9b8098f5a3d116 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=03ccac2beb394fa9819198811a85f631]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:17.415781 30776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9d28fd9c5e44c1aa9b8098f5a3d116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.418113 30851 tablet_service.cc:1511] Processing CreateTablet for tablet df9d28fd9c5e44c1aa9b8098f5a3d116 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=03ccac2beb394fa9819198811a85f631]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:17.418282 30777 tablet_service.cc:1511] Processing CreateTablet for tablet d476f8b7e0c943f18a0c55a3490fe135 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=03ccac2beb394fa9819198811a85f631]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:17.419396 30851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9d28fd9c5e44c1aa9b8098f5a3d116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.419569 30777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d476f8b7e0c943f18a0c55a3490fe135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.425927 30926 tablet_service.cc:1511] Processing CreateTablet for tablet d476f8b7e0c943f18a0c55a3490fe135 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=03ccac2beb394fa9819198811a85f631]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:17.427080 30926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d476f8b7e0c943f18a0c55a3490fe135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.427618 30925 tablet_service.cc:1511] Processing CreateTablet for tablet df9d28fd9c5e44c1aa9b8098f5a3d116 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=03ccac2beb394fa9819198811a85f631]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:17.428889 30925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9d28fd9c5e44c1aa9b8098f5a3d116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.448076 30977 tablet_bootstrap.cc:492] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e: Bootstrap starting.
I20260709 13:12:17.455286 30977 tablet_bootstrap.cc:654] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.456571 30976 tablet_bootstrap.cc:492] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8: Bootstrap starting.
I20260709 13:12:17.464321 30978 tablet_bootstrap.cc:492] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a: Bootstrap starting.
I20260709 13:12:17.465623 30977 tablet_bootstrap.cc:492] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e: No bootstrap required, opened a new log
I20260709 13:12:17.466176 30977 ts_tablet_manager.cc:1403] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:12:17.466346 30976 tablet_bootstrap.cc:654] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.469579 30977 raft_consensus.cc:359] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.470408 30977 raft_consensus.cc:385] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.470454 30978 tablet_bootstrap.cc:654] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.470716 30977 raft_consensus.cc:740] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.471632 30977 consensus_queue.cc:260] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.472162 30976 tablet_bootstrap.cc:492] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8: No bootstrap required, opened a new log
I20260709 13:12:17.472626 30976 ts_tablet_manager.cc:1403] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:12:17.473924 30812 heartbeater.cc:499] Master 127.21.67.254:45779 was elected leader, sending a full tablet report...
I20260709 13:12:17.474339 30977 ts_tablet_manager.cc:1434] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:12:17.475415 30977 tablet_bootstrap.cc:492] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e: Bootstrap starting.
I20260709 13:12:17.476363 30978 tablet_bootstrap.cc:492] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a: No bootstrap required, opened a new log
I20260709 13:12:17.475988 30976 raft_consensus.cc:359] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.476835 30978 ts_tablet_manager.cc:1403] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.006s
I20260709 13:12:17.476845 30976 raft_consensus.cc:385] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.477512 30976 raft_consensus.cc:740] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.479089 30976 consensus_queue.cc:260] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.480170 30978 raft_consensus.cc:359] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.480954 30978 raft_consensus.cc:385] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.481244 30978 raft_consensus.cc:740] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab3967809fb4bc88c1313a565d4603a, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.482064 30978 consensus_queue.cc:260] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.485015 30977 tablet_bootstrap.cc:654] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.488754 30978 ts_tablet_manager.cc:1434] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:12:17.489804 30978 tablet_bootstrap.cc:492] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a: Bootstrap starting.
I20260709 13:12:17.490132 30961 heartbeater.cc:499] Master 127.21.67.254:45779 was elected leader, sending a full tablet report...
I20260709 13:12:17.490307 30976 ts_tablet_manager.cc:1434] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:12:17.491189 30887 heartbeater.cc:499] Master 127.21.67.254:45779 was elected leader, sending a full tablet report...
I20260709 13:12:17.491483 30976 tablet_bootstrap.cc:492] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8: Bootstrap starting.
I20260709 13:12:17.495569 30978 tablet_bootstrap.cc:654] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.499635 30977 tablet_bootstrap.cc:492] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e: No bootstrap required, opened a new log
I20260709 13:12:17.500202 30977 ts_tablet_manager.cc:1403] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 13:12:17.503099 30977 raft_consensus.cc:359] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.503852 30977 raft_consensus.cc:385] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.504202 30977 raft_consensus.cc:740] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.505066 30977 consensus_queue.cc:260] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.507269 30976 tablet_bootstrap.cc:654] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.509980 30977 ts_tablet_manager.cc:1434] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:12:17.513423 30978 tablet_bootstrap.cc:492] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a: No bootstrap required, opened a new log
I20260709 13:12:17.513955 30978 ts_tablet_manager.cc:1403] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.012s
I20260709 13:12:17.515272 30983 raft_consensus.cc:493] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.515810 30983 raft_consensus.cc:515] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.516870 30984 raft_consensus.cc:493] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.517352 30984 raft_consensus.cc:515] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.518523 30983 leader_election.cc:290] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:17.521055 30978 raft_consensus.cc:359] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.521819 30978 raft_consensus.cc:385] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.521863 30976 tablet_bootstrap.cc:492] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8: No bootstrap required, opened a new log
I20260709 13:12:17.522212 30978 raft_consensus.cc:740] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab3967809fb4bc88c1313a565d4603a, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.522578 30976 ts_tablet_manager.cc:1403] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.009s
I20260709 13:12:17.523075 30978 consensus_queue.cc:260] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.526191 30984 leader_election.cc:290] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985), f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015)
I20260709 13:12:17.526448 30976 raft_consensus.cc:359] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.527242 30976 raft_consensus.cc:385] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.527604 30976 raft_consensus.cc:740] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.528600 30976 consensus_queue.cc:260] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.530994 30976 ts_tablet_manager.cc:1434] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:17.539793 30978 ts_tablet_manager.cc:1434] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.014s
I20260709 13:12:17.544591 30981 raft_consensus.cc:493] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.544821 30787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" is_pre_election: true
I20260709 13:12:17.545080 30981 raft_consensus.cc:515] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.545478 30787 raft_consensus.cc:2468] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 0.
I20260709 13:12:17.546774 30827 leader_election.cc:304] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7def4b0a5b764aad84d0bcf265d034f8, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:17.547833 30983 raft_consensus.cc:2804] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.548009 30981 leader_election.cc:290] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:17.548193 30983 raft_consensus.cc:493] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.550486 30983 raft_consensus.cc:3060] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.565701 30983 raft_consensus.cc:515] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.568542 30983 leader_election.cc:290] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 election: Requested vote from peers f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:17.568677 30787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
I20260709 13:12:17.568832 30862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8" is_pre_election: true
I20260709 13:12:17.569274 30787 raft_consensus.cc:3060] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.569564 30862 raft_consensus.cc:2468] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 0.
I20260709 13:12:17.573410 30753 leader_election.cc:304] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7def4b0a5b764aad84d0bcf265d034f8, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:17.578547 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
I20260709 13:12:17.578621 30936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a" is_pre_election: true
I20260709 13:12:17.579255 30935 raft_consensus.cc:3060] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.579592 30787 raft_consensus.cc:2468] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 1.
I20260709 13:12:17.580792 30827 leader_election.cc:304] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7def4b0a5b764aad84d0bcf265d034f8, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:17.581843 30981 raft_consensus.cc:2804] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.582243 30981 raft_consensus.cc:493] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.582571 30981 raft_consensus.cc:3060] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.582545 30786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "6ab3967809fb4bc88c1313a565d4603a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" is_pre_election: true
I20260709 13:12:17.583550 30786 raft_consensus.cc:2393] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ab3967809fb4bc88c1313a565d4603a in current term 1: Already voted for candidate 7def4b0a5b764aad84d0bcf265d034f8 in this term.
I20260709 13:12:17.583813 30936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a" is_pre_election: true
I20260709 13:12:17.584551 30936 raft_consensus.cc:2468] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 0.
I20260709 13:12:17.585469 30983 raft_consensus.cc:2804] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.587324 30935 raft_consensus.cc:2468] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 1.
I20260709 13:12:17.589190 30862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "6ab3967809fb4bc88c1313a565d4603a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8" is_pre_election: true
I20260709 13:12:17.591030 30981 raft_consensus.cc:515] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.592039 30983 raft_consensus.cc:697] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Becoming Leader. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Running, Role: LEADER
I20260709 13:12:17.592950 30983 consensus_queue.cc:237] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.593443 30981 leader_election.cc:290] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 election: Requested vote from peers 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:17.594004 30861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
I20260709 13:12:17.594521 30861 raft_consensus.cc:3060] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.599471 30861 raft_consensus.cc:2468] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 1.
I20260709 13:12:17.600245 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
I20260709 13:12:17.600867 30935 raft_consensus.cc:3060] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.601169 30753 leader_election.cc:304] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7def4b0a5b764aad84d0bcf265d034f8, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:17.602211 30981 raft_consensus.cc:2804] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.607728 30935 raft_consensus.cc:2468] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 1.
I20260709 13:12:17.609715 30683 catalog_manager.cc:5697] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "7def4b0a5b764aad84d0bcf265d034f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.610941 30981 raft_consensus.cc:697] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 LEADER]: Becoming Leader. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Running, Role: LEADER
I20260709 13:12:17.610397 30902 leader_election.cc:304] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a; no voters: 7def4b0a5b764aad84d0bcf265d034f8, f6d6fdd02e74424cb87ac73c0a19483e
I20260709 13:12:17.611931 30981 consensus_queue.cc:237] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.612428 30990 raft_consensus.cc:2749] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:17.619833 30684 catalog_manager.cc:5697] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193). New cstate: current_term: 1 leader_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.681553 30684 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42456:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:17.683311 30684 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:17.744804 30776 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba313e1181046b69af3e0afc450ca71 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8b59690d4c834913ba448fe684a53979]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:17.746752 30851 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba313e1181046b69af3e0afc450ca71 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8b59690d4c834913ba448fe684a53979]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:17.748232 30776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba313e1181046b69af3e0afc450ca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.749675 30777 tablet_service.cc:1511] Processing CreateTablet for tablet 69cf07feee1b4cf18b25c5b82c4d2ae3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8b59690d4c834913ba448fe684a53979]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:17.750015 30926 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba313e1181046b69af3e0afc450ca71 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8b59690d4c834913ba448fe684a53979]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:17.751163 30777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69cf07feee1b4cf18b25c5b82c4d2ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.751581 30926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba313e1181046b69af3e0afc450ca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.755697 30925 tablet_service.cc:1511] Processing CreateTablet for tablet 69cf07feee1b4cf18b25c5b82c4d2ae3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8b59690d4c834913ba448fe684a53979]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:17.757015 30925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69cf07feee1b4cf18b25c5b82c4d2ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.757526 30852 tablet_service.cc:1511] Processing CreateTablet for tablet 69cf07feee1b4cf18b25c5b82c4d2ae3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8b59690d4c834913ba448fe684a53979]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:17.759321 30851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba313e1181046b69af3e0afc450ca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.763337 30852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69cf07feee1b4cf18b25c5b82c4d2ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.775940 30978 tablet_bootstrap.cc:492] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a: Bootstrap starting.
I20260709 13:12:17.775940 30977 tablet_bootstrap.cc:492] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e: Bootstrap starting.
I20260709 13:12:17.784269 30977 tablet_bootstrap.cc:654] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.785946 30978 tablet_bootstrap.cc:654] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.796322 30976 tablet_bootstrap.cc:492] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8: Bootstrap starting.
I20260709 13:12:17.798434 30977 tablet_bootstrap.cc:492] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e: No bootstrap required, opened a new log
I20260709 13:12:17.798992 30977 ts_tablet_manager.cc:1403] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.011s
I20260709 13:12:17.799960 30978 tablet_bootstrap.cc:492] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a: No bootstrap required, opened a new log
I20260709 13:12:17.800454 30978 ts_tablet_manager.cc:1403] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.010s
I20260709 13:12:17.802930 30977 raft_consensus.cc:359] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.803833 30978 raft_consensus.cc:359] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.804211 30977 raft_consensus.cc:385] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.804625 30978 raft_consensus.cc:385] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.804740 30977 raft_consensus.cc:740] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.805104 30978 raft_consensus.cc:740] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab3967809fb4bc88c1313a565d4603a, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.806110 30976 tablet_bootstrap.cc:654] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.805756 30977 consensus_queue.cc:260] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.806309 30978 consensus_queue.cc:260] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.810277 30978 ts_tablet_manager.cc:1434] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:12:17.811990 30978 tablet_bootstrap.cc:492] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a: Bootstrap starting.
I20260709 13:12:17.813659 30976 tablet_bootstrap.cc:492] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8: No bootstrap required, opened a new log
I20260709 13:12:17.809733 30977 ts_tablet_manager.cc:1434] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 13:12:17.814205 30976 ts_tablet_manager.cc:1403] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:12:17.815954 30977 tablet_bootstrap.cc:492] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e: Bootstrap starting.
I20260709 13:12:17.816102 30981 raft_consensus.cc:493] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.816697 30981 raft_consensus.cc:515] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.819199 30981 leader_election.cc:290] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:17.820456 30978 tablet_bootstrap.cc:654] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.822337 30862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba313e1181046b69af3e0afc450ca71" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8" is_pre_election: true
I20260709 13:12:17.822372 30976 raft_consensus.cc:359] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.823319 30976 raft_consensus.cc:385] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.823626 30976 raft_consensus.cc:740] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.823869 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba313e1181046b69af3e0afc450ca71" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a" is_pre_election: true
I20260709 13:12:17.824550 30935 raft_consensus.cc:2468] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 0.
I20260709 13:12:17.824558 30976 consensus_queue.cc:260] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.825987 30977 tablet_bootstrap.cc:654] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.826293 30862 raft_consensus.cc:2468] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 0.
I20260709 13:12:17.828310 30753 leader_election.cc:304] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:17.829339 30981 raft_consensus.cc:2804] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.829703 30981 raft_consensus.cc:493] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.830025 30981 raft_consensus.cc:3060] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.838274 30976 ts_tablet_manager.cc:1434] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent starting tablet: real 0.023s	user 0.000s	sys 0.007s
I20260709 13:12:17.842119 30976 tablet_bootstrap.cc:492] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: Bootstrap starting.
I20260709 13:12:17.850862 30978 tablet_bootstrap.cc:492] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a: No bootstrap required, opened a new log
I20260709 13:12:17.851455 30978 ts_tablet_manager.cc:1403] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.012s
I20260709 13:12:17.851486 30976 tablet_bootstrap.cc:654] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.854883 30977 tablet_bootstrap.cc:492] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e: No bootstrap required, opened a new log
I20260709 13:12:17.855481 30977 ts_tablet_manager.cc:1403] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.022s
I20260709 13:12:17.854990 30978 raft_consensus.cc:359] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.859018 30978 raft_consensus.cc:385] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.859391 30978 raft_consensus.cc:740] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab3967809fb4bc88c1313a565d4603a, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.859717 30977 raft_consensus.cc:359] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.860850 30977 raft_consensus.cc:385] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.860415 30978 consensus_queue.cc:260] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.861292 30977 raft_consensus.cc:740] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.862567 30977 consensus_queue.cc:260] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.863701 30978 ts_tablet_manager.cc:1434] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:12:17.865804 30977 ts_tablet_manager.cc:1434] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:12:17.871869 30981 raft_consensus.cc:515] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.874469 30981 leader_election.cc:290] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 election: Requested vote from peers 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:17.876111 30862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba313e1181046b69af3e0afc450ca71" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
I20260709 13:12:17.876771 30862 raft_consensus.cc:3060] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.876938 30976 tablet_bootstrap.cc:492] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: No bootstrap required, opened a new log
I20260709 13:12:17.877846 30976 ts_tablet_manager.cc:1403] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.012s
I20260709 13:12:17.876775 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba313e1181046b69af3e0afc450ca71" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
I20260709 13:12:17.878937 30935 raft_consensus.cc:3060] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.880626 30976 raft_consensus.cc:359] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.881271 30976 raft_consensus.cc:385] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.881510 30976 raft_consensus.cc:740] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.882422 30976 consensus_queue.cc:260] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.884779 30976 ts_tablet_manager.cc:1434] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:17.888717 30862 raft_consensus.cc:2468] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 1.
I20260709 13:12:17.889772 30753 leader_election.cc:304] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7def4b0a5b764aad84d0bcf265d034f8, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:17.890745 30981 raft_consensus.cc:2804] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.891229 30981 raft_consensus.cc:697] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 LEADER]: Becoming Leader. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Running, Role: LEADER
I20260709 13:12:17.892079 30981 consensus_queue.cc:237] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:17.892323 30935 raft_consensus.cc:2468] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 1.
I20260709 13:12:17.900194 30685 catalog_manager.cc:5697] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193). New cstate: current_term: 1 leader_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.984598 30983 consensus_queue.cc:1048] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:17.995025 30733 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:18.000169 30983 consensus_queue.cc:1048] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:18.051584 30983 raft_consensus.cc:493] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.052124 30983 raft_consensus.cc:515] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.054145 30983 leader_election.cc:290] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:18.055096 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a" is_pre_election: true
I20260709 13:12:18.055126 30786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" is_pre_election: true
I20260709 13:12:18.055757 30935 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 0.
I20260709 13:12:18.055872 30786 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 0.
I20260709 13:12:18.056926 30828 leader_election.cc:304] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a, 7def4b0a5b764aad84d0bcf265d034f8; no voters: 
I20260709 13:12:18.057988 30983 raft_consensus.cc:2804] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:18.058308 30983 raft_consensus.cc:493] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.058642 30983 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.064843 30983 raft_consensus.cc:515] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.066376 30983 leader_election.cc:290] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 election: Requested vote from peers f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:18.067013 30786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
I20260709 13:12:18.067375 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
I20260709 13:12:18.067754 30786 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.068043 30935 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.073076 30935 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 1.
I20260709 13:12:18.073375 30786 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 1.
I20260709 13:12:18.074172 30828 leader_election.cc:304] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a, 7def4b0a5b764aad84d0bcf265d034f8; no voters: 
I20260709 13:12:18.074935 30983 raft_consensus.cc:2804] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:18.075320 30983 raft_consensus.cc:697] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Becoming Leader. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Running, Role: LEADER
I20260709 13:12:18.076004 30983 consensus_queue.cc:237] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.083348 30683 catalog_manager.cc:5697] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "7def4b0a5b764aad84d0bcf265d034f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.145982 30862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135"
dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
mode: GRACEFUL
new_leader_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
 from {username='slave'} at 127.0.0.1:55902
I20260709 13:12:18.146575 30862 raft_consensus.cc:606] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Received request to transfer leadership to TS f6d6fdd02e74424cb87ac73c0a19483e
I20260709 13:12:18.156656 30981 consensus_queue.cc:1048] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:18.160156 30786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116"
dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
mode: GRACEFUL
new_leader_uuid: "6ab3967809fb4bc88c1313a565d4603a"
 from {username='slave'} at 127.0.0.1:50122
I20260709 13:12:18.160635 30786 raft_consensus.cc:606] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 LEADER]: Received request to transfer leadership to TS 6ab3967809fb4bc88c1313a565d4603a
I20260709 13:12:18.171602 30862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3"
dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
mode: GRACEFUL
new_leader_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
 from {username='slave'} at 127.0.0.1:55902
I20260709 13:12:18.171768 30996 consensus_queue.cc:1048] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:18.172307 30862 raft_consensus.cc:606] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Received request to transfer leadership to TS f6d6fdd02e74424cb87ac73c0a19483e
I20260709 13:12:18.183274 30996 raft_consensus.cc:993] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e: : Instructing follower 6ab3967809fb4bc88c1313a565d4603a to start an election
I20260709 13:12:18.183832 30996 raft_consensus.cc:1081] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 LEADER]: Signalling peer 6ab3967809fb4bc88c1313a565d4603a to start an election
I20260709 13:12:18.187202 30935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116"
dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
 from {username='slave'} at 127.0.0.1:40938
I20260709 13:12:18.187842 30935 raft_consensus.cc:493] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.188206 30935 raft_consensus.cc:3060] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.195099 30935 raft_consensus.cc:515] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.197165 30935 leader_election.cc:290] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [CANDIDATE]: Term 2 election: Requested vote from peers f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015), 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985)
I20260709 13:12:18.197938 30786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116" candidate_uuid: "6ab3967809fb4bc88c1313a565d4603a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
I20260709 13:12:18.198586 30786 raft_consensus.cc:3055] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:18.198926 30786 raft_consensus.cc:740] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Running, Role: LEADER
I20260709 13:12:18.200139 30862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9d28fd9c5e44c1aa9b8098f5a3d116" candidate_uuid: "6ab3967809fb4bc88c1313a565d4603a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
I20260709 13:12:18.200780 30862 raft_consensus.cc:3060] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.200469 30786 consensus_queue.cc:260] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.201936 30786 raft_consensus.cc:3060] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.208196 30862 raft_consensus.cc:2468] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab3967809fb4bc88c1313a565d4603a in term 2.
I20260709 13:12:18.208851 30786 raft_consensus.cc:2468] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab3967809fb4bc88c1313a565d4603a in term 2.
I20260709 13:12:18.209607 30902 leader_election.cc:304] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a, 7def4b0a5b764aad84d0bcf265d034f8; no voters: 
I20260709 13:12:18.210552 31023 raft_consensus.cc:2804] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.211009 31023 raft_consensus.cc:697] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 2 LEADER]: Becoming Leader. State: Replica: 6ab3967809fb4bc88c1313a565d4603a, State: Running, Role: LEADER
I20260709 13:12:18.212059 31023 consensus_queue.cc:237] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.218119 30681 catalog_manager.cc:5697] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a reported cstate change: term changed from 1 to 2, leader changed from f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193) to 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195). New cstate: current_term: 2 leader_uuid: "6ab3967809fb4bc88c1313a565d4603a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.388247 31021 consensus_queue.cc:1048] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:18.398392 30996 consensus_queue.cc:1048] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:18.473222 30983 consensus_queue.cc:1048] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:18.483712 30994 consensus_queue.cc:1048] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:18.491490 30983 raft_consensus.cc:993] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: : Instructing follower f6d6fdd02e74424cb87ac73c0a19483e to start an election
I20260709 13:12:18.491963 31027 raft_consensus.cc:1081] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Signalling peer f6d6fdd02e74424cb87ac73c0a19483e to start an election
I20260709 13:12:18.493639 30786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3"
dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
 from {username='slave'} at 127.0.0.1:50100
I20260709 13:12:18.494196 30786 raft_consensus.cc:493] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.494609 30786 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.499408 30786 raft_consensus.cc:515] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.501264 30786 leader_election.cc:290] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 2 election: Requested vote from peers 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:18.502053 30862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
I20260709 13:12:18.502503 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
I20260709 13:12:18.502653 30862 raft_consensus.cc:3055] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:18.503070 30935 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.503118 30862 raft_consensus.cc:740] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Running, Role: LEADER
I20260709 13:12:18.504112 30862 consensus_queue.cc:260] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.505205 30862 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.509521 30935 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 2.
I20260709 13:12:18.510377 30862 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 2.
I20260709 13:12:18.510495 30753 leader_election.cc:304] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:18.511343 30996 raft_consensus.cc:2804] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.511804 30996 raft_consensus.cc:697] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 LEADER]: Becoming Leader. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Running, Role: LEADER
I20260709 13:12:18.512405 30996 consensus_queue.cc:237] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.517665 30683 catalog_manager.cc:5697] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e reported cstate change: term changed from 1 to 2, leader changed from 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194) to f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193). New cstate: current_term: 2 leader_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.590741 30994 raft_consensus.cc:993] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8: : Instructing follower f6d6fdd02e74424cb87ac73c0a19483e to start an election
I20260709 13:12:18.591362 31027 raft_consensus.cc:1081] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Signalling peer f6d6fdd02e74424cb87ac73c0a19483e to start an election
I20260709 13:12:18.593019 30786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135"
dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
 from {username='slave'} at 127.0.0.1:50100
I20260709 13:12:18.593633 30786 raft_consensus.cc:493] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.594048 30786 raft_consensus.cc:3060] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.598997 30786 raft_consensus.cc:515] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.600589 30786 leader_election.cc:290] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 2 election: Requested vote from peers 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:18.601331 30862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
I20260709 13:12:18.601646 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d476f8b7e0c943f18a0c55a3490fe135" candidate_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
I20260709 13:12:18.601891 30862 raft_consensus.cc:3055] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:18.602344 30862 raft_consensus.cc:740] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Running, Role: LEADER
I20260709 13:12:18.602383 30935 raft_consensus.cc:3060] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.603091 30862 consensus_queue.cc:260] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.604045 30862 raft_consensus.cc:3060] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.607635 30935 raft_consensus.cc:2468] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 2.
I20260709 13:12:18.608721 30753 leader_election.cc:304] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a, f6d6fdd02e74424cb87ac73c0a19483e; no voters: 
I20260709 13:12:18.608850 30862 raft_consensus.cc:2468] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d6fdd02e74424cb87ac73c0a19483e in term 2.
I20260709 13:12:18.609455 30996 raft_consensus.cc:2804] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.609933 30996 raft_consensus.cc:697] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 LEADER]: Becoming Leader. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Running, Role: LEADER
I20260709 13:12:18.610756 30996 consensus_queue.cc:237] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:18.616729 30683 catalog_manager.cc:5697] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e reported cstate change: term changed from 1 to 2, leader changed from 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194) to f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193). New cstate: current_term: 2 leader_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.640057 30862 raft_consensus.cc:1275] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Refusing update from remote peer 6ab3967809fb4bc88c1313a565d4603a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.641108 31023 consensus_queue.cc:1048] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.648734 30786 raft_consensus.cc:1275] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Refusing update from remote peer 6ab3967809fb4bc88c1313a565d4603a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.651074 31029 consensus_queue.cc:1048] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.872594 21775 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:12:18.874019 21775 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:12:18.874397 21775 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:12:18.887871 30786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3"
dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
mode: GRACEFUL
new_leader_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
 from {username='slave'} at 127.0.0.1:50126
I20260709 13:12:18.888352 30786 raft_consensus.cc:606] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 LEADER]: Received request to transfer leadership to TS 7def4b0a5b764aad84d0bcf265d034f8
I20260709 13:12:18.889329 21775 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:12:19.031642 30935 raft_consensus.cc:1275] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Refusing update from remote peer f6d6fdd02e74424cb87ac73c0a19483e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.032752 30996 consensus_queue.cc:1048] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.039696 30862 raft_consensus.cc:1275] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Refusing update from remote peer f6d6fdd02e74424cb87ac73c0a19483e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.041568 31021 consensus_queue.cc:1048] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.047119 30981 raft_consensus.cc:993] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e: : Instructing follower 7def4b0a5b764aad84d0bcf265d034f8 to start an election
I20260709 13:12:19.047528 31021 raft_consensus.cc:1081] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 LEADER]: Signalling peer 7def4b0a5b764aad84d0bcf265d034f8 to start an election
I20260709 13:12:19.048967 30862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3"
dest_uuid: "7def4b0a5b764aad84d0bcf265d034f8"
 from {username='slave'} at 127.0.0.1:55892
I20260709 13:12:19.049378 30862 raft_consensus.cc:493] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.049666 30862 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.055012 30862 raft_consensus.cc:515] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:19.057205 30862 leader_election.cc:290] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 3 election: Requested vote from peers f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015), 6ab3967809fb4bc88c1313a565d4603a (127.21.67.195:42323)
I20260709 13:12:19.057394 30786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6d6fdd02e74424cb87ac73c0a19483e"
I20260709 13:12:19.058106 30786 raft_consensus.cc:3055] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:19.058403 30786 raft_consensus.cc:740] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6d6fdd02e74424cb87ac73c0a19483e, State: Running, Role: LEADER
I20260709 13:12:19.058485 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69cf07feee1b4cf18b25c5b82c4d2ae3" candidate_uuid: "7def4b0a5b764aad84d0bcf265d034f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ab3967809fb4bc88c1313a565d4603a"
I20260709 13:12:19.058506 30861 raft_consensus.cc:1275] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Refusing update from remote peer f6d6fdd02e74424cb87ac73c0a19483e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.059100 30935 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.059228 30786 consensus_queue.cc:260] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:19.060555 30786 raft_consensus.cc:3060] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.060686 31021 consensus_queue.cc:1048] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.065407 30935 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 3.
I20260709 13:12:19.066555 30828 leader_election.cc:304] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ab3967809fb4bc88c1313a565d4603a, 7def4b0a5b764aad84d0bcf265d034f8; no voters: 
I20260709 13:12:19.067689 31027 raft_consensus.cc:2804] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.068141 31027 raft_consensus.cc:697] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 3 LEADER]: Becoming Leader. State: Replica: 7def4b0a5b764aad84d0bcf265d034f8, State: Running, Role: LEADER
I20260709 13:12:19.068361 30786 raft_consensus.cc:2468] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7def4b0a5b764aad84d0bcf265d034f8 in term 3.
I20260709 13:12:19.068910 31027 consensus_queue.cc:237] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } }
I20260709 13:12:19.072781 30935 raft_consensus.cc:1275] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Refusing update from remote peer f6d6fdd02e74424cb87ac73c0a19483e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.074419 30996 consensus_queue.cc:1048] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.077663 30681 catalog_manager.cc:5697] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 reported cstate change: term changed from 2 to 3, leader changed from f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193) to 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194). New cstate: current_term: 3 leader_uuid: "7def4b0a5b764aad84d0bcf265d034f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d6fdd02e74424cb87ac73c0a19483e" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7def4b0a5b764aad84d0bcf265d034f8" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ab3967809fb4bc88c1313a565d4603a" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42323 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.093127 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
I20260709 13:12:19.124104 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:19.124814 21775 tablet_replica.cc:333] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e: stopping tablet replica
I20260709 13:12:19.125348 21775 raft_consensus.cc:2243] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.125759 21775 raft_consensus.cc:2272] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P f6d6fdd02e74424cb87ac73c0a19483e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.127914 21775 tablet_replica.cc:333] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e: stopping tablet replica
I20260709 13:12:19.128422 21775 raft_consensus.cc:2243] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.129093 21775 raft_consensus.cc:2272] T 4ba313e1181046b69af3e0afc450ca71 P f6d6fdd02e74424cb87ac73c0a19483e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.130899 21775 tablet_replica.cc:333] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e: stopping tablet replica
I20260709 13:12:19.131373 21775 raft_consensus.cc:2243] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.131795 21775 raft_consensus.cc:2272] T df9d28fd9c5e44c1aa9b8098f5a3d116 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.133957 21775 tablet_replica.cc:333] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e: stopping tablet replica
I20260709 13:12:19.134380 21775 raft_consensus.cc:2243] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.135047 21775 raft_consensus.cc:2272] T d476f8b7e0c943f18a0c55a3490fe135 P f6d6fdd02e74424cb87ac73c0a19483e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.158344 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
I20260709 13:12:19.172055 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
I20260709 13:12:19.193686 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:19.194279 21775 tablet_replica.cc:333] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: stopping tablet replica
I20260709 13:12:19.194765 21775 raft_consensus.cc:2243] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.195312 21775 pending_rounds.cc:70] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: Trying to abort 1 pending ops.
I20260709 13:12:19.195467 21775 pending_rounds.cc:77] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636819236446208 op_type: NO_OP noop_request { }
I20260709 13:12:19.195760 21775 raft_consensus.cc:2889] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:19.196018 21775 raft_consensus.cc:2272] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 7def4b0a5b764aad84d0bcf265d034f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.197873 21775 tablet_replica.cc:333] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8: stopping tablet replica
I20260709 13:12:19.198316 21775 raft_consensus.cc:2243] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.198670 21775 raft_consensus.cc:2272] T 4ba313e1181046b69af3e0afc450ca71 P 7def4b0a5b764aad84d0bcf265d034f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.200825 21775 tablet_replica.cc:333] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8: stopping tablet replica
I20260709 13:12:19.201498 21775 raft_consensus.cc:2243] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.201997 21775 raft_consensus.cc:2272] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.205775 21775 tablet_replica.cc:333] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8: stopping tablet replica
I20260709 13:12:19.206427 21775 raft_consensus.cc:2243] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.206893 21775 raft_consensus.cc:2272] T d476f8b7e0c943f18a0c55a3490fe135 P 7def4b0a5b764aad84d0bcf265d034f8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:19.214916 30901 consensus_peers.cc:597] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a -> Peer f6d6fdd02e74424cb87ac73c0a19483e (127.21.67.193:46015): Couldn't send request to peer f6d6fdd02e74424cb87ac73c0a19483e. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:46015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.232054 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
I20260709 13:12:19.245962 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
W20260709 13:12:19.265936 30902 consensus_peers.cc:597] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a -> Peer 7def4b0a5b764aad84d0bcf265d034f8 (127.21.67.194:43985): Couldn't send request to peer 7def4b0a5b764aad84d0bcf265d034f8. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:43985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.268340 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:19.269032 21775 tablet_replica.cc:333] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a: stopping tablet replica
I20260709 13:12:19.269579 21775 raft_consensus.cc:2243] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.270005 21775 raft_consensus.cc:2272] T 69cf07feee1b4cf18b25c5b82c4d2ae3 P 6ab3967809fb4bc88c1313a565d4603a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.272058 21775 tablet_replica.cc:333] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a: stopping tablet replica
I20260709 13:12:19.272549 21775 raft_consensus.cc:2243] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.272938 21775 raft_consensus.cc:2272] T 4ba313e1181046b69af3e0afc450ca71 P 6ab3967809fb4bc88c1313a565d4603a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.275090 21775 tablet_replica.cc:333] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a: stopping tablet replica
I20260709 13:12:19.275583 21775 raft_consensus.cc:2243] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.276412 21775 raft_consensus.cc:2272] T df9d28fd9c5e44c1aa9b8098f5a3d116 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.278867 21775 tablet_replica.cc:333] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a: stopping tablet replica
I20260709 13:12:19.279330 21775 raft_consensus.cc:2243] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.279795 21775 raft_consensus.cc:2272] T d476f8b7e0c943f18a0c55a3490fe135 P 6ab3967809fb4bc88c1313a565d4603a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.292696 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:12:19.305554 21775 master.cc:562] Master@127.21.67.254:45779 shutting down...
I20260709 13:12:19.328370 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.328894 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.329252 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5495c7edc67d4f9f99a4aed5b2fdb771: stopping tablet replica
I20260709 13:12:19.348493 21775 master.cc:584] Master@127.21.67.254:45779 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2526 ms)
[----------] 6 tests from LeaderRebalancerTest (269000 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:12:19.388361 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:32829
I20260709 13:12:19.389526 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:19.394901 31038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:19.396148 31039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:19.396644 31041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:19.397027 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:19.397851 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:19.398058 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:19.398212 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602739398195 us; error 0 us; skew 500 ppm
I20260709 13:12:19.398715 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:19.400986 21775 webserver.cc:533] Webserver started at http://127.21.67.254:45015/ using document root <none> and password file <none>
I20260709 13:12:19.401495 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:19.401691 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:19.401954 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:19.402982 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "c0919fef666d4019b324c5ece4b47929"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.407133 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:12:19.410282 31046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.411046 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:19.411278 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "c0919fef666d4019b324c5ece4b47929"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.411513 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:19.433955 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:19.434998 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:19.470876 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:32829
I20260709 13:12:19.470981 31097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:32829 every 8 connection(s)
I20260709 13:12:19.474817 31098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.485836 31098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929: Bootstrap starting.
I20260709 13:12:19.490355 31098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.494225 31098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929: No bootstrap required, opened a new log
I20260709 13:12:19.496277 31098 raft_consensus.cc:359] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0919fef666d4019b324c5ece4b47929" member_type: VOTER }
I20260709 13:12:19.496662 31098 raft_consensus.cc:385] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.496886 31098 raft_consensus.cc:740] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0919fef666d4019b324c5ece4b47929, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.497527 31098 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0919fef666d4019b324c5ece4b47929" member_type: VOTER }
I20260709 13:12:19.497984 31098 raft_consensus.cc:399] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:19.498202 31098 raft_consensus.cc:493] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:19.498463 31098 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.503398 31098 raft_consensus.cc:515] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0919fef666d4019b324c5ece4b47929" member_type: VOTER }
I20260709 13:12:19.503898 31098 leader_election.cc:304] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0919fef666d4019b324c5ece4b47929; no voters: 
I20260709 13:12:19.505038 31098 leader_election.cc:290] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:19.505326 31101 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:19.506633 31101 raft_consensus.cc:697] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 1 LEADER]: Becoming Leader. State: Replica: c0919fef666d4019b324c5ece4b47929, State: Running, Role: LEADER
I20260709 13:12:19.507292 31101 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0919fef666d4019b324c5ece4b47929" member_type: VOTER }
I20260709 13:12:19.507901 31098 sys_catalog.cc:565] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:19.510200 31102 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0919fef666d4019b324c5ece4b47929" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0919fef666d4019b324c5ece4b47929" member_type: VOTER } }
I20260709 13:12:19.510396 31103 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0919fef666d4019b324c5ece4b47929. Latest consensus state: current_term: 1 leader_uuid: "c0919fef666d4019b324c5ece4b47929" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0919fef666d4019b324c5ece4b47929" member_type: VOTER } }
I20260709 13:12:19.510932 31102 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:19.510989 31103 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:19.514269 31107 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:19.519132 31107 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:19.523366 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:19.527155 31107 catalog_manager.cc:1383] Generated new cluster ID: 6eafc8822585415dbf70a47c7e630124
I20260709 13:12:19.527416 31107 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:19.560357 31107 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:19.561596 31107 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:19.571991 31107 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929: Generated new TSK 0
I20260709 13:12:19.572537 31107 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:19.590046 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:19.595546 31119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:19.596632 31120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:19.598567 21775 server_base.cc:1061] running on GCE node
W20260709 13:12:19.599027 31122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:19.599938 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:19.600136 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:19.600301 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602739600282 us; error 0 us; skew 500 ppm
I20260709 13:12:19.600813 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:19.602921 21775 webserver.cc:533] Webserver started at http://127.21.67.193:43223/ using document root <none> and password file <none>
I20260709 13:12:19.603397 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:19.603577 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:19.603893 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:19.604928 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.609138 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:19.612265 31127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.613020 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:19.613291 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.613543 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:19.624914 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:19.625936 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:19.627267 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:19.629410 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:19.629596 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.629853 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:19.630013 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.667754 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:42015
I20260709 13:12:19.667863 31189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:42015 every 8 connection(s)
I20260709 13:12:19.672514 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:19.679922 31194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:19.680886 31195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:19.683300 21775 server_base.cc:1061] running on GCE node
W20260709 13:12:19.685038 31197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:19.686163 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:19.686411 31190 heartbeater.cc:344] Connected to a master server at 127.21.67.254:32829
W20260709 13:12:19.686435 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:19.686827 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602739686811 us; error 0 us; skew 500 ppm
I20260709 13:12:19.686843 31190 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:19.687436 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:19.687747 31190 heartbeater.cc:507] Master 127.21.67.254:32829 requested a full tablet report, sending...
I20260709 13:12:19.690205 31063 ts_manager.cc:194] Registered new tserver with Master: 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015)
I20260709 13:12:19.690531 21775 webserver.cc:533] Webserver started at http://127.21.67.194:40235/ using document root <none> and password file <none>
I20260709 13:12:19.691179 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:19.691432 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:19.691764 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:19.692651 31063 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51124
I20260709 13:12:19.693221 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "a3e7169f66e0460a89e763a4889de629"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.697930 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:19.700862 31202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.701581 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:19.701856 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "a3e7169f66e0460a89e763a4889de629"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.702117 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:19.722375 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:19.723453 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:19.724852 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:19.727035 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:19.727234 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.727495 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:19.727648 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.765422 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:43855
I20260709 13:12:19.765507 31264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:43855 every 8 connection(s)
I20260709 13:12:19.769896 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:19.776937 31268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:19.778728 31269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:19.782403 31271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:19.782748 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:19.783285 31265 heartbeater.cc:344] Connected to a master server at 127.21.67.254:32829
I20260709 13:12:19.783769 31265 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:19.784041 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:19.784300 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:19.784494 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602739784481 us; error 0 us; skew 500 ppm
I20260709 13:12:19.784540 31265 heartbeater.cc:507] Master 127.21.67.254:32829 requested a full tablet report, sending...
I20260709 13:12:19.785091 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:19.786736 31063 ts_manager.cc:194] Registered new tserver with Master: a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:19.787526 21775 webserver.cc:533] Webserver started at http://127.21.67.195:43191/ using document root <none> and password file <none>
I20260709 13:12:19.788208 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:19.788400 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:19.788350 31063 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51138
I20260709 13:12:19.788833 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:19.790153 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "f0a8e9ab56a748fb844732263905dceb"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.794371 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:12:19.797509 31276 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.798211 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:19.798491 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "f0a8e9ab56a748fb844732263905dceb"
format_stamp: "Formatted at 2026-07-09 13:12:19 on dist-test-slave-zkvt"
I20260709 13:12:19.798759 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:19.813993 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:19.814982 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:19.816434 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:19.818573 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:19.818795 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.819022 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:19.819204 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:19.856848 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:42053
I20260709 13:12:19.856956 31338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:42053 every 8 connection(s)
I20260709 13:12:19.869812 31339 heartbeater.cc:344] Connected to a master server at 127.21.67.254:32829
I20260709 13:12:19.870199 31339 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:19.870887 31339 heartbeater.cc:507] Master 127.21.67.254:32829 requested a full tablet report, sending...
I20260709 13:12:19.872676 31063 ts_manager.cc:194] Registered new tserver with Master: f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:19.873133 21775 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013341633s
I20260709 13:12:19.874393 31063 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51150
I20260709 13:12:19.897877 31063 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51160:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:19.900699 31063 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:19.960493 31155 tablet_service.cc:1511] Processing CreateTablet for tablet 9ede478f186444a5a29c33a4d8b932a7 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:19.961604 31154 tablet_service.cc:1511] Processing CreateTablet for tablet ce7d67da5aa543ccb899770e642680fb (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:19.962077 31155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ede478f186444a5a29c33a4d8b932a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.963006 31154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7d67da5aa543ccb899770e642680fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.972184 31230 tablet_service.cc:1511] Processing CreateTablet for tablet 9ede478f186444a5a29c33a4d8b932a7 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:19.973711 31230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ede478f186444a5a29c33a4d8b932a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.976801 31229 tablet_service.cc:1511] Processing CreateTablet for tablet ce7d67da5aa543ccb899770e642680fb (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:19.978299 31229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7d67da5aa543ccb899770e642680fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.978600 31153 tablet_service.cc:1511] Processing CreateTablet for tablet 35cf3750f8cd44cf99196d3c4979d082 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:19.979955 31153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35cf3750f8cd44cf99196d3c4979d082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.987754 31228 tablet_service.cc:1511] Processing CreateTablet for tablet 35cf3750f8cd44cf99196d3c4979d082 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:19.989876 31228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35cf3750f8cd44cf99196d3c4979d082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.995841 31154 tablet_service.cc:1511] Processing CreateTablet for tablet 16be72b9a1834f5498757ccd3b508def (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:19.998579 31227 tablet_service.cc:1511] Processing CreateTablet for tablet 16be72b9a1834f5498757ccd3b508def (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:20.000162 31227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16be72b9a1834f5498757ccd3b508def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.003571 31302 tablet_service.cc:1511] Processing CreateTablet for tablet 35cf3750f8cd44cf99196d3c4979d082 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:20.004113 31304 tablet_service.cc:1511] Processing CreateTablet for tablet 9ede478f186444a5a29c33a4d8b932a7 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:20.004998 31302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35cf3750f8cd44cf99196d3c4979d082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.006340 31303 tablet_service.cc:1511] Processing CreateTablet for tablet ce7d67da5aa543ccb899770e642680fb (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:20.007818 31303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7d67da5aa543ccb899770e642680fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.007579 31152 tablet_service.cc:1511] Processing CreateTablet for tablet c6e8fdd5c7764c0082f4608ea805bdf8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:20.009771 31301 tablet_service.cc:1511] Processing CreateTablet for tablet 16be72b9a1834f5498757ccd3b508def (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:20.011070 31301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16be72b9a1834f5498757ccd3b508def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.012027 31304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ede478f186444a5a29c33a4d8b932a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.015496 31300 tablet_service.cc:1511] Processing CreateTablet for tablet c6e8fdd5c7764c0082f4608ea805bdf8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:19.998581 31154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16be72b9a1834f5498757ccd3b508def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.017710 31299 tablet_service.cc:1511] Processing CreateTablet for tablet e72b2e0b9fc54e93abff792129bdac5c (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:20.019774 31226 tablet_service.cc:1511] Processing CreateTablet for tablet c6e8fdd5c7764c0082f4608ea805bdf8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:20.020605 31151 tablet_service.cc:1511] Processing CreateTablet for tablet e72b2e0b9fc54e93abff792129bdac5c (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:20.022281 31150 tablet_service.cc:1511] Processing CreateTablet for tablet d798d7b4296446388955b746890212e2 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:20.022830 31354 tablet_bootstrap.cc:492] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.024459 31225 tablet_service.cc:1511] Processing CreateTablet for tablet e72b2e0b9fc54e93abff792129bdac5c (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:20.032359 31226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e8fdd5c7764c0082f4608ea805bdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.026640 31224 tablet_service.cc:1511] Processing CreateTablet for tablet d798d7b4296446388955b746890212e2 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:20.033373 31224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d798d7b4296446388955b746890212e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.033510 31298 tablet_service.cc:1511] Processing CreateTablet for tablet d798d7b4296446388955b746890212e2 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:20.035986 31150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d798d7b4296446388955b746890212e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.036231 31225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72b2e0b9fc54e93abff792129bdac5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.037586 31300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e8fdd5c7764c0082f4608ea805bdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.041188 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e8fdd5c7764c0082f4608ea805bdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.043992 31299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72b2e0b9fc54e93abff792129bdac5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.045687 31298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d798d7b4296446388955b746890212e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.048115 31151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72b2e0b9fc54e93abff792129bdac5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.062978 31155 tablet_service.cc:1511] Processing CreateTablet for tablet 14e6c50808c34cc7a21b043dbda6d8b8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:20.085568 31155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e6c50808c34cc7a21b043dbda6d8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.088490 31355 tablet_bootstrap.cc:492] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.117779 31230 tablet_service.cc:1511] Processing CreateTablet for tablet 14e6c50808c34cc7a21b043dbda6d8b8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:20.119230 31230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e6c50808c34cc7a21b043dbda6d8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.120903 31355 tablet_bootstrap.cc:654] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.141254 31228 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3e2c0967504d068f43a5bd54afaab8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:20.142151 31300 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3e2c0967504d068f43a5bd54afaab8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:20.142841 31228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3e2c0967504d068f43a5bd54afaab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.144289 31300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3e2c0967504d068f43a5bd54afaab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.144515 31154 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3e2c0967504d068f43a5bd54afaab8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:20.145853 31154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3e2c0967504d068f43a5bd54afaab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.148404 31298 tablet_service.cc:1511] Processing CreateTablet for tablet 14e6c50808c34cc7a21b043dbda6d8b8 (DEFAULT_TABLE table=test-workload [id=416ef1344404465c98678246a0d86014]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:20.149627 31298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e6c50808c34cc7a21b043dbda6d8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.157311 31354 tablet_bootstrap.cc:654] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.170552 31356 tablet_bootstrap.cc:492] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.173231 31355 tablet_bootstrap.cc:492] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.173874 31355 ts_tablet_manager.cc:1403] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.002s
I20260709 13:12:20.177363 31355 raft_consensus.cc:359] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.178717 31355 raft_consensus.cc:385] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.180001 31355 raft_consensus.cc:740] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.180562 31356 tablet_bootstrap.cc:654] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.181318 31354 tablet_bootstrap.cc:492] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.181819 31354 ts_tablet_manager.cc:1403] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.161s	user 0.007s	sys 0.004s
I20260709 13:12:20.184720 31354 raft_consensus.cc:359] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.185870 31354 raft_consensus.cc:385] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.186326 31354 raft_consensus.cc:740] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.184993 31355 consensus_queue.cc:260] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.186996 31354 consensus_queue.cc:260] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.193423 31356 tablet_bootstrap.cc:492] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.194047 31356 ts_tablet_manager.cc:1403] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 13:12:20.196770 31265 heartbeater.cc:499] Master 127.21.67.254:32829 was elected leader, sending a full tablet report...
I20260709 13:12:20.197199 31355 ts_tablet_manager.cc:1434] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.002s
I20260709 13:12:20.197513 31356 raft_consensus.cc:359] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.198048 31355 tablet_bootstrap.cc:492] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.198254 31356 raft_consensus.cc:385] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.198609 31356 raft_consensus.cc:740] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.199337 31356 consensus_queue.cc:260] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.204533 31355 tablet_bootstrap.cc:654] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.212760 31354 ts_tablet_manager.cc:1434] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.009s
I20260709 13:12:20.213743 31190 heartbeater.cc:499] Master 127.21.67.254:32829 was elected leader, sending a full tablet report...
I20260709 13:12:20.225438 31354 tablet_bootstrap.cc:492] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.230614 31355 tablet_bootstrap.cc:492] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.231078 31355 ts_tablet_manager.cc:1403] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.021s
I20260709 13:12:20.233834 31355 raft_consensus.cc:359] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.234548 31355 raft_consensus.cc:385] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.234848 31355 raft_consensus.cc:740] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.235751 31355 consensus_queue.cc:260] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.236191 31356 ts_tablet_manager.cc:1434] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.042s	user 0.030s	sys 0.013s
I20260709 13:12:20.236934 31339 heartbeater.cc:499] Master 127.21.67.254:32829 was elected leader, sending a full tablet report...
I20260709 13:12:20.237303 31356 tablet_bootstrap.cc:492] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.237958 31354 tablet_bootstrap.cc:654] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.241778 31355 ts_tablet_manager.cc:1434] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:20.243040 31355 tablet_bootstrap.cc:492] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.243785 31356 tablet_bootstrap.cc:654] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.251328 31355 tablet_bootstrap.cc:654] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.255249 31356 tablet_bootstrap.cc:492] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.255738 31356 ts_tablet_manager.cc:1403] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:12:20.256572 31362 raft_consensus.cc:493] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.257259 31362 raft_consensus.cc:515] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.258843 31356 raft_consensus.cc:359] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.259588 31356 raft_consensus.cc:385] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.259980 31356 raft_consensus.cc:740] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.261008 31356 consensus_queue.cc:260] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.262848 31362 leader_election.cc:290] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:20.278837 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:20.280457 31356 ts_tablet_manager.cc:1434] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.008s
W20260709 13:12:20.280923 31279 leader_election.cc:343] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.281586 31356 tablet_bootstrap.cc:492] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.290192 31356 tablet_bootstrap.cc:654] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.291800 31354 tablet_bootstrap.cc:492] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.292394 31354 ts_tablet_manager.cc:1403] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.067s	user 0.028s	sys 0.024s
I20260709 13:12:20.291847 31355 tablet_bootstrap.cc:492] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.293701 31355 ts_tablet_manager.cc:1403] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.003s
I20260709 13:12:20.294098 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
W20260709 13:12:20.295809 31277 leader_election.cc:343] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.296270 31277 leader_election.cc:304] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629
I20260709 13:12:20.296815 31355 raft_consensus.cc:359] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.297658 31355 raft_consensus.cc:385] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.297508 31368 raft_consensus.cc:2749] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.297230 31354 raft_consensus.cc:359] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.298177 31355 raft_consensus.cc:740] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.298501 31354 raft_consensus.cc:385] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.299017 31354 raft_consensus.cc:740] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.299145 31355 consensus_queue.cc:260] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.299976 31354 consensus_queue.cc:260] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.301841 31356 tablet_bootstrap.cc:492] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.302577 31356 ts_tablet_manager.cc:1403] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:12:20.302626 31354 ts_tablet_manager.cc:1434] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:20.303826 31354 tablet_bootstrap.cc:492] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.305334 31361 raft_consensus.cc:493] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.306715 31355 ts_tablet_manager.cc:1434] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:12:20.307708 31355 tablet_bootstrap.cc:492] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.305835 31361 raft_consensus.cc:515] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.311276 31354 tablet_bootstrap.cc:654] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.314563 31355 tablet_bootstrap.cc:654] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.319165 31361 leader_election.cc:290] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.326152 31355 tablet_bootstrap.cc:492] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.326000 31356 raft_consensus.cc:359] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.326843 31355 ts_tablet_manager.cc:1403] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:12:20.326877 31356 raft_consensus.cc:385] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.327437 31356 raft_consensus.cc:740] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.330312 31355 raft_consensus.cc:359] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.331159 31355 raft_consensus.cc:385] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.331501 31355 raft_consensus.cc:740] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.332019 31356 consensus_queue.cc:260] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.332486 31355 consensus_queue.cc:260] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.342314 31355 ts_tablet_manager.cc:1434] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:12:20.344209 31356 ts_tablet_manager.cc:1434] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:12:20.346104 31314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.346762 31314 raft_consensus.cc:2468] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.348582 31131 leader_election.cc:304] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:20.349740 31361 raft_consensus.cc:2804] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.349905 31355 tablet_bootstrap.cc:492] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.350235 31361 raft_consensus.cc:493] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.350711 31361 raft_consensus.cc:3060] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.351893 31356 tablet_bootstrap.cc:492] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.357489 31355 tablet_bootstrap.cc:654] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.359383 31356 tablet_bootstrap.cc:654] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.365867 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:20.371224 31240 raft_consensus.cc:2468] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.367414 31361 raft_consensus.cc:515] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.370182 31354 tablet_bootstrap.cc:492] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.373216 31354 ts_tablet_manager.cc:1403] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.035s
I20260709 13:12:20.374467 31355 tablet_bootstrap.cc:492] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.375281 31355 ts_tablet_manager.cc:1403] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.004s
I20260709 13:12:20.376266 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:20.376031 31354 raft_consensus.cc:359] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.376843 31240 raft_consensus.cc:3060] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.377767 31361 leader_election.cc:290] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.377146 31354 raft_consensus.cc:385] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.378720 31354 raft_consensus.cc:740] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.378871 31314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:20.379495 31314 raft_consensus.cc:3060] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.379199 31355 raft_consensus.cc:359] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.380216 31355 raft_consensus.cc:385] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.379637 31354 consensus_queue.cc:260] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.380546 31355 raft_consensus.cc:740] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.381516 31355 consensus_queue.cc:260] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.382359 31354 ts_tablet_manager.cc:1434] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:20.383412 31354 tablet_bootstrap.cc:492] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.385123 31240 raft_consensus.cc:2468] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.386561 31128 leader_election.cc:304] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.388015 31361 raft_consensus.cc:2804] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.388504 31361 raft_consensus.cc:697] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:20.388727 31355 ts_tablet_manager.cc:1434] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:20.389925 31355 tablet_bootstrap.cc:492] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.389518 31361 consensus_queue.cc:237] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.393874 31354 tablet_bootstrap.cc:654] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.395255 31356 tablet_bootstrap.cc:492] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.397333 31356 ts_tablet_manager.cc:1403] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.002s
I20260709 13:12:20.405789 31356 raft_consensus.cc:359] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.406548 31356 raft_consensus.cc:385] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.406877 31356 raft_consensus.cc:740] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.407627 31356 consensus_queue.cc:260] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.410876 31355 tablet_bootstrap.cc:654] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.416430 31356 ts_tablet_manager.cc:1434] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:20.412809 31314 raft_consensus.cc:2468] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.417599 31356 tablet_bootstrap.cc:492] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.420909 31360 raft_consensus.cc:493] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.421474 31360 raft_consensus.cc:515] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.421639 31063 catalog_manager.cc:5697] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.426633 31354 tablet_bootstrap.cc:492] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.426717 31376 raft_consensus.cc:493] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.427248 31354 ts_tablet_manager.cc:1403] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.017s
I20260709 13:12:20.427496 31376 raft_consensus.cc:515] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.430771 31354 raft_consensus.cc:359] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.431468 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:20.432422 31240 raft_consensus.cc:2468] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.433249 31360 leader_election.cc:290] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.435331 31128 leader_election.cc:304] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.437167 31376 leader_election.cc:290] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.437898 31376 raft_consensus.cc:2804] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.438324 31376 raft_consensus.cc:493] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.438761 31376 raft_consensus.cc:3060] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.438797 31314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.439677 31314 raft_consensus.cc:2468] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.442636 31360 raft_consensus.cc:493] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.443229 31360 raft_consensus.cc:515] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.445484 31360 leader_election.cc:290] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.446231 31356 tablet_bootstrap.cc:654] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.453033 31376 raft_consensus.cc:515] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.431524 31354 raft_consensus.cc:385] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.454243 31354 raft_consensus.cc:740] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.455549 31354 consensus_queue.cc:260] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.458525 31354 ts_tablet_manager.cc:1434] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:12:20.459012 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:20.461084 31240 raft_consensus.cc:3060] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.462353 31354 tablet_bootstrap.cc:492] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.470499 31360 raft_consensus.cc:493] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.471108 31360 raft_consensus.cc:515] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.472239 31240 raft_consensus.cc:2468] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.473923 31128 leader_election.cc:304] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.475139 31361 raft_consensus.cc:2804] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.477218 31354 tablet_bootstrap.cc:654] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.475095 31360 leader_election.cc:290] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.482288 31355 tablet_bootstrap.cc:492] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.482848 31355 ts_tablet_manager.cc:1403] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.093s	user 0.029s	sys 0.040s
I20260709 13:12:20.488233 31355 raft_consensus.cc:359] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.490429 31355 raft_consensus.cc:385] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.490743 31355 raft_consensus.cc:740] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.491012 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:20.491372 31354 tablet_bootstrap.cc:492] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.491942 31354 ts_tablet_manager.cc:1403] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 13:12:20.491701 31355 consensus_queue.cc:260] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.493089 31356 tablet_bootstrap.cc:492] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.492985 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:20.493722 31356 ts_tablet_manager.cc:1403] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.004s
I20260709 13:12:20.494145 31355 ts_tablet_manager.cc:1434] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:12:20.495460 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:20.495965 31376 leader_election.cc:290] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.496223 31164 raft_consensus.cc:2468] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:20.495133 31354 raft_consensus.cc:359] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.489202 31361 raft_consensus.cc:697] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:20.496992 31354 raft_consensus.cc:385] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.497283 31355 tablet_bootstrap.cc:492] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.497474 31354 raft_consensus.cc:740] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.497025 31356 raft_consensus.cc:359] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.498035 31356 raft_consensus.cc:385] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.498360 31356 raft_consensus.cc:740] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.498742 31314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:20.498329 31354 consensus_queue.cc:260] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.499388 31314 raft_consensus.cc:3060] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.499840 31356 consensus_queue.cc:260] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.501248 31354 ts_tablet_manager.cc:1434] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:20.502347 31354 tablet_bootstrap.cc:492] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.505182 31355 tablet_bootstrap.cc:654] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:20.505999 31205 leader_election.cc:343] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.507050 31361 consensus_queue.cc:237] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.509774 31376 raft_consensus.cc:493] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.510136 31354 tablet_bootstrap.cc:654] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.510313 31376 raft_consensus.cc:515] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.513651 31376 leader_election.cc:290] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.514887 31356 ts_tablet_manager.cc:1434] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 13:12:20.515451 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:20.516355 31240 raft_consensus.cc:2468] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.518227 31205 leader_election.cc:304] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.518129 31128 leader_election.cc:304] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
W20260709 13:12:20.518992 31111 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:20.520807 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.522406 31314 raft_consensus.cc:2468] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.525792 31356 tablet_bootstrap.cc:492] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.526733 31360 raft_consensus.cc:2804] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.536123 31360 raft_consensus.cc:493] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.536592 31360 raft_consensus.cc:3060] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.527006 31376 raft_consensus.cc:2804] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.537467 31376 raft_consensus.cc:493] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.537828 31376 raft_consensus.cc:3060] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.538561 31356 tablet_bootstrap.cc:654] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.528728 31354 tablet_bootstrap.cc:492] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
W20260709 13:12:20.527870 31131 leader_election.cc:343] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.540068 31354 ts_tablet_manager.cc:1403] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.011s
I20260709 13:12:20.544582 31354 raft_consensus.cc:359] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.545852 31354 raft_consensus.cc:385] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.546234 31354 raft_consensus.cc:740] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.547250 31354 consensus_queue.cc:260] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.544579 31063 catalog_manager.cc:5697] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.550593 31354 ts_tablet_manager.cc:1434] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:12:20.555325 31376 raft_consensus.cc:515] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.558357 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:20.558947 31240 raft_consensus.cc:3060] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.560563 31314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35cf3750f8cd44cf99196d3c4979d082" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.560734 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.561225 31360 raft_consensus.cc:515] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.561468 31314 raft_consensus.cc:2393] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3e7169f66e0460a89e763a4889de629 in current term 1: Already voted for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in this term.
I20260709 13:12:20.561520 31312 raft_consensus.cc:2468] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:20.562248 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.562911 31313 raft_consensus.cc:2468] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:20.563125 31206 leader_election.cc:304] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3e7169f66e0460a89e763a4889de629; no voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:20.565197 31389 raft_consensus.cc:2749] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.565883 31206 leader_election.cc:304] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:20.566843 31240 raft_consensus.cc:2468] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.560784 31354 tablet_bootstrap.cc:492] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.568046 31128 leader_election.cc:304] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.569036 31355 tablet_bootstrap.cc:492] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.568997 31361 raft_consensus.cc:2804] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.569679 31355 ts_tablet_manager.cc:1403] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.033s
I20260709 13:12:20.569846 31361 raft_consensus.cc:697] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:20.570830 31361 consensus_queue.cc:237] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.572752 31389 raft_consensus.cc:2804] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.573048 31355 raft_consensus.cc:359] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.579932 31355 raft_consensus.cc:385] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.580276 31355 raft_consensus.cc:740] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.581458 31389 raft_consensus.cc:493] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.581067 31355 consensus_queue.cc:260] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.581933 31389 raft_consensus.cc:3060] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.582451 31356 tablet_bootstrap.cc:492] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.583019 31356 ts_tablet_manager.cc:1403] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.008s
I20260709 13:12:20.584090 31062 catalog_manager.cc:5697] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.574573 31354 tablet_bootstrap.cc:654] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.576201 31376 leader_election.cc:290] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.577340 31360 leader_election.cc:290] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.578061 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:20.578177 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:20.579012 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:20.586833 31312 raft_consensus.cc:3060] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.586881 31165 raft_consensus.cc:3060] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:20.587092 31131 leader_election.cc:343] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.595110 31312 raft_consensus.cc:2468] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:20.596706 31356 raft_consensus.cc:359] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.597543 31356 raft_consensus.cc:385] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.597872 31356 raft_consensus.cc:740] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.598999 31389 raft_consensus.cc:515] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.599417 31206 leader_election.cc:304] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:20.602610 31360 raft_consensus.cc:2804] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.603109 31360 raft_consensus.cc:697] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:20.604202 31360 consensus_queue.cc:237] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:20.599077 31356 consensus_queue.cc:260] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.595110 31165 raft_consensus.cc:2468] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:20.612040 31356 ts_tablet_manager.cc:1434] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.005s
I20260709 13:12:20.613113 31356 tablet_bootstrap.cc:492] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.616884 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:20.610002 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:20.618356 31312 raft_consensus.cc:3060] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:20.618649 31205 leader_election.cc:343] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.619382 31355 ts_tablet_manager.cc:1434] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.049s	user 0.015s	sys 0.011s
I20260709 13:12:20.620501 31355 tablet_bootstrap.cc:492] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.627244 31354 tablet_bootstrap.cc:492] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.627805 31354 ts_tablet_manager.cc:1403] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.003s
I20260709 13:12:20.629376 31356 tablet_bootstrap.cc:654] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.630879 31354 raft_consensus.cc:359] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.631702 31354 raft_consensus.cc:385] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.633144 31312 raft_consensus.cc:2468] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:20.633801 31354 raft_consensus.cc:740] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.634778 31206 leader_election.cc:304] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:20.634877 31354 consensus_queue.cc:260] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.632953 31355 tablet_bootstrap.cc:654] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.637676 31354 ts_tablet_manager.cc:1434] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:20.638691 31354 tablet_bootstrap.cc:492] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.639920 31376 raft_consensus.cc:493] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.640295 31391 raft_consensus.cc:2804] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.640448 31376 raft_consensus.cc:515] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.642825 31376 leader_election.cc:290] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.644443 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be72b9a1834f5498757ccd3b508def" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:20.645088 31240 raft_consensus.cc:2468] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.647107 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be72b9a1834f5498757ccd3b508def" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.648821 31128 leader_election.cc:304] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.649716 31376 raft_consensus.cc:2804] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:20.649789 31131 leader_election.cc:343] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.650177 31376 raft_consensus.cc:493] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.650564 31376 raft_consensus.cc:3060] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.655155 31368 raft_consensus.cc:493] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.655867 31368 raft_consensus.cc:515] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.656695 31354 tablet_bootstrap.cc:654] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.658408 31376 raft_consensus.cc:515] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.660984 31376 leader_election.cc:290] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.631794 31389 leader_election.cc:290] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.661528 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:20.668640 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:20.661690 31368 leader_election.cc:290] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:20.671542 31240 raft_consensus.cc:2468] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 0.
I20260709 13:12:20.672458 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be72b9a1834f5498757ccd3b508def" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
W20260709 13:12:20.672646 31279 leader_election.cc:343] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.675379 31355 tablet_bootstrap.cc:492] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.676002 31355 ts_tablet_manager.cc:1403] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.016s
I20260709 13:12:20.676580 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be72b9a1834f5498757ccd3b508def" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
W20260709 13:12:20.678639 31131 leader_election.cc:343] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.679039 31355 raft_consensus.cc:359] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.679972 31355 raft_consensus.cc:385] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.680364 31355 raft_consensus.cc:740] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.681160 31355 consensus_queue.cc:260] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.683817 31355 ts_tablet_manager.cc:1434] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:20.683749 31277 leader_election.cc:304] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:20.685281 31355 tablet_bootstrap.cc:492] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:20.685683 31368 raft_consensus.cc:2804] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.686133 31368 raft_consensus.cc:493] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.686515 31368 raft_consensus.cc:3060] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.677618 31239 raft_consensus.cc:3060] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.689667 31376 raft_consensus.cc:493] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.690388 31376 raft_consensus.cc:515] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.697335 31355 tablet_bootstrap.cc:654] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.696362 31062 catalog_manager.cc:5697] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.700019 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:20.700667 31240 raft_consensus.cc:2468] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.699467 31376 leader_election.cc:290] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.701148 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.701839 31312 raft_consensus.cc:2468] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.701929 31128 leader_election.cc:304] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.703860 31376 raft_consensus.cc:2804] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.704407 31376 raft_consensus.cc:493] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.704828 31376 raft_consensus.cc:3060] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.714448 31355 tablet_bootstrap.cc:492] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:20.715019 31355 ts_tablet_manager.cc:1403] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 13:12:20.718205 31355 raft_consensus.cc:359] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.718954 31355 raft_consensus.cc:385] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.719302 31355 raft_consensus.cc:740] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.720124 31355 consensus_queue.cc:260] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.722790 31355 ts_tablet_manager.cc:1434] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:20.668372 31391 raft_consensus.cc:697] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:20.724512 31391 consensus_queue.cc:237] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.727873 31368 raft_consensus.cc:515] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.733338 31368 leader_election.cc:290] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:20.734162 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:20.734465 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:20.735255 31240 raft_consensus.cc:3060] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:20.736140 31279 leader_election.cc:343] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.737641 31356 tablet_bootstrap.cc:492] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.738194 31356 ts_tablet_manager.cc:1403] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.006s
I20260709 13:12:20.738829 31354 tablet_bootstrap.cc:492] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.739357 31354 ts_tablet_manager.cc:1403] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.038s
I20260709 13:12:20.741367 31356 raft_consensus.cc:359] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.741940 31240 raft_consensus.cc:2468] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 1.
I20260709 13:12:20.742166 31354 raft_consensus.cc:359] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.742916 31354 raft_consensus.cc:385] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.743173 31354 raft_consensus.cc:740] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.743373 31277 leader_election.cc:304] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:20.743954 31354 consensus_queue.cc:260] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.748656 31376 raft_consensus.cc:515] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.749014 31368 raft_consensus.cc:2804] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.749691 31368 raft_consensus.cc:697] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:20.750617 31368 consensus_queue.cc:237] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.752236 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:20.752934 31238 raft_consensus.cc:3060] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.754282 31354 ts_tablet_manager.cc:1434] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:12:20.755477 31354 tablet_bootstrap.cc:492] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:20.761849 31354 tablet_bootstrap.cc:654] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.742175 31356 raft_consensus.cc:385] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.769255 31356 raft_consensus.cc:740] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.770344 31238 raft_consensus.cc:2468] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.772755 31356 consensus_queue.cc:260] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.773782 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:20.773665 31128 leader_election.cc:304] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.774562 31312 raft_consensus.cc:3060] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.775244 31361 raft_consensus.cc:2804] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.775905 31361 raft_consensus.cc:697] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:20.777048 31361 consensus_queue.cc:237] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.743518 31239 raft_consensus.cc:2468] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.787066 31128 leader_election.cc:304] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:20.787868 31312 raft_consensus.cc:2468] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.788111 31383 raft_consensus.cc:2804] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.778935 31376 leader_election.cc:290] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.790910 31062 catalog_manager.cc:5697] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 0 to 1, leader changed from <none> to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 1 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.792158 31063 catalog_manager.cc:5697] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.795173 31356 ts_tablet_manager.cc:1434] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.002s
I20260709 13:12:20.799510 31356 tablet_bootstrap.cc:492] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.802640 31354 tablet_bootstrap.cc:492] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:20.803153 31354 ts_tablet_manager.cc:1403] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.015s
I20260709 13:12:20.806110 31354 raft_consensus.cc:359] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.806777 31354 raft_consensus.cc:385] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.807063 31354 raft_consensus.cc:740] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.807780 31354 consensus_queue.cc:260] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.808673 31383 raft_consensus.cc:697] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:20.809670 31383 consensus_queue.cc:237] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.810163 31356 tablet_bootstrap.cc:654] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.810995 31061 catalog_manager.cc:5697] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.814656 31354 ts_tablet_manager.cc:1434] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:20.814903 31356 tablet_bootstrap.cc:492] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.815400 31356 ts_tablet_manager.cc:1403] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:12:20.817359 31356 raft_consensus.cc:359] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.817852 31356 raft_consensus.cc:385] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.818068 31356 raft_consensus.cc:740] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.818776 31356 consensus_queue.cc:260] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.822914 31356 ts_tablet_manager.cc:1434] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:20.823782 31356 tablet_bootstrap.cc:492] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:20.829249 31356 tablet_bootstrap.cc:654] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.831084 31062 catalog_manager.cc:5697] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.832974 31356 tablet_bootstrap.cc:492] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:20.833396 31356 ts_tablet_manager.cc:1403] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:20.835150 31356 raft_consensus.cc:359] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.835603 31356 raft_consensus.cc:385] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.835876 31356 raft_consensus.cc:740] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.836503 31356 consensus_queue.cc:260] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.837497 31383 raft_consensus.cc:493] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.838169 31356 ts_tablet_manager.cc:1434] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:20.838016 31383 raft_consensus.cc:515] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.840322 31383 leader_election.cc:290] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.840965 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:20.841619 31239 raft_consensus.cc:2468] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.841893 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:20.842514 31312 raft_consensus.cc:2468] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:20.842608 31128 leader_election.cc:304] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:20.843488 31383 raft_consensus.cc:2804] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.843886 31383 raft_consensus.cc:493] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.844177 31383 raft_consensus.cc:3060] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.850811 31383 raft_consensus.cc:515] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.852348 31383 leader_election.cc:290] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:20.853024 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:20.853219 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:20.853469 31239 raft_consensus.cc:3060] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.853650 31312 raft_consensus.cc:3060] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.858613 31312 raft_consensus.cc:2468] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.858644 31239 raft_consensus.cc:2468] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:20.859458 31131 leader_election.cc:304] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:20.860124 31383 raft_consensus.cc:2804] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.860572 31383 raft_consensus.cc:697] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:20.860841 31361 consensus_queue.cc:1048] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.861268 31383 consensus_queue.cc:237] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:20.885632 31383 consensus_queue.cc:1048] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.885792 31061 catalog_manager.cc:5697] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.005455 31383 consensus_queue.cc:1048] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.015523 31376 consensus_queue.cc:1048] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:21.024610 31368 raft_consensus.cc:493] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.025205 31368 raft_consensus.cc:515] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.027278 31368 leader_election.cc:290] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:21.028290 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:21.028281 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:21.029850 31239 raft_consensus.cc:2393] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0a8e9ab56a748fb844732263905dceb in current term 1: Already voted for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in this term.
I20260709 13:12:21.030712 31277 leader_election.cc:304] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629
I20260709 13:12:21.031373 31368 raft_consensus.cc:3060] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.036324 31368 raft_consensus.cc:2749] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.043942 31376 consensus_queue.cc:1048] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.053632 31383 consensus_queue.cc:1048] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.063431 31368 raft_consensus.cc:493] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.063838 31368 raft_consensus.cc:515] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.065488 31368 leader_election.cc:290] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:21.066288 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be72b9a1834f5498757ccd3b508def" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:21.066517 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16be72b9a1834f5498757ccd3b508def" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:21.067714 31239 raft_consensus.cc:2393] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0a8e9ab56a748fb844732263905dceb in current term 1: Already voted for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in this term.
I20260709 13:12:21.068712 31277 leader_election.cc:304] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629
I20260709 13:12:21.069449 31368 raft_consensus.cc:3060] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.074321 31368 raft_consensus.cc:2749] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.093673 31383 raft_consensus.cc:493] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.094255 31383 raft_consensus.cc:515] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.097023 31383 leader_election.cc:290] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:21.097183 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:21.097642 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:21.098079 31239 raft_consensus.cc:2393] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71b91eceb00143eaa8f88b0ae6297bf5 in current term 1: Already voted for candidate f0a8e9ab56a748fb844732263905dceb in this term.
I20260709 13:12:21.099139 31128 leader_election.cc:304] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5; no voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:21.099786 31383 raft_consensus.cc:3060] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.104913 31239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
mode: GRACEFUL
new_leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:12:21.105458 31239 raft_consensus.cc:606] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Received request to transfer leadership to TS 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:21.107393 31383 raft_consensus.cc:2749] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.113337 31383 raft_consensus.cc:493] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.113708 31383 raft_consensus.cc:515] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.115799 31383 leader_election.cc:290] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:21.116432 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:21.116752 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:21.117586 31313 raft_consensus.cc:2393] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71b91eceb00143eaa8f88b0ae6297bf5 in current term 1: Already voted for candidate a3e7169f66e0460a89e763a4889de629 in this term.
I20260709 13:12:21.118551 31131 leader_election.cc:304] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5; no voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:21.119272 31383 raft_consensus.cc:3060] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.126085 31383 raft_consensus.cc:2749] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.130252 31165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
mode: GRACEFUL
new_leader_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:58466
I20260709 13:12:21.130733 31165 raft_consensus.cc:606] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Received request to transfer leadership to TS a3e7169f66e0460a89e763a4889de629
I20260709 13:12:21.133900 31395 consensus_queue.cc:1048] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.141026 31391 raft_consensus.cc:993] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629: : Instructing follower 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:21.141448 31391 raft_consensus.cc:1081] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Signalling peer 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:21.143498 31164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:58452
I20260709 13:12:21.144068 31164 raft_consensus.cc:493] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.144378 31164 raft_consensus.cc:3060] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.146751 31312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d798d7b4296446388955b746890212e2"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
mode: GRACEFUL
new_leader_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:51208
I20260709 13:12:21.147393 31312 raft_consensus.cc:606] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Received request to transfer leadership to TS a3e7169f66e0460a89e763a4889de629
I20260709 13:12:21.147928 31391 consensus_queue.cc:1048] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.154790 31164 raft_consensus.cc:515] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:21.155992 31165 raft_consensus.cc:1240] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Rejecting Update request from peer a3e7169f66e0460a89e763a4889de629 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:21.156291 31163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
mode: GRACEFUL
new_leader_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:58466
I20260709 13:12:21.156965 31163 raft_consensus.cc:606] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Received request to transfer leadership to TS a3e7169f66e0460a89e763a4889de629
I20260709 13:12:21.158550 31164 leader_election.cc:290] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Requested vote from peers f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:21.159932 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:21.160573 31239 raft_consensus.cc:3055] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:21.160202 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ede478f186444a5a29c33a4d8b932a7" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:21.160892 31239 raft_consensus.cc:740] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:21.161365 31313 raft_consensus.cc:3060] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.160900 31391 consensus_queue.cc:1059] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:21.162565 31239 consensus_queue.cc:260] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:21.163853 31239 raft_consensus.cc:3060] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.167403 31313 raft_consensus.cc:2468] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 2.
I20260709 13:12:21.168485 31131 leader_election.cc:304] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:21.169200 31239 raft_consensus.cc:2468] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 2.
W20260709 13:12:21.169770 31389 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:12:21.169853 31383 raft_consensus.cc:2804] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:21.170475 31383 raft_consensus.cc:697] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:21.171358 31383 consensus_queue.cc:237] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } }
I20260709 13:12:21.172726 31165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
mode: GRACEFUL
new_leader_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:58466
I20260709 13:12:21.173563 31165 raft_consensus.cc:606] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Received request to transfer leadership to TS f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:21.180061 31061 catalog_manager.cc:5697] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 1 to 2, leader changed from a3e7169f66e0460a89e763a4889de629 (127.21.67.194) to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.199805 31383 consensus_queue.cc:1048] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.215344 31361 consensus_queue.cc:1048] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.221664 31376 raft_consensus.cc:993] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5: : Instructing follower a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:21.222143 31361 raft_consensus.cc:1081] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Signalling peer a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:21.223520 31239 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:51282
I20260709 13:12:21.224053 31239 raft_consensus.cc:493] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.224363 31239 raft_consensus.cc:3060] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.228562 31361 consensus_queue.cc:1048] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.230861 31239 raft_consensus.cc:515] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.233757 31239 leader_election.cc:290] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:21.233997 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:21.234582 31313 raft_consensus.cc:3060] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.239392 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72b2e0b9fc54e93abff792129bdac5c" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:21.240041 31165 raft_consensus.cc:3055] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:21.240343 31165 raft_consensus.cc:740] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:21.240474 31376 consensus_queue.cc:1048] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.244580 31313 raft_consensus.cc:2468] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:21.246155 31206 leader_election.cc:304] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:21.246985 31389 raft_consensus.cc:2804] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:21.247490 31389 raft_consensus.cc:697] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:21.248261 31389 consensus_queue.cc:237] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.251564 31391 consensus_queue.cc:1048] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.251291 31165 consensus_queue.cc:260] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.255300 31165 raft_consensus.cc:3060] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.257810 31389 consensus_queue.cc:1048] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.261089 31061 catalog_manager.cc:5697] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 1 to 2, leader changed from 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193) to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.262523 31165 raft_consensus.cc:2468] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:21.325822 31368 consensus_queue.cc:1048] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.334435 31430 consensus_queue.cc:1048] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.344882 31431 raft_consensus.cc:993] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb: : Instructing follower a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:21.345381 31430 raft_consensus.cc:1081] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Signalling peer a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:21.346807 31238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d798d7b4296446388955b746890212e2"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:51268
I20260709 13:12:21.347280 31238 raft_consensus.cc:493] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.347626 31238 raft_consensus.cc:3060] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.352584 31238 raft_consensus.cc:515] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.354974 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:21.355587 31165 raft_consensus.cc:3060] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.355422 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d798d7b4296446388955b746890212e2" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:21.354398 31238 leader_election.cc:290] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:21.356180 31312 raft_consensus.cc:3055] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:21.356526 31312 raft_consensus.cc:740] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:21.357300 31312 consensus_queue.cc:260] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.358554 31312 raft_consensus.cc:3060] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.363366 31165 raft_consensus.cc:2468] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:21.365235 31205 leader_election.cc:304] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:21.365432 31312 raft_consensus.cc:2468] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:21.366019 31360 raft_consensus.cc:2804] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:21.366509 31360 raft_consensus.cc:697] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:21.367308 31360 consensus_queue.cc:237] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.372771 31062 catalog_manager.cc:5697] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 1 to 2, leader changed from f0a8e9ab56a748fb844732263905dceb (127.21.67.195) to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.438015 31383 consensus_queue.cc:1048] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.444339 31403 raft_consensus.cc:993] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5: : Instructing follower f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:21.444801 31376 raft_consensus.cc:1081] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Signalling peer f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:21.447078 31313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:51190
I20260709 13:12:21.448724 31313 raft_consensus.cc:493] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.449111 31313 raft_consensus.cc:3060] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.449469 31376 consensus_queue.cc:1048] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.457134 31313 raft_consensus.cc:515] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.461519 31313 leader_election.cc:290] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:21.462165 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:21.462776 31165 raft_consensus.cc:3055] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:21.463105 31165 raft_consensus.cc:740] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:21.463155 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2c0967504d068f43a5bd54afaab8" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:21.463793 31238 raft_consensus.cc:3060] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.463984 31165 consensus_queue.cc:260] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.465132 31165 raft_consensus.cc:3060] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.470736 31238 raft_consensus.cc:2468] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:21.472102 31165 raft_consensus.cc:2468] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:21.472463 31277 leader_election.cc:304] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:21.473418 31430 raft_consensus.cc:2804] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:21.473883 31430 raft_consensus.cc:697] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:21.474687 31430 consensus_queue.cc:237] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.480561 31062 catalog_manager.cc:5697] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 1 to 2, leader changed from 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193) to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 2 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.552480 31313 raft_consensus.cc:1275] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.553565 31403 consensus_queue.cc:1048] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:21.560971 31238 raft_consensus.cc:1275] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.562371 31376 consensus_queue.cc:1048] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:21.678349 31376 raft_consensus.cc:993] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5: : Instructing follower a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:21.678871 31403 raft_consensus.cc:1081] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Signalling peer a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:21.680470 31239 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:51282
I20260709 13:12:21.680974 31239 raft_consensus.cc:493] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.681283 31239 raft_consensus.cc:3060] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.686228 31239 raft_consensus.cc:515] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.687891 31239 leader_election.cc:290] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:21.688473 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:21.689111 31165 raft_consensus.cc:3055] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:21.688980 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e6c50808c34cc7a21b043dbda6d8b8" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:21.689414 31165 raft_consensus.cc:740] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:21.689656 31313 raft_consensus.cc:3060] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.690274 31165 consensus_queue.cc:260] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.691221 31165 raft_consensus.cc:3060] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.694945 31313 raft_consensus.cc:2468] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:21.696082 31165 raft_consensus.cc:2468] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:21.696121 31206 leader_election.cc:304] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:21.697103 31360 raft_consensus.cc:2804] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:21.697609 31360 raft_consensus.cc:697] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:21.698311 31360 consensus_queue.cc:237] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:21.704561 31063 catalog_manager.cc:5697] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 1 to 2, leader changed from 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193) to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.784926 31313 raft_consensus.cc:1275] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.786131 31360 consensus_queue.cc:1048] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:21.794508 31165 raft_consensus.cc:1275] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.795914 31435 consensus_queue.cc:1048] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:21.829190 31165 raft_consensus.cc:1275] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.830386 31360 consensus_queue.cc:1048] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:21.837841 31313 raft_consensus.cc:1275] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.839497 31391 consensus_queue.cc:1048] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:21.942117 31165 raft_consensus.cc:1275] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.943372 31430 consensus_queue.cc:1048] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:21.950681 31239 raft_consensus.cc:1275] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:21.952313 31436 consensus_queue.cc:1048] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:22.272631 31165 raft_consensus.cc:1275] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.273801 31391 consensus_queue.cc:1048] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:22.278826 31313 raft_consensus.cc:1275] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.281864 31360 consensus_queue.cc:1048] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.197067 31063 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36280:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:24.199059 31063 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:24.247920 31150 tablet_service.cc:1511] Processing CreateTablet for tablet 81dafbca974840de85ec434eccd86283 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:24.249173 31150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dafbca974840de85ec434eccd86283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.249127 31228 tablet_service.cc:1511] Processing CreateTablet for tablet 81dafbca974840de85ec434eccd86283 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:24.250520 31228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dafbca974840de85ec434eccd86283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.250394 31300 tablet_service.cc:1511] Processing CreateTablet for tablet 81dafbca974840de85ec434eccd86283 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:24.251610 31300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dafbca974840de85ec434eccd86283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.255379 31225 tablet_service.cc:1511] Processing CreateTablet for tablet 5717671bf4294eb697293f22ad23b9f0 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:24.256585 31225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5717671bf4294eb697293f22ad23b9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.259585 31227 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed3d8d7977c4f2da2d51387048eedd5 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:24.260775 31227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed3d8d7977c4f2da2d51387048eedd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.263911 31230 tablet_service.cc:1511] Processing CreateTablet for tablet 08fd5eb8f6dd4a2f81eb068463702ff3 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:24.264668 31301 tablet_service.cc:1511] Processing CreateTablet for tablet 5717671bf4294eb697293f22ad23b9f0 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:24.265168 31230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fd5eb8f6dd4a2f81eb068463702ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.265002 31298 tablet_service.cc:1511] Processing CreateTablet for tablet 08fd5eb8f6dd4a2f81eb068463702ff3 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:24.265892 31301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5717671bf4294eb697293f22ad23b9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.266463 31298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fd5eb8f6dd4a2f81eb068463702ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.267597 31299 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed3d8d7977c4f2da2d51387048eedd5 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:24.268925 31299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed3d8d7977c4f2da2d51387048eedd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.269495 31303 tablet_service.cc:1511] Processing CreateTablet for tablet bef77dbf0ab64dbfa5714a627bee855a (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:24.269708 31224 tablet_service.cc:1511] Processing CreateTablet for tablet bef77dbf0ab64dbfa5714a627bee855a (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:24.270678 31303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef77dbf0ab64dbfa5714a627bee855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.270954 31224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef77dbf0ab64dbfa5714a627bee855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.281380 31154 tablet_service.cc:1511] Processing CreateTablet for tablet 5717671bf4294eb697293f22ad23b9f0 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:24.282061 31152 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed3d8d7977c4f2da2d51387048eedd5 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:24.282712 31154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5717671bf4294eb697293f22ad23b9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.283301 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed3d8d7977c4f2da2d51387048eedd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.284547 31229 tablet_service.cc:1511] Processing CreateTablet for tablet 92f0e5c990ec4c848c75b34e5c349348 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:24.285808 31229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f0e5c990ec4c848c75b34e5c349348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.307197 31155 tablet_service.cc:1511] Processing CreateTablet for tablet 08fd5eb8f6dd4a2f81eb068463702ff3 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:24.307554 31151 tablet_service.cc:1511] Processing CreateTablet for tablet bef77dbf0ab64dbfa5714a627bee855a (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:24.308631 31155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fd5eb8f6dd4a2f81eb068463702ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.309504 31153 tablet_service.cc:1511] Processing CreateTablet for tablet 92f0e5c990ec4c848c75b34e5c349348 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:24.310720 31153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f0e5c990ec4c848c75b34e5c349348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.327365 31151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef77dbf0ab64dbfa5714a627bee855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.329571 31453 tablet_bootstrap.cc:492] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.331487 31300 tablet_service.cc:1511] Processing CreateTablet for tablet 92f0e5c990ec4c848c75b34e5c349348 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:24.332803 31300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f0e5c990ec4c848c75b34e5c349348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.341197 31149 tablet_service.cc:1511] Processing CreateTablet for tablet bd29b8bf326d4c548d0abc6baaa25df7 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:24.342517 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd29b8bf326d4c548d0abc6baaa25df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.345669 31304 tablet_service.cc:1511] Processing CreateTablet for tablet 927019c3eb4144cc943a7649c97e5663 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:24.346999 31304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927019c3eb4144cc943a7649c97e5663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.348273 31453 tablet_bootstrap.cc:654] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.349500 31148 tablet_service.cc:1511] Processing CreateTablet for tablet 927019c3eb4144cc943a7649c97e5663 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:24.356395 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927019c3eb4144cc943a7649c97e5663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.356623 31224 tablet_service.cc:1511] Processing CreateTablet for tablet 927019c3eb4144cc943a7649c97e5663 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:24.357892 31224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927019c3eb4144cc943a7649c97e5663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.361202 31228 tablet_service.cc:1511] Processing CreateTablet for tablet bd29b8bf326d4c548d0abc6baaa25df7 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:24.366616 31147 tablet_service.cc:1511] Processing CreateTablet for tablet 3836060c7531403bb5d030b027f9bcfb (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:24.364796 31299 tablet_service.cc:1511] Processing CreateTablet for tablet bd29b8bf326d4c548d0abc6baaa25df7 (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:24.368122 31228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd29b8bf326d4c548d0abc6baaa25df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.368535 31147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3836060c7531403bb5d030b027f9bcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.383834 31455 tablet_bootstrap.cc:492] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.387246 31454 tablet_bootstrap.cc:492] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.386279 31299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd29b8bf326d4c548d0abc6baaa25df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.392222 31455 tablet_bootstrap.cc:654] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.397861 31230 tablet_service.cc:1511] Processing CreateTablet for tablet 3836060c7531403bb5d030b027f9bcfb (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:24.399212 31230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3836060c7531403bb5d030b027f9bcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.400197 31454 tablet_bootstrap.cc:654] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.401507 31300 tablet_service.cc:1511] Processing CreateTablet for tablet 3836060c7531403bb5d030b027f9bcfb (DEFAULT_TABLE table=soft_deleted_table [id=4e315203288445598156bf9778e7417c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:24.402731 31300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3836060c7531403bb5d030b027f9bcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.431376 31453 tablet_bootstrap.cc:492] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.431814 31455 tablet_bootstrap.cc:492] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.432011 31453 ts_tablet_manager.cc:1403] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.004s
I20260709 13:12:24.432328 31455 ts_tablet_manager.cc:1403] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.011s
I20260709 13:12:24.441046 31455 raft_consensus.cc:359] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.442873 31455 raft_consensus.cc:385] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.435119 31453 raft_consensus.cc:359] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.443262 31455 raft_consensus.cc:740] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.443408 31453 raft_consensus.cc:385] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.443791 31453 raft_consensus.cc:740] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.444090 31455 consensus_queue.cc:260] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.444376 31453 consensus_queue.cc:260] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.446348 31455 ts_tablet_manager.cc:1434] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:24.446507 31453 ts_tablet_manager.cc:1434] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:12:24.447285 31455 tablet_bootstrap.cc:492] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.447540 31453 tablet_bootstrap.cc:492] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.453190 31454 tablet_bootstrap.cc:492] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.453677 31454 ts_tablet_manager.cc:1403] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.006s
I20260709 13:12:24.456547 31454 raft_consensus.cc:359] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.457271 31454 raft_consensus.cc:385] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.457572 31454 raft_consensus.cc:740] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.457753 31453 tablet_bootstrap.cc:654] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.458393 31454 consensus_queue.cc:260] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.460742 31454 ts_tablet_manager.cc:1434] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:24.461284 31455 tablet_bootstrap.cc:654] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.461910 31454 tablet_bootstrap.cc:492] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.469539 31453 tablet_bootstrap.cc:492] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.470057 31453 ts_tablet_manager.cc:1403] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:12:24.474972 31454 tablet_bootstrap.cc:654] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.474934 31453 raft_consensus.cc:359] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.475643 31453 raft_consensus.cc:385] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.476032 31453 raft_consensus.cc:740] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.476835 31453 consensus_queue.cc:260] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.478909 31453 ts_tablet_manager.cc:1434] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:24.480173 31453 tablet_bootstrap.cc:492] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.481700 31455 tablet_bootstrap.cc:492] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.482416 31455 ts_tablet_manager.cc:1403] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.011s
I20260709 13:12:24.485901 31455 raft_consensus.cc:359] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.486631 31455 raft_consensus.cc:385] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.486681 31454 tablet_bootstrap.cc:492] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.487072 31442 raft_consensus.cc:493] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.487715 31454 ts_tablet_manager.cc:1403] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.012s
I20260709 13:12:24.487772 31453 tablet_bootstrap.cc:654] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.487628 31442 raft_consensus.cc:515] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.489884 31442 leader_election.cc:290] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:24.490947 31454 raft_consensus.cc:359] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.491386 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:24.491724 31454 raft_consensus.cc:385] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.492049 31454 raft_consensus.cc:740] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.492266 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:24.487397 31455 raft_consensus.cc:740] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
W20260709 13:12:24.492938 31277 leader_election.cc:343] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.492949 31454 consensus_queue.cc:260] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.493845 31455 consensus_queue.cc:260] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.494323 31165 raft_consensus.cc:2468] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 0.
I20260709 13:12:24.496039 31454 ts_tablet_manager.cc:1434] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:12:24.496946 31454 tablet_bootstrap.cc:492] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.498202 31279 leader_election.cc:304] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: a3e7169f66e0460a89e763a4889de629
I20260709 13:12:24.501843 31453 tablet_bootstrap.cc:492] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.502341 31453 ts_tablet_manager.cc:1403] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 13:12:24.502849 31442 raft_consensus.cc:2804] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.503252 31442 raft_consensus.cc:493] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.503437 31454 tablet_bootstrap.cc:654] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.503587 31442 raft_consensus.cc:3060] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.505215 31453 raft_consensus.cc:359] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.505978 31453 raft_consensus.cc:385] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.506318 31453 raft_consensus.cc:740] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.507140 31453 consensus_queue.cc:260] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.513988 31453 ts_tablet_manager.cc:1434] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:12:24.514858 31453 tablet_bootstrap.cc:492] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.518816 31455 ts_tablet_manager.cc:1434] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:12:24.519955 31442 raft_consensus.cc:515] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.523106 31453 tablet_bootstrap.cc:654] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.524196 31454 tablet_bootstrap.cc:492] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.524799 31454 ts_tablet_manager.cc:1403] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.005s
I20260709 13:12:24.526400 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:24.522940 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:24.528488 31165 raft_consensus.cc:3060] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.528112 31454 raft_consensus.cc:359] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.528924 31454 raft_consensus.cc:385] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.529238 31454 raft_consensus.cc:740] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.530000 31454 consensus_queue.cc:260] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.532480 31454 ts_tablet_manager.cc:1434] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:12:24.532573 31277 leader_election.cc:343] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.533644 31454 tablet_bootstrap.cc:492] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.538232 31165 raft_consensus.cc:2468] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 1.
I20260709 13:12:24.539670 31279 leader_election.cc:304] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: a3e7169f66e0460a89e763a4889de629
I20260709 13:12:24.540515 31464 raft_consensus.cc:2804] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.540880 31361 raft_consensus.cc:493] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.541080 31455 tablet_bootstrap.cc:492] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.541419 31361 raft_consensus.cc:515] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.543630 31361 leader_election.cc:290] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.545167 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.545850 31454 tablet_bootstrap.cc:654] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:24.547052 31131 leader_election.cc:343] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.547818 31442 leader_election.cc:290] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:24.549358 31464 raft_consensus.cc:697] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:24.550382 31464 consensus_queue.cc:237] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.550935 31455 tablet_bootstrap.cc:654] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.555476 31454 tablet_bootstrap.cc:492] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.556182 31454 ts_tablet_manager.cc:1403] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.010s
I20260709 13:12:24.556716 31453 tablet_bootstrap.cc:492] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.557267 31453 ts_tablet_manager.cc:1403] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.019s
I20260709 13:12:24.560799 31454 raft_consensus.cc:359] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.561964 31454 raft_consensus.cc:385] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.562355 31454 raft_consensus.cc:740] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.563414 31454 consensus_queue.cc:260] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.564438 31455 tablet_bootstrap.cc:492] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.564951 31455 ts_tablet_manager.cc:1403] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
W20260709 13:12:24.565135 31111 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:24.566417 31454 ts_tablet_manager.cc:1434] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:24.566761 31453 raft_consensus.cc:359] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.567555 31453 raft_consensus.cc:385] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.567879 31453 raft_consensus.cc:740] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.567962 31454 tablet_bootstrap.cc:492] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.568110 31455 raft_consensus.cc:359] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.568632 31453 consensus_queue.cc:260] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.569216 31455 raft_consensus.cc:385] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.569598 31455 raft_consensus.cc:740] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.569718 31361 raft_consensus.cc:493] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.571758 31361 raft_consensus.cc:515] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.573995 31361 leader_election.cc:290] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.570830 31453 ts_tablet_manager.cc:1434] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.003s
I20260709 13:12:24.575064 31455 consensus_queue.cc:260] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.576206 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.576859 31453 tablet_bootstrap.cc:492] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.578214 31455 ts_tablet_manager.cc:1434] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:12:24.579536 31455 tablet_bootstrap.cc:492] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
W20260709 13:12:24.580277 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.194:43855, user_credentials={real_user=slave}} blocked reactor thread for 46087.9us
W20260709 13:12:24.583431 31131 leader_election.cc:343] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.586733 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:24.587339 31238 raft_consensus.cc:2468] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:24.589164 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:24.590502 31454 tablet_bootstrap.cc:654] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.590758 31128 leader_election.cc:304] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: f0a8e9ab56a748fb844732263905dceb
W20260709 13:12:24.592020 31128 leader_election.cc:343] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.592438 31128 leader_election.cc:304] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5; no voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:24.592476 31467 raft_consensus.cc:2804] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.592599 31455 tablet_bootstrap.cc:654] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.595261 31062 catalog_manager.cc:5697] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 0 to 1, leader changed from <none> to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 1 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.593091 31467 raft_consensus.cc:493] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.598461 31467 raft_consensus.cc:3060] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.593544 31361 raft_consensus.cc:2749] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.606055 31453 tablet_bootstrap.cc:654] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.607115 31455 tablet_bootstrap.cc:492] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.607764 31455 ts_tablet_manager.cc:1403] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.002s
I20260709 13:12:24.611152 31455 raft_consensus.cc:359] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.612092 31455 raft_consensus.cc:385] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.612468 31455 raft_consensus.cc:740] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.613570 31455 consensus_queue.cc:260] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.616233 31455 ts_tablet_manager.cc:1434] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:24.617379 31455 tablet_bootstrap.cc:492] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.624383 31455 tablet_bootstrap.cc:654] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.634588 31467 raft_consensus.cc:515] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.636536 31455 tablet_bootstrap.cc:492] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.637099 31467 leader_election.cc:290] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.638060 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:24.638273 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:24.638860 31238 raft_consensus.cc:3060] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.639362 31455 ts_tablet_manager.cc:1403] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
W20260709 13:12:24.639693 31131 leader_election.cc:343] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.642941 31455 raft_consensus.cc:359] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.643306 31454 tablet_bootstrap.cc:492] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.643576 31455 raft_consensus.cc:385] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.643872 31454 ts_tablet_manager.cc:1403] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.028s
I20260709 13:12:24.643977 31455 raft_consensus.cc:740] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.645099 31455 consensus_queue.cc:260] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.646178 31453 tablet_bootstrap.cc:492] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.646777 31453 ts_tablet_manager.cc:1403] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.020s
I20260709 13:12:24.646873 31454 raft_consensus.cc:359] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.647610 31454 raft_consensus.cc:385] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.647884 31455 ts_tablet_manager.cc:1434] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:24.647893 31454 raft_consensus.cc:740] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.649210 31455 tablet_bootstrap.cc:492] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.648932 31454 consensus_queue.cc:260] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.651297 31454 ts_tablet_manager.cc:1434] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:24.650938 31453 raft_consensus.cc:359] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.651921 31453 raft_consensus.cc:385] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.652318 31454 tablet_bootstrap.cc:492] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.652318 31453 raft_consensus.cc:740] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.653900 31453 consensus_queue.cc:260] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.656435 31453 ts_tablet_manager.cc:1434] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:12:24.661185 31454 tablet_bootstrap.cc:654] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.665772 31464 raft_consensus.cc:493] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.666123 31455 tablet_bootstrap.cc:654] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.666433 31464 raft_consensus.cc:515] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.669381 31464 leader_election.cc:290] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:24.670827 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
W20260709 13:12:24.672948 31279 leader_election.cc:343] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.674053 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
W20260709 13:12:24.675946 31277 leader_election.cc:343] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.676602 31277 leader_election.cc:304] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629
I20260709 13:12:24.678649 31238 raft_consensus.cc:2468] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:24.679111 31455 tablet_bootstrap.cc:492] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.675948 31453 tablet_bootstrap.cc:492] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.679785 31455 ts_tablet_manager.cc:1403] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.004s
I20260709 13:12:24.683125 31455 raft_consensus.cc:359] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.683905 31455 raft_consensus.cc:385] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.684285 31455 raft_consensus.cc:740] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.684026 31128 leader_election.cc:304] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:24.685186 31455 consensus_queue.cc:260] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.685670 31467 raft_consensus.cc:2804] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.686365 31467 raft_consensus.cc:697] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:24.687189 31467 consensus_queue.cc:237] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.688022 31455 ts_tablet_manager.cc:1434] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:24.689152 31455 tablet_bootstrap.cc:492] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.690014 31453 tablet_bootstrap.cc:654] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.693549 31464 raft_consensus.cc:2749] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.695109 31454 tablet_bootstrap.cc:492] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.697356 31453 tablet_bootstrap.cc:492] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.698666 31455 tablet_bootstrap.cc:654] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.700088 31453 ts_tablet_manager.cc:1403] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.005s
I20260709 13:12:24.700829 31454 ts_tablet_manager.cc:1403] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.017s
I20260709 13:12:24.705235 31454 raft_consensus.cc:359] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.706296 31454 raft_consensus.cc:385] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.706799 31454 raft_consensus.cc:740] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.707934 31454 consensus_queue.cc:260] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.709385 31453 raft_consensus.cc:359] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.710165 31453 raft_consensus.cc:385] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.710486 31453 raft_consensus.cc:740] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.711201 31453 consensus_queue.cc:260] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.712181 31454 ts_tablet_manager.cc:1434] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:12:24.715152 31453 ts_tablet_manager.cc:1434] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 13:12:24.715776 31455 tablet_bootstrap.cc:492] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.716178 31453 tablet_bootstrap.cc:492] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.716301 31455 ts_tablet_manager.cc:1403] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.012s
I20260709 13:12:24.713486 31454 tablet_bootstrap.cc:492] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.719527 31467 raft_consensus.cc:493] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.719596 31455 raft_consensus.cc:359] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.720531 31455 raft_consensus.cc:385] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.720263 31467 raft_consensus.cc:515] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.722549 31467 leader_election.cc:290] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.723968 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927019c3eb4144cc943a7649c97e5663" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.724234 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927019c3eb4144cc943a7649c97e5663" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
W20260709 13:12:24.725584 31128 leader_election.cc:343] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.720852 31455 raft_consensus.cc:740] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.727240 31062 catalog_manager.cc:5697] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:24.728894 31131 leader_election.cc:343] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.728741 31455 consensus_queue.cc:260] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.731768 31131 leader_election.cc:304] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5; no voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:24.732283 31455 ts_tablet_manager.cc:1434] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:12:24.732777 31467 raft_consensus.cc:2749] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.733493 31468 raft_consensus.cc:493] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.733971 31468 raft_consensus.cc:515] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.735961 31468 leader_election.cc:290] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:24.736267 31455 tablet_bootstrap.cc:492] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.736694 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:24.736985 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:24.737742 31238 raft_consensus.cc:2393] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0a8e9ab56a748fb844732263905dceb in current term 1: Already voted for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in this term.
I20260709 13:12:24.738871 31277 leader_election.cc:304] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629
I20260709 13:12:24.740558 31468 raft_consensus.cc:3060] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.744663 31475 raft_consensus.cc:493] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.745162 31475 raft_consensus.cc:515] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.747401 31475 leader_election.cc:290] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.749490 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef77dbf0ab64dbfa5714a627bee855a" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.750219 31312 raft_consensus.cc:2468] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:24.751988 31206 leader_election.cc:304] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:24.752411 31453 tablet_bootstrap.cc:654] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.753070 31475 raft_consensus.cc:2804] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.753548 31475 raft_consensus.cc:493] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.753962 31475 raft_consensus.cc:3060] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.754914 31455 tablet_bootstrap.cc:654] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.756134 31468 raft_consensus.cc:2749] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.757283 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef77dbf0ab64dbfa5714a627bee855a" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
W20260709 13:12:24.758533 31205 leader_election.cc:343] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.764511 31467 raft_consensus.cc:493] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.765023 31467 raft_consensus.cc:515] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.765810 31454 tablet_bootstrap.cc:654] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.768018 31453 tablet_bootstrap.cc:492] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.768499 31453 ts_tablet_manager.cc:1403] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.009s
I20260709 13:12:24.771322 31475 raft_consensus.cc:515] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.773626 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:24.773931 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.774269 31238 raft_consensus.cc:2468] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:24.775151 31475 leader_election.cc:290] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.775544 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef77dbf0ab64dbfa5714a627bee855a" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:24.775800 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef77dbf0ab64dbfa5714a627bee855a" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:24.776235 31313 raft_consensus.cc:3060] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.776584 31455 tablet_bootstrap.cc:492] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.777052 31455 ts_tablet_manager.cc:1403] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.016s
W20260709 13:12:24.777173 31205 leader_election.cc:343] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.777777 31467 leader_election.cc:290] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.771449 31453 raft_consensus.cc:359] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.778611 31128 leader_election.cc:304] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:24.778884 31453 raft_consensus.cc:385] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.779201 31453 raft_consensus.cc:740] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.779987 31453 consensus_queue.cc:260] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.780401 31455 raft_consensus.cc:359] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.780897 31312 raft_consensus.cc:2468] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:24.781248 31455 raft_consensus.cc:385] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.781643 31455 raft_consensus.cc:740] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.782671 31454 tablet_bootstrap.cc:492] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.782341 31455 consensus_queue.cc:260] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.784055 31467 raft_consensus.cc:2804] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.784541 31467 raft_consensus.cc:493] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.783594 31454 ts_tablet_manager.cc:1403] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.013s
I20260709 13:12:24.784915 31453 ts_tablet_manager.cc:1434] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:24.784972 31467 raft_consensus.cc:3060] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.785881 31453 tablet_bootstrap.cc:492] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.788012 31454 raft_consensus.cc:359] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.788380 31455 ts_tablet_manager.cc:1434] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:24.788746 31454 raft_consensus.cc:385] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.789135 31454 raft_consensus.cc:740] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.789893 31454 consensus_queue.cc:260] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.791538 31453 tablet_bootstrap.cc:654] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.792368 31454 ts_tablet_manager.cc:1434] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:24.794703 31313 raft_consensus.cc:2468] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:24.796023 31455 tablet_bootstrap.cc:492] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: Bootstrap starting.
I20260709 13:12:24.796319 31454 tablet_bootstrap.cc:492] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.802561 31206 leader_election.cc:304] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:24.803395 31360 raft_consensus.cc:493] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.803962 31360 raft_consensus.cc:515] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.805883 31454 tablet_bootstrap.cc:654] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.806267 31360 leader_election.cc:290] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.806926 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:24.807554 31165 raft_consensus.cc:2468] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:24.806795 31360 raft_consensus.cc:2804] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.808352 31360 raft_consensus.cc:697] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:24.815508 31455 tablet_bootstrap.cc:654] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.815691 31360 consensus_queue.cc:237] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.808795 31205 leader_election.cc:304] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:24.808269 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.820566 31313 raft_consensus.cc:2468] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:24.829073 31467 raft_consensus.cc:515] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.830295 31455 tablet_bootstrap.cc:492] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: No bootstrap required, opened a new log
I20260709 13:12:24.832953 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:24.833540 31455 ts_tablet_manager.cc:1403] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.010s
I20260709 13:12:24.833633 31313 raft_consensus.cc:3060] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.834245 31454 tablet_bootstrap.cc:492] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.834807 31454 ts_tablet_manager.cc:1403] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.001s
I20260709 13:12:24.832264 31475 raft_consensus.cc:2804] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.832790 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:24.835822 31475 raft_consensus.cc:493] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.835968 31238 raft_consensus.cc:3060] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.836246 31475 raft_consensus.cc:3060] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.831363 31467 leader_election.cc:290] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.840574 31060 catalog_manager.cc:5697] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.844249 31313 raft_consensus.cc:2468] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:24.846719 31131 leader_election.cc:304] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:24.847313 31453 tablet_bootstrap.cc:492] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.847517 31467 raft_consensus.cc:2804] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.847790 31453 ts_tablet_manager.cc:1403] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.008s
I20260709 13:12:24.848126 31467 raft_consensus.cc:697] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:24.849073 31467 consensus_queue.cc:237] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.850864 31475 raft_consensus.cc:515] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.851951 31454 raft_consensus.cc:359] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.852603 31454 raft_consensus.cc:385] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.852841 31454 raft_consensus.cc:740] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.853065 31453 raft_consensus.cc:359] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.853688 31453 raft_consensus.cc:385] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.853473 31454 consensus_queue.cc:260] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.853969 31453 raft_consensus.cc:740] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.854703 31453 consensus_queue.cc:260] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.854784 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:24.855757 31165 raft_consensus.cc:3060] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.857105 31453 ts_tablet_manager.cc:1434] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:12:24.858037 31453 tablet_bootstrap.cc:492] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb: Bootstrap starting.
I20260709 13:12:24.855523 31454 ts_tablet_manager.cc:1434] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:24.859354 31454 tablet_bootstrap.cc:492] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: Bootstrap starting.
I20260709 13:12:24.861603 31486 raft_consensus.cc:493] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.862116 31486 raft_consensus.cc:515] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.864326 31486 leader_election.cc:290] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.865427 31455 raft_consensus.cc:359] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.866688 31455 raft_consensus.cc:385] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.868121 31455 raft_consensus.cc:740] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.868669 31165 raft_consensus.cc:2468] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:24.867805 31454 tablet_bootstrap.cc:654] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.868904 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.866214 31238 raft_consensus.cc:2468] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:24.869791 31453 tablet_bootstrap.cc:654] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.869692 31313 raft_consensus.cc:2468] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:24.870954 31475 leader_election.cc:290] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.871887 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:24.868886 31455 consensus_queue.cc:260] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.872570 31165 raft_consensus.cc:2468] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:24.873274 31062 catalog_manager.cc:5697] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.874154 31205 leader_election.cc:304] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:24.874163 31455 ts_tablet_manager.cc:1434] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 13:12:24.875133 31205 leader_election.cc:304] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:24.878113 31486 raft_consensus.cc:2804] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.878508 31486 raft_consensus.cc:493] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.878867 31486 raft_consensus.cc:3060] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.879757 31475 raft_consensus.cc:2804] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.880501 31475 raft_consensus.cc:697] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:24.881414 31475 consensus_queue.cc:237] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.884021 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:24.884682 31313 raft_consensus.cc:3060] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.889205 31486 raft_consensus.cc:515] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.893162 31313 raft_consensus.cc:2468] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:24.903465 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:24.903867 31454 tablet_bootstrap.cc:492] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: No bootstrap required, opened a new log
I20260709 13:12:24.904529 31454 ts_tablet_manager.cc:1403] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.006s
I20260709 13:12:24.904397 31164 raft_consensus.cc:3060] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.907500 31454 raft_consensus.cc:359] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.908290 31454 raft_consensus.cc:385] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.908634 31454 raft_consensus.cc:740] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.909520 31454 consensus_queue.cc:260] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.912114 31454 ts_tablet_manager.cc:1434] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:24.915467 31468 raft_consensus.cc:493] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.916013 31468 raft_consensus.cc:515] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.916482 31453 tablet_bootstrap.cc:492] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb: No bootstrap required, opened a new log
I20260709 13:12:24.916913 31453 ts_tablet_manager.cc:1403] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.015s
I20260709 13:12:24.918030 31468 leader_election.cc:290] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:24.919313 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:24.919586 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:24.920011 31238 raft_consensus.cc:2468] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 0.
I20260709 13:12:24.920197 31165 raft_consensus.cc:2468] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 0.
I20260709 13:12:24.921221 31277 leader_election.cc:304] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:24.922264 31468 raft_consensus.cc:2804] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.922597 31468 raft_consensus.cc:493] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.922897 31468 raft_consensus.cc:3060] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.923480 31453 raft_consensus.cc:359] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.923132 31060 catalog_manager.cc:5697] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.924122 31453 raft_consensus.cc:385] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.924432 31453 raft_consensus.cc:740] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.925035 31453 consensus_queue.cc:260] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.925477 31164 raft_consensus.cc:2468] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:24.926457 31453 ts_tablet_manager.cc:1434] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:12:24.926965 31486 leader_election.cc:290] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.927018 31205 leader_election.cc:304] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:24.928339 31486 raft_consensus.cc:2804] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.928491 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:24.930837 31313 raft_consensus.cc:3060] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.933755 31486 raft_consensus.cc:697] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:24.935151 31486 consensus_queue.cc:237] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.940431 31468 raft_consensus.cc:515] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.942525 31468 leader_election.cc:290] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:24.943188 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:24.943828 31165 raft_consensus.cc:3060] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.944043 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:24.944629 31238 raft_consensus.cc:3060] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.940604 31313 raft_consensus.cc:2468] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:24.950762 31165 raft_consensus.cc:2468] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 1.
I20260709 13:12:24.951313 31238 raft_consensus.cc:2468] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 1.
I20260709 13:12:24.951982 31279 leader_election.cc:304] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:24.953055 31468 raft_consensus.cc:2804] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.953510 31468 raft_consensus.cc:697] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:24.954284 31468 consensus_queue.cc:237] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.956189 31062 catalog_manager.cc:5697] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.958009 31486 raft_consensus.cc:493] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.957832 31475 raft_consensus.cc:493] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.958482 31486 raft_consensus.cc:515] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.959126 31475 raft_consensus.cc:515] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.961380 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927019c3eb4144cc943a7649c97e5663" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:24.961766 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927019c3eb4144cc943a7649c97e5663" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.961951 31165 raft_consensus.cc:2468] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:24.962330 31313 raft_consensus.cc:2468] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 0.
I20260709 13:12:24.963193 31205 leader_election.cc:304] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:24.963497 31486 leader_election.cc:290] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.964078 31486 raft_consensus.cc:2804] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.964486 31486 raft_consensus.cc:493] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.964818 31486 raft_consensus.cc:3060] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.966277 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" is_pre_election: true
I20260709 13:12:24.966964 31165 raft_consensus.cc:2393] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3e7169f66e0460a89e763a4889de629 in current term 1: Already voted for candidate f0a8e9ab56a748fb844732263905dceb in this term.
I20260709 13:12:24.966912 31475 leader_election.cc:290] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.968289 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:24.969412 31206 leader_election.cc:304] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3e7169f66e0460a89e763a4889de629; no voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:24.970134 31475 raft_consensus.cc:3060] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.971184 31062 catalog_manager.cc:5697] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 0 to 1, leader changed from <none> to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 1 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.973543 31486 raft_consensus.cc:515] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.975630 31486 leader_election.cc:290] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:24.976325 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927019c3eb4144cc943a7649c97e5663" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:24.976718 31475 raft_consensus.cc:2749] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.976890 31165 raft_consensus.cc:3060] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.979707 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927019c3eb4144cc943a7649c97e5663" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:24.980233 31313 raft_consensus.cc:3060] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.984781 31165 raft_consensus.cc:2468] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:24.984915 31313 raft_consensus.cc:2468] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 1.
I20260709 13:12:24.986004 31206 leader_election.cc:304] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:24.986687 31475 raft_consensus.cc:2804] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.987437 31475 raft_consensus.cc:697] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:24.988082 31475 consensus_queue.cc:237] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:24.994354 31062 catalog_manager.cc:5697] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 1 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.002115 31468 consensus_queue.cc:1048] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.012564 31442 consensus_queue.cc:1048] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.029088 31467 raft_consensus.cc:493] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.029671 31467 raft_consensus.cc:515] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.031257 31467 leader_election.cc:290] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.031879 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:25.032112 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:25.032426 31238 raft_consensus.cc:2468] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:25.032672 31313 raft_consensus.cc:2468] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 0.
I20260709 13:12:25.033430 31128 leader_election.cc:304] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:25.034137 31467 raft_consensus.cc:2804] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:25.034451 31467 raft_consensus.cc:493] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.034715 31467 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.039887 31467 raft_consensus.cc:515] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.041339 31467 leader_election.cc:290] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.041976 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:25.042172 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:25.042495 31238 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.042687 31313 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.046804 31313 raft_consensus.cc:2468] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:25.047176 31238 raft_consensus.cc:2468] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 1.
I20260709 13:12:25.047695 31131 leader_election.cc:304] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:25.048457 31467 raft_consensus.cc:2804] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:25.048816 31467 raft_consensus.cc:697] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:25.049397 31467 consensus_queue.cc:237] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.056876 31062 catalog_manager.cc:5697] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.075942 31467 consensus_queue.cc:1048] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.086269 31467 consensus_queue.cc:1048] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.164685 31466 raft_consensus.cc:493] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.165058 31466 raft_consensus.cc:515] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.166651 31466 leader_election.cc:290] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.167295 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef77dbf0ab64dbfa5714a627bee855a" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3e7169f66e0460a89e763a4889de629" is_pre_election: true
I20260709 13:12:25.167524 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef77dbf0ab64dbfa5714a627bee855a" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a8e9ab56a748fb844732263905dceb" is_pre_election: true
I20260709 13:12:25.168332 31313 raft_consensus.cc:2393] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71b91eceb00143eaa8f88b0ae6297bf5 in current term 1: Already voted for candidate a3e7169f66e0460a89e763a4889de629 in this term.
I20260709 13:12:25.169229 31131 leader_election.cc:304] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5; no voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:25.169777 31466 raft_consensus.cc:3060] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.174618 31466 raft_consensus.cc:2749] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.231791 31313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81dafbca974840de85ec434eccd86283"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
mode: GRACEFUL
new_leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:51208
I20260709 13:12:25.232354 31313 raft_consensus.cc:606] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Received request to transfer leadership to TS 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:25.239468 31239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
mode: GRACEFUL
new_leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:12:25.240077 31239 raft_consensus.cc:606] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Received request to transfer leadership to TS 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:25.244661 31239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
mode: GRACEFUL
new_leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:12:25.245107 31239 raft_consensus.cc:606] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Received request to transfer leadership to TS 71b91eceb00143eaa8f88b0ae6297bf5
I20260709 13:12:25.252188 31313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
mode: GRACEFUL
new_leader_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:51208
I20260709 13:12:25.252593 31313 raft_consensus.cc:606] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Received request to transfer leadership to TS a3e7169f66e0460a89e763a4889de629
I20260709 13:12:25.256742 31165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
mode: GRACEFUL
new_leader_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:58466
I20260709 13:12:25.257144 31165 raft_consensus.cc:606] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Received request to transfer leadership to TS a3e7169f66e0460a89e763a4889de629
I20260709 13:12:25.263356 31165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
mode: GRACEFUL
new_leader_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:58466
I20260709 13:12:25.263762 31165 raft_consensus.cc:606] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Received request to transfer leadership to TS f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:25.301736 31475 consensus_queue.cc:1048] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.308214 31486 raft_consensus.cc:993] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: : Instructing follower 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:25.308662 31360 raft_consensus.cc:1081] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Signalling peer 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:25.310797 31164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:58452
I20260709 13:12:25.311302 31164 raft_consensus.cc:493] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.312362 31164 raft_consensus.cc:3060] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.313561 31360 consensus_queue.cc:1048] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.319500 31164 raft_consensus.cc:515] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.321601 31164 leader_election.cc:290] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.322181 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:25.322789 31239 raft_consensus.cc:3055] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.323118 31239 raft_consensus.cc:740] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:25.324020 31239 consensus_queue.cc:260] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.324275 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed3d8d7977c4f2da2d51387048eedd5" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:25.324929 31239 raft_consensus.cc:3060] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.325420 31466 consensus_queue.cc:1048] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:25.333434 31239 raft_consensus.cc:2468] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 2.
I20260709 13:12:25.334992 31504 consensus_queue.cc:1048] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:25.336005 31128 leader_election.cc:304] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:25.337138 31504 raft_consensus.cc:2804] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.337643 31504 raft_consensus.cc:697] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:25.338421 31504 consensus_queue.cc:237] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.350793 31466 raft_consensus.cc:993] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: : Instructing follower f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:25.351253 31466 raft_consensus.cc:1081] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Signalling peer f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:25.351636 31060 catalog_manager.cc:5697] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 1 to 2, leader changed from a3e7169f66e0460a89e763a4889de629 (127.21.67.194) to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.353006 31313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:51190
I20260709 13:12:25.353546 31313 raft_consensus.cc:493] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.353889 31313 raft_consensus.cc:3060] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.357443 31442 consensus_queue.cc:1048] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.360386 31313 raft_consensus.cc:515] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.362855 31313 leader_election.cc:290] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:25.363328 31165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:25.363900 31165 raft_consensus.cc:3055] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.364192 31165 raft_consensus.cc:740] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:25.364333 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3836060c7531403bb5d030b027f9bcfb" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:25.364954 31239 raft_consensus.cc:3060] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.364907 31165 consensus_queue.cc:260] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.366106 31165 raft_consensus.cc:3060] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.371186 31464 consensus_queue.cc:1048] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.375351 31239 raft_consensus.cc:2468] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:25.376187 31165 raft_consensus.cc:2468] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:25.378170 31279 leader_election.cc:304] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:25.379094 31464 raft_consensus.cc:2804] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.379545 31464 raft_consensus.cc:697] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:25.380330 31464 consensus_queue.cc:237] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.388625 31360 consensus_queue.cc:1048] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.390347 31060 catalog_manager.cc:5697] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 1 to 2, leader changed from 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193) to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 2 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:25.391237 31442 raft_consensus.cc:993] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: : Instructing follower a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:25.391808 31464 raft_consensus.cc:1081] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Signalling peer a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:25.393340 31238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:51268
I20260709 13:12:25.395433 31238 raft_consensus.cc:493] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.395792 31238 raft_consensus.cc:3060] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.402763 31486 consensus_queue.cc:1048] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.403044 31238 raft_consensus.cc:515] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.405128 31238 leader_election.cc:290] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.405272 31486 consensus_queue.cc:1048] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.406955 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:25.407549 31164 raft_consensus.cc:3060] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.411278 31313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f0e5c990ec4c848c75b34e5c349348" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:25.411837 31313 raft_consensus.cc:3055] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.412119 31313 raft_consensus.cc:740] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:25.416610 31164 raft_consensus.cc:2468] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:25.423537 31205 leader_election.cc:304] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:25.425283 31486 raft_consensus.cc:2804] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.418089 31313 consensus_queue.cc:260] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.426573 31313 raft_consensus.cc:3060] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.429600 31486 raft_consensus.cc:697] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:25.430545 31486 consensus_queue.cc:237] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.433008 31313 raft_consensus.cc:2468] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:25.435909 31475 consensus_queue.cc:1048] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.440167 31464 raft_consensus.cc:993] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: : Instructing follower 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:25.440613 31464 raft_consensus.cc:1081] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Signalling peer 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:25.439561 31060 catalog_manager.cc:5697] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 1 to 2, leader changed from f0a8e9ab56a748fb844732263905dceb (127.21.67.195) to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.441957 31475 consensus_queue.cc:1048] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.442296 31163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81dafbca974840de85ec434eccd86283"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:58444
I20260709 13:12:25.442896 31163 raft_consensus.cc:493] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.443257 31163 raft_consensus.cc:3060] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.460599 31486 consensus_queue.cc:1048] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:25.472759 31163 raft_consensus.cc:515] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.475979 31238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:25.476751 31238 raft_consensus.cc:3060] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.477530 31360 raft_consensus.cc:993] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: : Instructing follower 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:25.478155 31360 raft_consensus.cc:1081] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Signalling peer 71b91eceb00143eaa8f88b0ae6297bf5 to start an election
I20260709 13:12:25.481264 31165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
 from {username='slave'} at 127.0.0.1:58452
I20260709 13:12:25.481758 31165 raft_consensus.cc:493] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.482093 31165 raft_consensus.cc:3060] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.485805 31238 raft_consensus.cc:2468] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 2.
I20260709 13:12:25.487217 31128 leader_election.cc:304] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: 
I20260709 13:12:25.488358 31466 raft_consensus.cc:2804] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.488960 31466 raft_consensus.cc:697] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:25.489046 31165 raft_consensus.cc:515] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.489971 31466 consensus_queue.cc:237] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.490839 31165 leader_election.cc:290] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.492108 31314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:25.502588 31239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd5eb8f6dd4a2f81eb068463702ff3" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:25.503130 31239 raft_consensus.cc:3055] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.503444 31239 raft_consensus.cc:740] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:25.504213 31239 consensus_queue.cc:260] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.505259 31239 raft_consensus.cc:3060] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.506386 31314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dafbca974840de85ec434eccd86283" candidate_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:25.506992 31314 raft_consensus.cc:3055] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.507284 31314 raft_consensus.cc:740] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:25.508075 31314 consensus_queue.cc:260] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.509205 31314 raft_consensus.cc:3060] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.512620 31239 raft_consensus.cc:2468] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 2.
I20260709 13:12:25.505160 31163 leader_election.cc:290] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Requested vote from peers a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.516144 31128 leader_election.cc:304] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:25.517124 31314 raft_consensus.cc:2468] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b91eceb00143eaa8f88b0ae6297bf5 in term 2.
I20260709 13:12:25.517773 31466 raft_consensus.cc:2804] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.517307 31061 catalog_manager.cc:5697] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 1 to 2, leader changed from f0a8e9ab56a748fb844732263905dceb (127.21.67.195) to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.518873 31466 raft_consensus.cc:697] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:25.520049 31466 consensus_queue.cc:237] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.532588 31062 catalog_manager.cc:5697] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 reported cstate change: term changed from 1 to 2, leader changed from a3e7169f66e0460a89e763a4889de629 (127.21.67.194) to 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.585923 31466 consensus_queue.cc:1048] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.592139 31504 raft_consensus.cc:993] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: : Instructing follower a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:25.592581 31467 raft_consensus.cc:1081] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Signalling peer a3e7169f66e0460a89e763a4889de629 to start an election
I20260709 13:12:25.594211 31239 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
 from {username='slave'} at 127.0.0.1:51282
I20260709 13:12:25.595358 31239 raft_consensus.cc:493] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.596114 31239 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.597822 31504 consensus_queue.cc:1048] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.602137 31239 raft_consensus.cc:515] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.605849 31312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
I20260709 13:12:25.605643 31239 leader_election.cc:290] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), f0a8e9ab56a748fb844732263905dceb (127.21.67.195:42053)
I20260709 13:12:25.610329 31163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "a3e7169f66e0460a89e763a4889de629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:25.610961 31163 raft_consensus.cc:3055] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.611253 31163 raft_consensus.cc:740] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:25.612104 31163 consensus_queue.cc:260] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.613210 31163 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.619963 31163 raft_consensus.cc:2468] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3e7169f66e0460a89e763a4889de629 in term 2.
I20260709 13:12:25.621147 31205 leader_election.cc:304] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, a3e7169f66e0460a89e763a4889de629; no voters: f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:25.622294 31486 raft_consensus.cc:2804] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.622736 31486 raft_consensus.cc:697] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Becoming Leader. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:25.623546 31486 consensus_queue.cc:237] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:25.629408 31061 catalog_manager.cc:5697] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 reported cstate change: term changed from 1 to 2, leader changed from 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193) to a3e7169f66e0460a89e763a4889de629 (127.21.67.194). New cstate: current_term: 2 leader_uuid: "a3e7169f66e0460a89e763a4889de629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.777390 31163 raft_consensus.cc:1275] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.778501 31468 consensus_queue.cc:1048] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.785341 31238 raft_consensus.cc:1275] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.786680 31442 consensus_queue.cc:1048] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.828462 31239 raft_consensus.cc:1275] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.829016 31312 raft_consensus.cc:3060] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.829676 31504 consensus_queue.cc:1048] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.835829 31312 raft_consensus.cc:1275] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.837375 31504 consensus_queue.cc:1048] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.949353 31165 raft_consensus.cc:1275] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.950459 31486 consensus_queue.cc:1048] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.952765 31312 raft_consensus.cc:1275] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.954120 31467 consensus_queue.cc:1048] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.960323 31314 raft_consensus.cc:1275] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.964273 31486 consensus_queue.cc:1048] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:25.966356 31239 raft_consensus.cc:1275] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.967891 31467 consensus_queue.cc:1048] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:26.106513 31313 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.109365 31314 raft_consensus.cc:3060] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.111790 31313 raft_consensus.cc:1275] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:26.113154 31486 consensus_queue.cc:1048] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:26.114691 31314 raft_consensus.cc:1275] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:26.116204 31504 consensus_queue.cc:1048] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.121057 31165 raft_consensus.cc:1275] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer a3e7169f66e0460a89e763a4889de629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:26.122452 31475 consensus_queue.cc:1048] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:26.129164 31239 raft_consensus.cc:1275] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer 71b91eceb00143eaa8f88b0ae6297bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:26.130584 31467 consensus_queue.cc:1048] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.266871 31062 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36280:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:12:28.295423 31062 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36280:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:12:28.421033 21775 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:12:28.474493 31557 tablet.cc:1724] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:28.530078 31562 log.cc:927] Time spent T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:12:28.545769 31567 tablet.cc:1724] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:28.571821 31543 log.cc:927] Time spent T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
W20260709 13:12:28.600942 31191 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:81dafbca974840de85ec434eccd86283)
W20260709 13:12:28.596194 31548 log.cc:927] Time spent T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: Append to log took a long time: real 0.138s	user 0.002s	sys 0.002s
W20260709 13:12:28.605707 31191 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:81dafbca974840de85ec434eccd86283)
W20260709 13:12:28.607497 31191 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:81dafbca974840de85ec434eccd86283)
W20260709 13:12:28.619251 31560 log.cc:927] Time spent T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: Append to log took a long time: real 0.142s	user 0.002s	sys 0.003s
I20260709 13:12:28.659950 31571 tablet.cc:1724] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.663475 31573 tablet.cc:1724] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.692903 31580 tablet.cc:1724] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.700541 31582 tablet.cc:1724] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.719063 31587 tablet.cc:1724] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.720459 31584 tablet.cc:1724] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.730270 31571 tablet.cc:1724] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.735785 31567 tablet.cc:1724] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.741164 31557 tablet.cc:1724] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.745029 31573 tablet.cc:1724] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.749993 31585 tablet.cc:1724] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.765275 31580 tablet.cc:1724] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.803112 31573 tablet.cc:1724] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.816902 31557 tablet.cc:1724] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:28.848526 31205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.193:42015, user_credentials={real_user=slave}} blocked reactor thread for 79030.7us
I20260709 13:12:28.851125 31593 tablet.cc:1724] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:28.857228 31206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:42053, user_credentials={real_user=slave}} blocked reactor thread for 68400.3us
I20260709 13:12:28.856493 31591 tablet.cc:1724] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.868685 31585 tablet.cc:1724] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.833669 31571 tablet.cc:1724] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.874112 31567 tablet.cc:1724] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.876586 31590 tablet.cc:1724] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.878373 31587 tablet.cc:1724] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.879738 31584 tablet.cc:1724] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.880380 31164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
mode: GRACEFUL
new_leader_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:34208
I20260709 13:12:28.883575 31164 raft_consensus.cc:606] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Received request to transfer leadership to TS f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:28.900772 31593 tablet.cc:1724] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.914889 31591 tablet.cc:1724] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.916486 31584 tablet.cc:1724] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:28.943781 31240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
mode: GRACEFUL
new_leader_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:12:28.944422 31240 raft_consensus.cc:606] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Received request to transfer leadership to TS f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:28.946590 21775 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:12:28.947480 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:28.951152 31062 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929: soft_deleted_table [id=4e315203288445598156bf9778e7417c] alter complete (version 1)
I20260709 13:12:28.958556 31240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8"
dest_uuid: "a3e7169f66e0460a89e763a4889de629"
mode: GRACEFUL
new_leader_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:12:28.959142 31240 raft_consensus.cc:606] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Received request to transfer leadership to TS f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:28.965216 31164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb"
dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
mode: GRACEFUL
new_leader_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:34208
I20260709 13:12:28.965811 31164 raft_consensus.cc:606] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Received request to transfer leadership to TS f0a8e9ab56a748fb844732263905dceb
I20260709 13:12:28.967536 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:28.968214 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:28.968323 31550 raft_consensus.cc:993] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5: : Instructing follower f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:28.969048 31551 raft_consensus.cc:1081] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Signalling peer f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:28.970594 31310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:51190
I20260709 13:12:28.971067 31310 raft_consensus.cc:493] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.971423 31310 raft_consensus.cc:3060] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.977217 31310 raft_consensus.cc:515] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:28.978902 31310 leader_election.cc:290] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:28.979935 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:28.979930 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7d67da5aa543ccb899770e642680fb" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:28.980616 31240 raft_consensus.cc:3060] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.980649 31164 raft_consensus.cc:3055] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:28.981065 31164 raft_consensus.cc:740] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:28.981805 31164 consensus_queue.cc:260] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:28.982829 31164 raft_consensus.cc:3060] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.986631 31240 raft_consensus.cc:2468] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:28.988125 31277 leader_election.cc:304] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:28.988233 31164 raft_consensus.cc:2468] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:28.989035 31468 raft_consensus.cc:2804] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:28.989467 31468 raft_consensus.cc:697] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:28.990468 31468 consensus_queue.cc:237] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:28.997366 31062 catalog_manager.cc:5697] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 1 to 2, leader changed from 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193) to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 2 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.021471 31592 raft_consensus.cc:993] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629: : Instructing follower f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:29.021976 31522 raft_consensus.cc:1081] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Signalling peer f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:29.023190 31310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:51198
I20260709 13:12:29.023689 31310 raft_consensus.cc:493] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.024049 31310 raft_consensus.cc:3060] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.029258 31310 raft_consensus.cc:515] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.030802 31310 leader_election.cc:290] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:29.031653 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:29.031762 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e8fdd5c7764c0082f4608ea805bdf8" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:29.032328 31240 raft_consensus.cc:3055] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:29.032416 31164 raft_consensus.cc:3060] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.032630 31240 raft_consensus.cc:740] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:29.033409 31240 consensus_queue.cc:260] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.034327 31240 raft_consensus.cc:3060] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.037680 31164 raft_consensus.cc:2468] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:29.038898 31279 leader_election.cc:304] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:29.039601 31468 raft_consensus.cc:2804] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:29.039686 31240 raft_consensus.cc:2468] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:29.040181 31468 raft_consensus.cc:697] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:29.040957 31468 consensus_queue.cc:237] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.047875 31062 catalog_manager.cc:5697] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 1 to 2, leader changed from a3e7169f66e0460a89e763a4889de629 (127.21.67.194) to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 2 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.274652 31522 raft_consensus.cc:993] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: : Instructing follower f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:29.275050 31592 raft_consensus.cc:1081] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Signalling peer f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:29.276364 31310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:51198
I20260709 13:12:29.276769 31310 raft_consensus.cc:493] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.277094 31310 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.283445 31310 raft_consensus.cc:515] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.285420 31310 leader_election.cc:290] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 3 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:29.286018 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:29.286666 31164 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.286662 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd29b8bf326d4c548d0abc6baaa25df7" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:29.287348 31240 raft_consensus.cc:3055] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:29.287694 31240 raft_consensus.cc:740] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a3e7169f66e0460a89e763a4889de629, State: Running, Role: LEADER
I20260709 13:12:29.288515 31240 consensus_queue.cc:260] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.289727 31240 raft_consensus.cc:3060] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.293730 31164 raft_consensus.cc:2468] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 3.
I20260709 13:12:29.294821 31279 leader_election.cc:304] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b91eceb00143eaa8f88b0ae6297bf5, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:29.295578 31468 raft_consensus.cc:2804] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:29.296027 31468 raft_consensus.cc:697] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 3 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:29.296788 31240 raft_consensus.cc:2468] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 3.
I20260709 13:12:29.296834 31468 consensus_queue.cc:237] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.303202 31062 catalog_manager.cc:5697] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 2 to 3, leader changed from a3e7169f66e0460a89e763a4889de629 (127.21.67.194) to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 3 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.390574 31504 raft_consensus.cc:993] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: : Instructing follower f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:29.391000 31551 raft_consensus.cc:1081] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Signalling peer f0a8e9ab56a748fb844732263905dceb to start an election
I20260709 13:12:29.392270 31310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0"
dest_uuid: "f0a8e9ab56a748fb844732263905dceb"
 from {username='slave'} at 127.0.0.1:51190
I20260709 13:12:29.392753 31310 raft_consensus.cc:493] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.393070 31310 raft_consensus.cc:3060] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.398152 31310 raft_consensus.cc:515] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.399682 31310 leader_election.cc:290] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Requested vote from peers 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015), a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855)
I20260709 13:12:29.400446 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "71b91eceb00143eaa8f88b0ae6297bf5"
I20260709 13:12:29.400645 31240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5717671bf4294eb697293f22ad23b9f0" candidate_uuid: "f0a8e9ab56a748fb844732263905dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a3e7169f66e0460a89e763a4889de629"
I20260709 13:12:29.401126 31164 raft_consensus.cc:3055] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:29.401218 31240 raft_consensus.cc:3060] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.401434 31164 raft_consensus.cc:740] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b91eceb00143eaa8f88b0ae6297bf5, State: Running, Role: LEADER
I20260709 13:12:29.402325 31164 consensus_queue.cc:260] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.403510 31164 raft_consensus.cc:3060] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.407490 31240 raft_consensus.cc:2468] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:29.408489 31277 leader_election.cc:304] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3e7169f66e0460a89e763a4889de629, f0a8e9ab56a748fb844732263905dceb; no voters: 
I20260709 13:12:29.409153 31468 raft_consensus.cc:2804] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:29.409317 31164 raft_consensus.cc:2468] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a8e9ab56a748fb844732263905dceb in term 2.
I20260709 13:12:29.409651 31468 raft_consensus.cc:697] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Becoming Leader. State: Replica: f0a8e9ab56a748fb844732263905dceb, State: Running, Role: LEADER
I20260709 13:12:29.410655 31468 consensus_queue.cc:237] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } }
I20260709 13:12:29.417475 31062 catalog_manager.cc:5697] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb reported cstate change: term changed from 1 to 2, leader changed from 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193) to f0a8e9ab56a748fb844732263905dceb (127.21.67.195). New cstate: current_term: 2 leader_uuid: "f0a8e9ab56a748fb844732263905dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a8e9ab56a748fb844732263905dceb" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.436936 31164 raft_consensus.cc:1275] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:29.438102 31565 consensus_queue.cc:1048] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:29.439278 31240 raft_consensus.cc:1275] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:29.440572 31565 consensus_queue.cc:1048] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:29.460290 31240 raft_consensus.cc:1275] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:29.461992 31164 raft_consensus.cc:1275] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:29.462648 31468 consensus_queue.cc:1048] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:29.463831 31607 consensus_queue.cc:1048] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:29.857296 31164 raft_consensus.cc:1275] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 3 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:12:29.858554 31607 consensus_queue.cc:1048] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:29.866143 31240 raft_consensus.cc:1275] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 3 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:12:29.867447 31468 consensus_queue.cc:1048] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:29.932065 31240 raft_consensus.cc:1275] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:29.933140 31468 consensus_queue.cc:1048] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3e7169f66e0460a89e763a4889de629" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 43855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.940788 31164 raft_consensus.cc:1275] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Refusing update from remote peer f0a8e9ab56a748fb844732263905dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:29.942390 31565 consensus_queue.cc:1048] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b91eceb00143eaa8f88b0ae6297bf5" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:30.020257 21775 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:12:30.025231 21775 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:12:30.025573 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.030745 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:12:30.031064 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:31.058548 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
W20260709 13:12:31.083516 31279 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:12:31.087298 31279 consensus_peers.cc:597] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb -> Peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Couldn't send request to peer 71b91eceb00143eaa8f88b0ae6297bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.088145 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:31.089021 21775 tablet_replica.cc:333] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.089877 21775 raft_consensus.cc:2243] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.091333 21775 raft_consensus.cc:2272] T bd29b8bf326d4c548d0abc6baaa25df7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.093731 21775 tablet_replica.cc:333] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.094419 21775 raft_consensus.cc:2243] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:12:31.094534 31205 consensus_peers.cc:597] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 -> Peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Couldn't send request to peer 71b91eceb00143eaa8f88b0ae6297bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.095285 21775 raft_consensus.cc:2272] T 08fd5eb8f6dd4a2f81eb068463702ff3 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.097465 21775 tablet_replica.cc:333] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.098160 21775 raft_consensus.cc:2243] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.098608 21775 raft_consensus.cc:2272] T 3836060c7531403bb5d030b027f9bcfb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.100660 21775 tablet_replica.cc:333] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.101203 21775 raft_consensus.cc:2243] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.101609 21775 raft_consensus.cc:2272] T bef77dbf0ab64dbfa5714a627bee855a P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.103457 21775 tablet_replica.cc:333] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.104107 21775 raft_consensus.cc:2243] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.104544 21775 raft_consensus.cc:2272] T 927019c3eb4144cc943a7649c97e5663 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.106406 21775 tablet_replica.cc:333] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.107160 21775 raft_consensus.cc:2243] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.108085 21775 raft_consensus.cc:2272] T 9ed3d8d7977c4f2da2d51387048eedd5 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.110598 21775 tablet_replica.cc:333] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.111223 21775 raft_consensus.cc:2243] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.111605 21775 raft_consensus.cc:2272] T 5717671bf4294eb697293f22ad23b9f0 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.113605 21775 tablet_replica.cc:333] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.114094 21775 raft_consensus.cc:2243] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.114537 21775 raft_consensus.cc:2272] T 92f0e5c990ec4c848c75b34e5c349348 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.116474 21775 tablet_replica.cc:333] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.116974 21775 raft_consensus.cc:2243] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.117400 21775 raft_consensus.cc:2272] T d798d7b4296446388955b746890212e2 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.119426 21775 tablet_replica.cc:333] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.119984 21775 raft_consensus.cc:2243] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.120373 21775 raft_consensus.cc:2272] T c6e8fdd5c7764c0082f4608ea805bdf8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.122253 21775 tablet_replica.cc:333] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.122740 21775 raft_consensus.cc:2243] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.123785 21775 raft_consensus.cc:2272] T 81dafbca974840de85ec434eccd86283 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.125969 21775 tablet_replica.cc:333] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.126423 21775 raft_consensus.cc:2243] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.126785 21775 raft_consensus.cc:2272] T 14e6c50808c34cc7a21b043dbda6d8b8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.128738 21775 tablet_replica.cc:333] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.129209 21775 raft_consensus.cc:2243] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.129868 21775 raft_consensus.cc:2272] T 16be72b9a1834f5498757ccd3b508def P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.131850 21775 tablet_replica.cc:333] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.132313 21775 raft_consensus.cc:2243] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.132694 21775 raft_consensus.cc:2272] T e72b2e0b9fc54e93abff792129bdac5c P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.134603 21775 tablet_replica.cc:333] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.135073 21775 raft_consensus.cc:2243] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.135387 21775 raft_consensus.cc:2272] T ce7d67da5aa543ccb899770e642680fb P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.137266 21775 tablet_replica.cc:333] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.137938 21775 raft_consensus.cc:2243] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.138340 21775 raft_consensus.cc:2272] T 0d3e2c0967504d068f43a5bd54afaab8 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.140192 21775 tablet_replica.cc:333] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.140672 21775 raft_consensus.cc:2243] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.141371 21775 raft_consensus.cc:2272] T 35cf3750f8cd44cf99196d3c4979d082 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.143244 21775 tablet_replica.cc:333] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5: stopping tablet replica
I20260709 13:12:31.143642 21775 raft_consensus.cc:2243] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.144491 21775 raft_consensus.cc:2272] T 9ede478f186444a5a29c33a4d8b932a7 P 71b91eceb00143eaa8f88b0ae6297bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:31.169633 31205 consensus_peers.cc:597] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 -> Peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Couldn't send request to peer 71b91eceb00143eaa8f88b0ae6297bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:31.171095 31131 connection.cc:466] server connection from 127.0.0.1:58452 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 168) could send its response
W20260709 13:12:31.172181 31205 consensus_peers.cc:597] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 -> Peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Couldn't send request to peer 71b91eceb00143eaa8f88b0ae6297bf5. Status: Network error: recv got EOF from 127.21.67.193:42015 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.185738 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
I20260709 13:12:31.220557 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
W20260709 13:12:31.245517 31277 consensus_peers.cc:597] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb -> Peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Couldn't send request to peer a3e7169f66e0460a89e763a4889de629. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.248159 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:31.250845 21775 tablet_replica.cc:333] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.251524 21775 raft_consensus.cc:2243] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.252089 21775 raft_consensus.cc:2272] T bd29b8bf326d4c548d0abc6baaa25df7 P a3e7169f66e0460a89e763a4889de629 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:31.252261 31279 consensus_peers.cc:597] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb -> Peer 71b91eceb00143eaa8f88b0ae6297bf5 (127.21.67.193:42015): Couldn't send request to peer 71b91eceb00143eaa8f88b0ae6297bf5. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:42015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.254122 21775 tablet_replica.cc:333] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.254808 21775 raft_consensus.cc:2243] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.255244 21775 raft_consensus.cc:2272] T 3836060c7531403bb5d030b027f9bcfb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.257103 21775 tablet_replica.cc:333] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.257679 21775 raft_consensus.cc:2243] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.258484 21775 raft_consensus.cc:2272] T 92f0e5c990ec4c848c75b34e5c349348 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.260522 21775 tablet_replica.cc:333] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.261049 21775 raft_consensus.cc:2243] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.261714 21775 raft_consensus.cc:2272] T 927019c3eb4144cc943a7649c97e5663 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.263613 21775 tablet_replica.cc:333] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.264160 21775 raft_consensus.cc:2243] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.264827 21775 raft_consensus.cc:2272] T bef77dbf0ab64dbfa5714a627bee855a P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.266578 21775 tablet_replica.cc:333] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.267072 21775 raft_consensus.cc:2243] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.267809 21775 raft_consensus.cc:2272] T e72b2e0b9fc54e93abff792129bdac5c P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.269695 21775 tablet_replica.cc:333] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.270190 21775 raft_consensus.cc:2243] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.270561 21775 raft_consensus.cc:2272] T 9ed3d8d7977c4f2da2d51387048eedd5 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.272368 21775 tablet_replica.cc:333] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.272857 21775 raft_consensus.cc:2243] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.273227 21775 raft_consensus.cc:2272] T 5717671bf4294eb697293f22ad23b9f0 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.274832 21775 tablet_replica.cc:333] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.275271 21775 raft_consensus.cc:2243] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.275620 21775 raft_consensus.cc:2272] T 81dafbca974840de85ec434eccd86283 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.277344 21775 tablet_replica.cc:333] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.277917 21775 raft_consensus.cc:2243] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.278349 21775 raft_consensus.cc:2272] T 16be72b9a1834f5498757ccd3b508def P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.280162 21775 tablet_replica.cc:333] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.280658 21775 raft_consensus.cc:2243] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.281397 21775 raft_consensus.cc:2272] T 14e6c50808c34cc7a21b043dbda6d8b8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.283195 21775 tablet_replica.cc:333] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.283735 21775 raft_consensus.cc:2243] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.284124 21775 raft_consensus.cc:2272] T 08fd5eb8f6dd4a2f81eb068463702ff3 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.285825 21775 tablet_replica.cc:333] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.286266 21775 raft_consensus.cc:2243] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.286931 21775 raft_consensus.cc:2272] T d798d7b4296446388955b746890212e2 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.288717 21775 tablet_replica.cc:333] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.289156 21775 raft_consensus.cc:2243] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.289501 21775 raft_consensus.cc:2272] T ce7d67da5aa543ccb899770e642680fb P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.291213 21775 tablet_replica.cc:333] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.291757 21775 raft_consensus.cc:2243] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.292112 21775 raft_consensus.cc:2272] T c6e8fdd5c7764c0082f4608ea805bdf8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.293885 21775 tablet_replica.cc:333] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.294335 21775 raft_consensus.cc:2243] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.294719 21775 raft_consensus.cc:2272] T 0d3e2c0967504d068f43a5bd54afaab8 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.296602 21775 tablet_replica.cc:333] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.297009 21775 raft_consensus.cc:2243] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.297355 21775 raft_consensus.cc:2272] T 35cf3750f8cd44cf99196d3c4979d082 P a3e7169f66e0460a89e763a4889de629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.299104 21775 tablet_replica.cc:333] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629: stopping tablet replica
I20260709 13:12:31.299499 21775 raft_consensus.cc:2243] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.299885 21775 raft_consensus.cc:2272] T 9ede478f186444a5a29c33a4d8b932a7 P a3e7169f66e0460a89e763a4889de629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.339071 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
I20260709 13:12:31.370539 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
W20260709 13:12:31.399526 31277 consensus_peers.cc:597] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb -> Peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Couldn't send request to peer a3e7169f66e0460a89e763a4889de629. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:43855: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:31.402172 31277 consensus_peers.cc:597] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb -> Peer a3e7169f66e0460a89e763a4889de629 (127.21.67.194:43855): Couldn't send request to peer a3e7169f66e0460a89e763a4889de629. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:43855: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.403329 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:31.404093 21775 tablet_replica.cc:333] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.404815 21775 raft_consensus.cc:2243] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.405561 21775 raft_consensus.cc:2272] T bd29b8bf326d4c548d0abc6baaa25df7 P f0a8e9ab56a748fb844732263905dceb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.407430 21775 tablet_replica.cc:333] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.408059 21775 raft_consensus.cc:2243] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.408906 21775 raft_consensus.cc:2272] T 3836060c7531403bb5d030b027f9bcfb P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.411075 21775 tablet_replica.cc:333] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.411720 21775 raft_consensus.cc:2243] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.412145 21775 raft_consensus.cc:2272] T 92f0e5c990ec4c848c75b34e5c349348 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.414007 21775 tablet_replica.cc:333] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.414572 21775 raft_consensus.cc:2243] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.414984 21775 raft_consensus.cc:2272] T 927019c3eb4144cc943a7649c97e5663 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.416798 21775 tablet_replica.cc:333] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.417308 21775 raft_consensus.cc:2243] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.417779 21775 raft_consensus.cc:2272] T bef77dbf0ab64dbfa5714a627bee855a P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.419734 21775 tablet_replica.cc:333] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.420277 21775 raft_consensus.cc:2243] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.420701 21775 raft_consensus.cc:2272] T 08fd5eb8f6dd4a2f81eb068463702ff3 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.422546 21775 tablet_replica.cc:333] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.423086 21775 raft_consensus.cc:2243] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.423525 21775 raft_consensus.cc:2272] T 81dafbca974840de85ec434eccd86283 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.425326 21775 tablet_replica.cc:333] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.425858 21775 raft_consensus.cc:2243] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.426275 21775 raft_consensus.cc:2272] T 16be72b9a1834f5498757ccd3b508def P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.428242 21775 tablet_replica.cc:333] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.428763 21775 raft_consensus.cc:2243] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.429194 21775 raft_consensus.cc:2272] T 14e6c50808c34cc7a21b043dbda6d8b8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.431058 21775 tablet_replica.cc:333] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.431594 21775 raft_consensus.cc:2243] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.432376 21775 raft_consensus.cc:2272] T 5717671bf4294eb697293f22ad23b9f0 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.434140 21775 tablet_replica.cc:333] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.434655 21775 raft_consensus.cc:2243] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.435077 21775 raft_consensus.cc:2272] T 9ed3d8d7977c4f2da2d51387048eedd5 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.436796 21775 tablet_replica.cc:333] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.437292 21775 raft_consensus.cc:2243] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.437728 21775 raft_consensus.cc:2272] T e72b2e0b9fc54e93abff792129bdac5c P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.439594 21775 tablet_replica.cc:333] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.440137 21775 raft_consensus.cc:2243] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.440876 21775 raft_consensus.cc:2272] T c6e8fdd5c7764c0082f4608ea805bdf8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.442627 21775 tablet_replica.cc:333] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.443092 21775 raft_consensus.cc:2243] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.443529 21775 raft_consensus.cc:2272] T d798d7b4296446388955b746890212e2 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.445329 21775 tablet_replica.cc:333] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.445824 21775 raft_consensus.cc:2243] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.446540 21775 raft_consensus.cc:2272] T ce7d67da5aa543ccb899770e642680fb P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.448312 21775 tablet_replica.cc:333] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.448804 21775 raft_consensus.cc:2243] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.449520 21775 raft_consensus.cc:2272] T 0d3e2c0967504d068f43a5bd54afaab8 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.451332 21775 tablet_replica.cc:333] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.451820 21775 raft_consensus.cc:2243] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.452286 21775 raft_consensus.cc:2272] T 9ede478f186444a5a29c33a4d8b932a7 P f0a8e9ab56a748fb844732263905dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.454128 21775 tablet_replica.cc:333] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb: stopping tablet replica
I20260709 13:12:31.454566 21775 raft_consensus.cc:2243] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.454967 21775 raft_consensus.cc:2272] T 35cf3750f8cd44cf99196d3c4979d082 P f0a8e9ab56a748fb844732263905dceb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.491896 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:12:31.524799 21775 master.cc:562] Master@127.21.67.254:32829 shutting down...
I20260709 13:12:31.549896 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.550418 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.550741 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P c0919fef666d4019b324c5ece4b47929: stopping tablet replica
I20260709 13:12:31.570425 21775 master.cc:584] Master@127.21.67.254:32829 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12233 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:12:31.621464 21775 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.67.254:42149
I20260709 13:12:31.622519 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:31.628027 31619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:31.628131 31620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:31.629175 31622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:31.629632 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:31.632282 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:31.632460 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:31.632570 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602751632559 us; error 0 us; skew 500 ppm
I20260709 13:12:31.632994 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:31.635097 21775 webserver.cc:533] Webserver started at http://127.21.67.254:37043/ using document root <none> and password file <none>
I20260709 13:12:31.635501 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:31.635777 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:31.636004 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:31.636960 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/master-0-root/instance:
uuid: "d1fe50de32524dd1ae081a3305911a2b"
format_stamp: "Formatted at 2026-07-09 13:12:31 on dist-test-slave-zkvt"
I20260709 13:12:31.640933 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:31.643935 31627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:31.644606 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:31.644865 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/master-0-root
uuid: "d1fe50de32524dd1ae081a3305911a2b"
format_stamp: "Formatted at 2026-07-09 13:12:31 on dist-test-slave-zkvt"
I20260709 13:12:31.645103 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:31.655896 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:31.656983 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:31.693182 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.254:42149
I20260709 13:12:31.693295 31678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.254:42149 every 8 connection(s)
I20260709 13:12:31.696929 31679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.707412 31679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b: Bootstrap starting.
I20260709 13:12:31.712112 31679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.715899 31679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b: No bootstrap required, opened a new log
I20260709 13:12:31.717878 31679 raft_consensus.cc:359] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1fe50de32524dd1ae081a3305911a2b" member_type: VOTER }
I20260709 13:12:31.718236 31679 raft_consensus.cc:385] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.718410 31679 raft_consensus.cc:740] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1fe50de32524dd1ae081a3305911a2b, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.718876 31679 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1fe50de32524dd1ae081a3305911a2b" member_type: VOTER }
I20260709 13:12:31.719261 31679 raft_consensus.cc:399] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:31.719440 31679 raft_consensus.cc:493] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:31.719630 31679 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.723789 31679 raft_consensus.cc:515] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1fe50de32524dd1ae081a3305911a2b" member_type: VOTER }
I20260709 13:12:31.724225 31679 leader_election.cc:304] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1fe50de32524dd1ae081a3305911a2b; no voters: 
I20260709 13:12:31.725189 31679 leader_election.cc:290] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:31.725481 31682 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:31.726744 31682 raft_consensus.cc:697] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 1 LEADER]: Becoming Leader. State: Replica: d1fe50de32524dd1ae081a3305911a2b, State: Running, Role: LEADER
I20260709 13:12:31.727394 31682 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1fe50de32524dd1ae081a3305911a2b" member_type: VOTER }
I20260709 13:12:31.728107 31679 sys_catalog.cc:565] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:31.731848 31683 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1fe50de32524dd1ae081a3305911a2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1fe50de32524dd1ae081a3305911a2b" member_type: VOTER } }
I20260709 13:12:31.732218 31684 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1fe50de32524dd1ae081a3305911a2b. Latest consensus state: current_term: 1 leader_uuid: "d1fe50de32524dd1ae081a3305911a2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1fe50de32524dd1ae081a3305911a2b" member_type: VOTER } }
I20260709 13:12:31.732571 31683 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:31.732771 31684 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:31.735389 31689 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:31.743211 31689 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:31.744177 21775 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:31.751507 31689 catalog_manager.cc:1383] Generated new cluster ID: a6a9c689af5e4874aaaab564c520ec2c
I20260709 13:12:31.751754 31689 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:31.774375 31689 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:31.775552 31689 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:31.786513 31689 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b: Generated new TSK 0
I20260709 13:12:31.786985 31689 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:31.810638 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:31.816737 31700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:31.817795 31701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:31.819423 31703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:31.822511 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:31.824115 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:31.824304 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:31.824502 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602751824460 us; error 0 us; skew 500 ppm
I20260709 13:12:31.825044 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:31.827095 21775 webserver.cc:533] Webserver started at http://127.21.67.193:44667/ using document root <none> and password file <none>
I20260709 13:12:31.827560 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:31.827788 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:31.828048 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:31.829077 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-0-root/instance:
uuid: "bea62f58c7024abea16d17ee5ff2da99"
format_stamp: "Formatted at 2026-07-09 13:12:31 on dist-test-slave-zkvt"
I20260709 13:12:31.833261 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:12:31.836179 31708 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:31.836843 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:31.837139 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-0-root
uuid: "bea62f58c7024abea16d17ee5ff2da99"
format_stamp: "Formatted at 2026-07-09 13:12:31 on dist-test-slave-zkvt"
I20260709 13:12:31.837406 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:31.854518 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:31.855664 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:31.857061 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:31.859136 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:31.859338 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:31.859570 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:31.859763 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:12:31.897325 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.193:35355
I20260709 13:12:31.897430 31770 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.193:35355 every 8 connection(s)
I20260709 13:12:31.902479 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:31.909524 31775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:31.911535 31776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:31.913344 31778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:31.916060 31771 heartbeater.cc:344] Connected to a master server at 127.21.67.254:42149
I20260709 13:12:31.916528 31771 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:31.917398 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:31.917550 31771 heartbeater.cc:507] Master 127.21.67.254:42149 requested a full tablet report, sending...
I20260709 13:12:31.918843 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:31.919065 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:31.919255 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602751919238 us; error 0 us; skew 500 ppm
I20260709 13:12:31.919893 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:31.920152 31644 ts_manager.cc:194] Registered new tserver with Master: bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355)
I20260709 13:12:31.922325 21775 webserver.cc:533] Webserver started at http://127.21.67.194:39931/ using document root <none> and password file <none>
I20260709 13:12:31.922785 31644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54278
I20260709 13:12:31.922873 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:31.923280 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:31.923570 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:31.924901 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-1-root/instance:
uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
format_stamp: "Formatted at 2026-07-09 13:12:31 on dist-test-slave-zkvt"
I20260709 13:12:31.929337 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:31.932577 31783 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:31.933302 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:31.933590 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-1-root
uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
format_stamp: "Formatted at 2026-07-09 13:12:31 on dist-test-slave-zkvt"
I20260709 13:12:31.933863 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:31.943928 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:31.945016 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:31.946466 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:31.948568 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:31.948799 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:31.949036 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:31.949209 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:31.987180 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.194:38253
I20260709 13:12:31.987282 31845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.194:38253 every 8 connection(s)
I20260709 13:12:31.991958 21775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:31.998133 31849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:31.999787 31850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:32.001214 31852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:32.001948 21775 server_base.cc:1061] running on GCE node
I20260709 13:12:32.002781 31846 heartbeater.cc:344] Connected to a master server at 127.21.67.254:42149
I20260709 13:12:32.003069 21775 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:32.003194 31846 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:32.003372 21775 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:32.003607 21775 hybrid_clock.cc:648] HybridClock initialized: now 1783602752003588 us; error 0 us; skew 500 ppm
I20260709 13:12:32.004127 31846 heartbeater.cc:507] Master 127.21.67.254:42149 requested a full tablet report, sending...
I20260709 13:12:32.004396 21775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:32.006350 31644 ts_manager.cc:194] Registered new tserver with Master: bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:32.006960 21775 webserver.cc:533] Webserver started at http://127.21.67.195:32839/ using document root <none> and password file <none>
I20260709 13:12:32.007480 21775 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:32.007720 21775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:32.007858 31644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54284
I20260709 13:12:32.008006 21775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:32.009488 21775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-2-root/instance:
uuid: "65621217b5b7487f947e8cf35abb03e0"
format_stamp: "Formatted at 2026-07-09 13:12:32 on dist-test-slave-zkvt"
I20260709 13:12:32.013823 21775 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:32.016904 31857 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:32.017601 21775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:32.017884 21775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-2-root
uuid: "65621217b5b7487f947e8cf35abb03e0"
format_stamp: "Formatted at 2026-07-09 13:12:32 on dist-test-slave-zkvt"
I20260709 13:12:32.018146 21775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_OHg0z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602470215473-21775-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:32.035785 21775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:32.036958 21775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:32.038336 21775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:32.040545 21775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:32.040710 21775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:32.040995 21775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:32.041150 21775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:32.079244 21775 rpc_server.cc:307] RPC server started. Bound to: 127.21.67.195:45255
I20260709 13:12:32.079339 31919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.67.195:45255 every 8 connection(s)
I20260709 13:12:32.092135 31920 heartbeater.cc:344] Connected to a master server at 127.21.67.254:42149
I20260709 13:12:32.092588 31920 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:32.093283 31920 heartbeater.cc:507] Master 127.21.67.254:42149 requested a full tablet report, sending...
I20260709 13:12:32.095060 31644 ts_manager.cc:194] Registered new tserver with Master: 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.095816 21775 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013434178s
I20260709 13:12:32.096402 31644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54300
I20260709 13:12:32.118954 31644 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54306:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:32.121627 31644 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:32.186972 31811 tablet_service.cc:1511] Processing CreateTablet for tablet d3bf0d653caa4e7788fb5a3a573cac75 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:32.188548 31811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bf0d653caa4e7788fb5a3a573cac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.192474 31810 tablet_service.cc:1511] Processing CreateTablet for tablet 8862505b4bc84982b8da0d0ca08acaae (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:32.193943 31810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8862505b4bc84982b8da0d0ca08acaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.195753 31809 tablet_service.cc:1511] Processing CreateTablet for tablet b800469e506e4ca5bf477e2d3a3f58ff (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:32.197170 31809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b800469e506e4ca5bf477e2d3a3f58ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.214825 31808 tablet_service.cc:1511] Processing CreateTablet for tablet 372fb0be4269425288939f7776ff0767 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:32.216782 31808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372fb0be4269425288939f7776ff0767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.226289 31885 tablet_service.cc:1511] Processing CreateTablet for tablet d3bf0d653caa4e7788fb5a3a573cac75 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:32.226692 31807 tablet_service.cc:1511] Processing CreateTablet for tablet cac5ecff68444a5783240e5e35c7c4ca (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:32.227728 31885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bf0d653caa4e7788fb5a3a573cac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.228380 31807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac5ecff68444a5783240e5e35c7c4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.238407 31883 tablet_service.cc:1511] Processing CreateTablet for tablet b800469e506e4ca5bf477e2d3a3f58ff (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:32.239748 31883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b800469e506e4ca5bf477e2d3a3f58ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.244234 31884 tablet_service.cc:1511] Processing CreateTablet for tablet 8862505b4bc84982b8da0d0ca08acaae (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:32.250880 31884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8862505b4bc84982b8da0d0ca08acaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.252238 31806 tablet_service.cc:1511] Processing CreateTablet for tablet 47c876f874224fbbb54617d8a4598b77 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:32.253031 31732 tablet_service.cc:1511] Processing CreateTablet for tablet cac5ecff68444a5783240e5e35c7c4ca (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:32.254271 31806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c876f874224fbbb54617d8a4598b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.255574 31735 tablet_service.cc:1511] Processing CreateTablet for tablet 8862505b4bc84982b8da0d0ca08acaae (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:32.257581 31734 tablet_service.cc:1511] Processing CreateTablet for tablet b800469e506e4ca5bf477e2d3a3f58ff (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:32.254455 31732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac5ecff68444a5783240e5e35c7c4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.260620 31733 tablet_service.cc:1511] Processing CreateTablet for tablet 372fb0be4269425288939f7776ff0767 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:32.244335 31736 tablet_service.cc:1511] Processing CreateTablet for tablet d3bf0d653caa4e7788fb5a3a573cac75 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:32.265878 31935 tablet_bootstrap.cc:492] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.266217 31730 tablet_service.cc:1511] Processing CreateTablet for tablet 47c876f874224fbbb54617d8a4598b77 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:32.259541 31731 tablet_service.cc:1511] Processing CreateTablet for tablet 96ba567cb7dc46c0907c9346ba85ce94 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:32.268106 31735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8862505b4bc84982b8da0d0ca08acaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.271950 31935 tablet_bootstrap.cc:654] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.271965 31733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372fb0be4269425288939f7776ff0767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.275491 31731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ba567cb7dc46c0907c9346ba85ce94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.276103 31730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c876f874224fbbb54617d8a4598b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.276716 31736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bf0d653caa4e7788fb5a3a573cac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.279943 31734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b800469e506e4ca5bf477e2d3a3f58ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.292094 31936 tablet_bootstrap.cc:492] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.296622 31885 tablet_service.cc:1511] Processing CreateTablet for tablet 372fb0be4269425288939f7776ff0767 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:32.297927 31885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372fb0be4269425288939f7776ff0767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.301874 31729 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbca3802d824aadba6ef70655e16a1d (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:32.303202 31729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbca3802d824aadba6ef70655e16a1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.305138 31882 tablet_service.cc:1511] Processing CreateTablet for tablet cac5ecff68444a5783240e5e35c7c4ca (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:32.306432 31882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac5ecff68444a5783240e5e35c7c4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.309116 31881 tablet_service.cc:1511] Processing CreateTablet for tablet 96ba567cb7dc46c0907c9346ba85ce94 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:32.310277 31881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ba567cb7dc46c0907c9346ba85ce94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.313592 31879 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbca3802d824aadba6ef70655e16a1d (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:32.314905 31879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbca3802d824aadba6ef70655e16a1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.318022 31880 tablet_service.cc:1511] Processing CreateTablet for tablet 47c876f874224fbbb54617d8a4598b77 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:32.319267 31880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c876f874224fbbb54617d8a4598b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.264133 31811 tablet_service.cc:1511] Processing CreateTablet for tablet 96ba567cb7dc46c0907c9346ba85ce94 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:32.321412 31811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ba567cb7dc46c0907c9346ba85ce94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.340595 31936 tablet_bootstrap.cc:654] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.357061 31878 tablet_service.cc:1511] Processing CreateTablet for tablet 0f8bea6824254217bef7c7d9f07bf0b6 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:32.358462 31878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f8bea6824254217bef7c7d9f07bf0b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.360957 31734 tablet_service.cc:1511] Processing CreateTablet for tablet 0f8bea6824254217bef7c7d9f07bf0b6 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:32.361182 31806 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbca3802d824aadba6ef70655e16a1d (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:32.362175 31734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f8bea6824254217bef7c7d9f07bf0b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.362357 31806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbca3802d824aadba6ef70655e16a1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.371284 31938 tablet_bootstrap.cc:492] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.376605 31808 tablet_service.cc:1511] Processing CreateTablet for tablet 0f8bea6824254217bef7c7d9f07bf0b6 (DEFAULT_TABLE table=test-workload [id=9aec87f0044641798f934c1fd2a6d1bc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:32.377877 31808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f8bea6824254217bef7c7d9f07bf0b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.378921 31935 tablet_bootstrap.cc:492] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.379504 31935 ts_tablet_manager.cc:1403] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.114s	user 0.028s	sys 0.046s
I20260709 13:12:32.382496 31935 raft_consensus.cc:359] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.391790 31935 raft_consensus.cc:385] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.392171 31935 raft_consensus.cc:740] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.393203 31935 consensus_queue.cc:260] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.395023 31938 tablet_bootstrap.cc:654] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.427073 31846 heartbeater.cc:499] Master 127.21.67.254:42149 was elected leader, sending a full tablet report...
I20260709 13:12:32.427453 31935 ts_tablet_manager.cc:1434] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.048s	user 0.018s	sys 0.010s
I20260709 13:12:32.428418 31935 tablet_bootstrap.cc:492] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.433516 31935 tablet_bootstrap.cc:654] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.437592 31938 tablet_bootstrap.cc:492] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.438105 31938 ts_tablet_manager.cc:1403] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.007s
I20260709 13:12:32.440892 31938 raft_consensus.cc:359] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.441617 31938 raft_consensus.cc:385] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.441936 31938 raft_consensus.cc:740] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.442821 31938 consensus_queue.cc:260] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.458788 31935 tablet_bootstrap.cc:492] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.459349 31935 ts_tablet_manager.cc:1403] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.016s
I20260709 13:12:32.460996 31771 heartbeater.cc:499] Master 127.21.67.254:42149 was elected leader, sending a full tablet report...
I20260709 13:12:32.462438 31935 raft_consensus.cc:359] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.463147 31935 raft_consensus.cc:385] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.463436 31935 raft_consensus.cc:740] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.464134 31935 consensus_queue.cc:260] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.464772 31936 tablet_bootstrap.cc:492] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.465292 31936 ts_tablet_manager.cc:1403] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.173s	user 0.018s	sys 0.047s
I20260709 13:12:32.466082 31938 ts_tablet_manager.cc:1434] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:12:32.466250 31935 ts_tablet_manager.cc:1434] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:32.467212 31938 tablet_bootstrap.cc:492] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.467312 31935 tablet_bootstrap.cc:492] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.474117 31935 tablet_bootstrap.cc:654] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.474198 31938 tablet_bootstrap.cc:654] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.477469 31936 raft_consensus.cc:359] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.483094 31936 raft_consensus.cc:385] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.483775 31936 raft_consensus.cc:740] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.485001 31936 consensus_queue.cc:260] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.485836 31938 tablet_bootstrap.cc:492] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.487402 31938 ts_tablet_manager.cc:1403] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 13:12:32.487931 31920 heartbeater.cc:499] Master 127.21.67.254:42149 was elected leader, sending a full tablet report...
I20260709 13:12:32.492714 31938 raft_consensus.cc:359] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.493706 31938 raft_consensus.cc:385] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.494096 31938 raft_consensus.cc:740] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.495008 31938 consensus_queue.cc:260] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.496937 31936 ts_tablet_manager.cc:1434] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.005s
I20260709 13:12:32.498085 31936 tablet_bootstrap.cc:492] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.498402 31938 ts_tablet_manager.cc:1434] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:12:32.499743 31938 tablet_bootstrap.cc:492] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.505019 31935 tablet_bootstrap.cc:492] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.505605 31935 ts_tablet_manager.cc:1403] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.015s
I20260709 13:12:32.505677 31936 tablet_bootstrap.cc:654] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.508803 31938 tablet_bootstrap.cc:654] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.508754 31935 raft_consensus.cc:359] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.509594 31935 raft_consensus.cc:385] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.509946 31935 raft_consensus.cc:740] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.510747 31935 consensus_queue.cc:260] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.512867 31936 tablet_bootstrap.cc:492] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.513427 31936 ts_tablet_manager.cc:1403] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:12:32.516332 31936 raft_consensus.cc:359] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.517076 31936 raft_consensus.cc:385] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.517469 31936 raft_consensus.cc:740] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.518366 31936 consensus_queue.cc:260] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.519577 31935 ts_tablet_manager.cc:1434] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:32.520557 31936 ts_tablet_manager.cc:1434] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:32.521590 31936 tablet_bootstrap.cc:492] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.522881 31935 tablet_bootstrap.cc:492] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.528030 31936 tablet_bootstrap.cc:654] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.529804 31935 tablet_bootstrap.cc:654] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.533393 31936 tablet_bootstrap.cc:492] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.533591 31938 tablet_bootstrap.cc:492] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.533995 31936 ts_tablet_manager.cc:1403] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:12:32.534145 31938 ts_tablet_manager.cc:1403] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.009s
I20260709 13:12:32.537148 31938 raft_consensus.cc:359] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.537415 31936 raft_consensus.cc:359] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.537906 31938 raft_consensus.cc:385] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.538189 31936 raft_consensus.cc:385] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.538239 31938 raft_consensus.cc:740] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.538602 31936 raft_consensus.cc:740] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.539150 31938 consensus_queue.cc:260] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.539857 31935 tablet_bootstrap.cc:492] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.539547 31936 consensus_queue.cc:260] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.540397 31935 ts_tablet_manager.cc:1403] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:12:32.541325 31938 ts_tablet_manager.cc:1434] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:32.542402 31938 tablet_bootstrap.cc:492] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.543437 31935 raft_consensus.cc:359] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.543972 31936 ts_tablet_manager.cc:1434] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:32.544245 31935 raft_consensus.cc:385] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.544652 31935 raft_consensus.cc:740] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.545037 31936 tablet_bootstrap.cc:492] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.545576 31935 consensus_queue.cc:260] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.549329 31938 tablet_bootstrap.cc:654] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.549569 31940 raft_consensus.cc:493] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.550034 31940 raft_consensus.cc:515] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.554728 31940 leader_election.cc:290] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.560631 31935 ts_tablet_manager.cc:1434] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:32.552100 31936 tablet_bootstrap.cc:654] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.563418 31935 tablet_bootstrap.cc:492] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.574949 31935 tablet_bootstrap.cc:654] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.576083 31936 tablet_bootstrap.cc:492] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.582049 31936 ts_tablet_manager.cc:1403] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.001s
I20260709 13:12:32.585623 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.588968 31935 tablet_bootstrap.cc:492] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.589522 31935 ts_tablet_manager.cc:1403] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.002s
I20260709 13:12:32.590637 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:32.591398 31746 raft_consensus.cc:2468] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
W20260709 13:12:32.590648 31786 leader_election.cc:343] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.592571 31935 raft_consensus.cc:359] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.593324 31935 raft_consensus.cc:385] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.593118 31784 leader_election.cc:304] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:32.593652 31935 raft_consensus.cc:740] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.594327 31940 raft_consensus.cc:2804] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.594679 31940 raft_consensus.cc:493] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.594535 31935 consensus_queue.cc:260] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.595054 31940 raft_consensus.cc:3060] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.596850 31936 raft_consensus.cc:359] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.597893 31936 raft_consensus.cc:385] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.598259 31936 raft_consensus.cc:740] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.599241 31936 consensus_queue.cc:260] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.601145 31940 raft_consensus.cc:515] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.602312 31938 tablet_bootstrap.cc:492] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.602846 31938 ts_tablet_manager.cc:1403] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.039s
I20260709 13:12:32.605135 31936 ts_tablet_manager.cc:1434] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:12:32.605700 31938 raft_consensus.cc:359] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.606426 31938 raft_consensus.cc:385] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.606753 31938 raft_consensus.cc:740] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.607731 31938 consensus_queue.cc:260] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.608289 31935 ts_tablet_manager.cc:1434] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:12:32.608335 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:32.609037 31746 raft_consensus.cc:3060] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.606225 31936 tablet_bootstrap.cc:492] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.609459 31935 tablet_bootstrap.cc:492] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.615267 31938 ts_tablet_manager.cc:1434] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:32.616267 31936 tablet_bootstrap.cc:654] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.616559 31938 tablet_bootstrap.cc:492] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.616731 31935 tablet_bootstrap.cc:654] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.623328 31938 tablet_bootstrap.cc:654] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.628069 31935 tablet_bootstrap.cc:492] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.628614 31935 ts_tablet_manager.cc:1403] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 13:12:32.632957 31936 tablet_bootstrap.cc:492] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.633564 31936 ts_tablet_manager.cc:1403] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.002s
I20260709 13:12:32.634406 31935 raft_consensus.cc:359] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.636046 31935 raft_consensus.cc:385] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.636639 31935 raft_consensus.cc:740] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.638015 31935 consensus_queue.cc:260] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.638247 31936 raft_consensus.cc:359] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.639384 31936 raft_consensus.cc:385] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.639881 31936 raft_consensus.cc:740] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.641601 31746 raft_consensus.cc:2468] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:32.643869 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.644014 31784 leader_election.cc:304] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.644505 31895 raft_consensus.cc:3060] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.645859 31940 leader_election.cc:290] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.646435 31940 raft_consensus.cc:2804] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.647171 31940 raft_consensus.cc:697] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:32.641073 31936 consensus_queue.cc:260] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.650333 31936 ts_tablet_manager.cc:1434] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:32.651559 31936 tablet_bootstrap.cc:492] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.656423 31895 raft_consensus.cc:2468] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:32.642671 31935 ts_tablet_manager.cc:1434] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:12:32.658939 31935 tablet_bootstrap.cc:492] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.659818 31936 tablet_bootstrap.cc:654] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.661015 31940 consensus_queue.cc:237] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.664475 31943 raft_consensus.cc:493] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.665180 31943 raft_consensus.cc:515] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.666368 31935 tablet_bootstrap.cc:654] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.674189 31943 leader_election.cc:290] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.674777 31936 tablet_bootstrap.cc:492] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.675414 31936 ts_tablet_manager.cc:1403] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.012s
I20260709 13:12:32.674729 31943 raft_consensus.cc:493] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.676007 31943 raft_consensus.cc:515] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.684453 31943 leader_election.cc:290] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.686340 31936 raft_consensus.cc:359] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.687088 31936 raft_consensus.cc:385] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.687364 31936 raft_consensus.cc:740] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.688824 31938 tablet_bootstrap.cc:492] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.687911 31642 catalog_manager.cc:5697] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 0 to 1, leader changed from <none> to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 1 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.689338 31938 ts_tablet_manager.cc:1403] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.025s
I20260709 13:12:32.691155 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8862505b4bc84982b8da0d0ca08acaae" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.691848 31895 raft_consensus.cc:2468] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:32.693743 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.694353 31938 raft_consensus.cc:359] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.695047 31938 raft_consensus.cc:385] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.695328 31938 raft_consensus.cc:740] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.695459 31711 leader_election.cc:304] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: 
I20260709 13:12:32.691931 31936 consensus_queue.cc:260] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.696847 31943 raft_consensus.cc:2804] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.697624 31943 raft_consensus.cc:493] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.698019 31943 raft_consensus.cc:3060] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.699293 31935 tablet_bootstrap.cc:492] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.696414 31938 consensus_queue.cc:260] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
W20260709 13:12:32.696480 31711 leader_election.cc:343] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.701396 31936 ts_tablet_manager.cc:1434] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
I20260709 13:12:32.702493 31936 tablet_bootstrap.cc:492] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.700042 31935 ts_tablet_manager.cc:1403] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.013s
I20260709 13:12:32.707264 31938 ts_tablet_manager.cc:1434] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:32.708631 31938 tablet_bootstrap.cc:492] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.711995 31935 raft_consensus.cc:359] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.713546 31935 raft_consensus.cc:385] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.714342 31935 raft_consensus.cc:740] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.715111 31935 consensus_queue.cc:260] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.716243 31943 raft_consensus.cc:515] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.717257 31935 ts_tablet_manager.cc:1434] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:32.718359 31935 tablet_bootstrap.cc:492] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.721520 31938 tablet_bootstrap.cc:654] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.719331 31936 tablet_bootstrap.cc:654] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.723712 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8862505b4bc84982b8da0d0ca08acaae" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:32.724406 31821 raft_consensus.cc:2468] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:32.724639 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8862505b4bc84982b8da0d0ca08acaae" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.726161 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8862505b4bc84982b8da0d0ca08acaae" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:32.725251 31894 raft_consensus.cc:3060] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.726814 31819 raft_consensus.cc:3060] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.729950 31943 leader_election.cc:290] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.731783 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:32.732702 31820 raft_consensus.cc:2468] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:32.734396 31935 tablet_bootstrap.cc:654] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.734457 31710 leader_election.cc:304] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:32.737804 31943 raft_consensus.cc:2804] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.738298 31943 raft_consensus.cc:493] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.738557 31819 raft_consensus.cc:2468] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:32.738787 31943 raft_consensus.cc:3060] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.741758 31710 leader_election.cc:304] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.746611 31963 raft_consensus.cc:2804] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:32.767235 31692 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:32.783031 31894 raft_consensus.cc:2468] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:32.784843 31936 tablet_bootstrap.cc:492] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.785418 31936 ts_tablet_manager.cc:1403] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.083s	user 0.042s	sys 0.023s
I20260709 13:12:32.788282 31936 raft_consensus.cc:359] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.788940 31936 raft_consensus.cc:385] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.789232 31936 raft_consensus.cc:740] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.789770 31943 raft_consensus.cc:515] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.790767 31946 raft_consensus.cc:493] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.792624 31946 raft_consensus.cc:515] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.793264 31938 tablet_bootstrap.cc:492] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.793784 31938 ts_tablet_manager.cc:1403] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.016s
I20260709 13:12:32.794732 31971 raft_consensus.cc:493] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.791987 31963 raft_consensus.cc:697] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:32.798970 31963 consensus_queue.cc:237] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.800657 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.801533 31943 leader_election.cc:290] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.795218 31946 leader_election.cc:290] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:32.790131 31936 consensus_queue.cc:260] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.804220 31894 raft_consensus.cc:3060] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.805935 31936 ts_tablet_manager.cc:1434] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:12:32.807121 31936 tablet_bootstrap.cc:492] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.797809 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:32.808000 31819 raft_consensus.cc:3060] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.814373 31938 raft_consensus.cc:359] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.815143 31938 raft_consensus.cc:385] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.813071 31971 raft_consensus.cc:515] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.815421 31938 raft_consensus.cc:740] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.818008 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:32.818307 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.818634 31820 raft_consensus.cc:2468] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:32.818990 31895 raft_consensus.cc:2468] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:32.819854 31710 leader_election.cc:304] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.820993 31972 raft_consensus.cc:2804] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.821095 31894 raft_consensus.cc:2468] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:32.821424 31972 raft_consensus.cc:493] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.821807 31972 raft_consensus.cc:3060] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.822072 31819 raft_consensus.cc:2468] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:32.827062 31943 raft_consensus.cc:493] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.828086 31710 leader_election.cc:304] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.826558 31936 tablet_bootstrap.cc:654] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.830681 31943 raft_consensus.cc:515] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.835646 31943 leader_election.cc:290] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.835858 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.836171 31943 raft_consensus.cc:2804] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.836521 31895 raft_consensus.cc:2468] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:32.837648 31943 raft_consensus.cc:697] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:32.838588 31711 leader_election.cc:304] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: 
I20260709 13:12:32.838483 31943 consensus_queue.cc:237] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.840585 31940 raft_consensus.cc:493] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.841216 31940 raft_consensus.cc:515] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.843444 31940 leader_election.cc:290] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.844842 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:32.845636 31746 raft_consensus.cc:2468] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:32.848723 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.849556 31895 raft_consensus.cc:2468] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:32.850922 31786 leader_election.cc:304] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.852046 31940 raft_consensus.cc:2804] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.852594 31940 raft_consensus.cc:493] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.852358 31938 consensus_queue.cc:260] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.853116 31940 raft_consensus.cc:3060] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.859184 31971 leader_election.cc:290] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.860349 31971 raft_consensus.cc:2804] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.860767 31971 raft_consensus.cc:493] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.864032 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:32.864008 31971 raft_consensus.cc:3060] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.866698 31972 raft_consensus.cc:515] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.867009 31956 raft_consensus.cc:493] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.867694 31956 raft_consensus.cc:515] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.869038 31935 tablet_bootstrap.cc:492] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:32.869524 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:32.870129 31820 raft_consensus.cc:3060] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.872108 31956 leader_election.cc:290] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.872816 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372fb0be4269425288939f7776ff0767" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.873657 31895 raft_consensus.cc:2468] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:32.874856 31786 leader_election.cc:304] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.875964 31956 raft_consensus.cc:2804] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.876348 31956 raft_consensus.cc:493] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.876722 31956 raft_consensus.cc:3060] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.877552 31820 raft_consensus.cc:2468] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:32.878741 31710 leader_election.cc:304] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.878827 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372fb0be4269425288939f7776ff0767" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:32.869532 31935 ts_tablet_manager.cc:1403] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.151s	user 0.024s	sys 0.039s
I20260709 13:12:32.880441 31980 raft_consensus.cc:2804] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.880967 31980 raft_consensus.cc:697] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:32.881199 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.881745 31895 raft_consensus.cc:3060] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.882782 31935 raft_consensus.cc:359] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.883519 31935 raft_consensus.cc:385] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.883922 31935 raft_consensus.cc:740] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.881767 31980 consensus_queue.cc:237] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:32.885293 31935 consensus_queue.cc:260] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.887524 31936 tablet_bootstrap.cc:492] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.879526 31938 ts_tablet_manager.cc:1434] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.008s
I20260709 13:12:32.888025 31936 ts_tablet_manager.cc:1403] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.014s
I20260709 13:12:32.888692 31938 tablet_bootstrap.cc:492] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.891070 31936 raft_consensus.cc:359] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.891743 31936 raft_consensus.cc:385] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.891794 31972 leader_election.cc:290] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.892076 31936 raft_consensus.cc:740] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.893076 31982 raft_consensus.cc:493] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.893551 31982 raft_consensus.cc:515] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.896770 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:32.897392 31894 raft_consensus.cc:2468] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:32.897018 31971 raft_consensus.cc:515] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.896883 31641 catalog_manager.cc:5697] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.898490 31786 leader_election.cc:304] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.899175 31971 leader_election.cc:290] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.899917 31936 consensus_queue.cc:260] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.900837 31895 raft_consensus.cc:2468] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:32.902635 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.903192 31894 raft_consensus.cc:3060] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:32.904012 31784 leader_election.cc:343] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.907676 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:32.909354 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:32.910048 31894 raft_consensus.cc:2468] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
W20260709 13:12:32.910312 31784 leader_election.cc:343] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.910871 31982 leader_election.cc:290] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.915311 31982 raft_consensus.cc:2804] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.915645 31982 raft_consensus.cc:493] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.915977 31982 raft_consensus.cc:3060] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.916980 31936 ts_tablet_manager.cc:1434] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:12:32.923905 31936 tablet_bootstrap.cc:492] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:32.924394 31711 leader_election.cc:304] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:32.926025 31963 raft_consensus.cc:2804] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.926694 31963 raft_consensus.cc:697] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:32.928303 31982 raft_consensus.cc:515] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.928093 31963 consensus_queue.cc:237] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.923913 31938 tablet_bootstrap.cc:654] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.929677 31936 tablet_bootstrap.cc:654] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.933394 31982 leader_election.cc:290] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.934479 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.935062 31894 raft_consensus.cc:3060] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.935618 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:32.937282 31938 tablet_bootstrap.cc:492] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.937813 31938 ts_tablet_manager.cc:1403] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.004s
I20260709 13:12:32.938216 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
W20260709 13:12:32.940274 31784 leader_election.cc:343] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.941154 31938 raft_consensus.cc:359] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.941880 31938 raft_consensus.cc:385] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.941479 31642 catalog_manager.cc:5697] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:32.943280 31894 raft_consensus.cc:2468] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:32.943655 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:32.943296 31642 catalog_manager.cc:5697] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.944913 31786 leader_election.cc:304] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:32.945035 31858 leader_election.cc:304] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0; no voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:32.945602 31956 raft_consensus.cc:515] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.946251 31946 raft_consensus.cc:2749] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.866312 31940 raft_consensus.cc:515] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.947338 31982 raft_consensus.cc:2804] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.948593 31982 raft_consensus.cc:697] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:32.949802 31819 raft_consensus.cc:2393] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bea62f58c7024abea16d17ee5ff2da99 in current term 1: Already voted for candidate bfda2baa4b9d4151bca7437a6027a1fd in this term.
I20260709 13:12:32.949440 31982 consensus_queue.cc:237] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.951215 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:32.942203 31938 raft_consensus.cc:740] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.952620 31938 consensus_queue.cc:260] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.956090 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b800469e506e4ca5bf477e2d3a3f58ff" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.956609 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372fb0be4269425288939f7776ff0767" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:32.956138 31938 ts_tablet_manager.cc:1434] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:12:32.957286 31746 raft_consensus.cc:3060] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.958185 31938 tablet_bootstrap.cc:492] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:32.956911 31894 raft_consensus.cc:2393] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bfda2baa4b9d4151bca7437a6027a1fd in current term 1: Already voted for candidate bea62f58c7024abea16d17ee5ff2da99 in this term.
I20260709 13:12:32.965041 31786 leader_election.cc:304] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:32.965906 31985 raft_consensus.cc:2749] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.966457 31940 leader_election.cc:290] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.968601 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372fb0be4269425288939f7776ff0767" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:32.970079 31894 raft_consensus.cc:3060] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.971907 31938 tablet_bootstrap.cc:654] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.973258 31642 catalog_manager.cc:5697] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 0 to 1, leader changed from <none> to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 1 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.978824 31894 raft_consensus.cc:2468] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:32.979215 31936 tablet_bootstrap.cc:492] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:32.983175 31936 ts_tablet_manager.cc:1403] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.008s
I20260709 13:12:32.983469 31935 ts_tablet_manager.cc:1434] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.104s	user 0.016s	sys 0.035s
I20260709 13:12:32.983644 31786 leader_election.cc:304] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:32.984508 31935 tablet_bootstrap.cc:492] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:32.985549 31936 raft_consensus.cc:359] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.986037 31936 raft_consensus.cc:385] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.986315 31936 raft_consensus.cc:740] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.987061 31936 consensus_queue.cc:260] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.987576 31983 raft_consensus.cc:2804] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.988488 31983 raft_consensus.cc:697] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:32.989501 31983 consensus_queue.cc:237] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.990574 31935 tablet_bootstrap.cc:654] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.981405 31938 tablet_bootstrap.cc:492] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:32.981284 31746 raft_consensus.cc:2468] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:32.969238 31956 leader_election.cc:290] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:32.991564 31936 ts_tablet_manager.cc:1434] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:12:32.992354 31938 ts_tablet_manager.cc:1403] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.002s
I20260709 13:12:32.994801 31938 raft_consensus.cc:359] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.995289 31938 raft_consensus.cc:385] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.995546 31938 raft_consensus.cc:740] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.996385 31938 consensus_queue.cc:260] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:32.999006 31938 ts_tablet_manager.cc:1434] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:33.000149 31938 tablet_bootstrap.cc:492] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:33.000538 31641 catalog_manager.cc:5697] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.006317 31938 tablet_bootstrap.cc:654] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.011524 31935 tablet_bootstrap.cc:492] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:33.012187 31935 ts_tablet_manager.cc:1403] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.001s
I20260709 13:12:33.014375 31643 catalog_manager.cc:5697] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 0 to 1, leader changed from <none> to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 1 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.015859 31935 raft_consensus.cc:359] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.016566 31935 raft_consensus.cc:385] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.016882 31935 raft_consensus.cc:740] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.017581 31938 tablet_bootstrap.cc:492] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:33.018183 31938 ts_tablet_manager.cc:1403] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 13:12:33.017597 31935 consensus_queue.cc:260] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.019814 31935 ts_tablet_manager.cc:1434] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:33.020697 31938 raft_consensus.cc:359] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.021229 31938 raft_consensus.cc:385] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.021463 31938 raft_consensus.cc:740] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.022051 31938 consensus_queue.cc:260] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.023842 31938 ts_tablet_manager.cc:1434] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:12:33.035948 31963 raft_consensus.cc:493] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.036427 31963 raft_consensus.cc:515] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.038208 31963 leader_election.cc:290] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.038928 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:33.039422 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:33.039549 31819 raft_consensus.cc:2468] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:33.040099 31894 raft_consensus.cc:2468] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:33.040693 31710 leader_election.cc:304] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:33.041356 31963 raft_consensus.cc:2804] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.041693 31963 raft_consensus.cc:493] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.041913 31963 raft_consensus.cc:3060] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.046911 31963 raft_consensus.cc:515] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.048585 31963 leader_election.cc:290] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.049151 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:33.049531 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:33.049697 31819 raft_consensus.cc:3060] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.050084 31894 raft_consensus.cc:3060] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.054396 31819 raft_consensus.cc:2468] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:33.054706 31894 raft_consensus.cc:2468] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:33.055426 31710 leader_election.cc:304] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:33.056254 31963 raft_consensus.cc:2804] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.056679 31963 raft_consensus.cc:697] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:33.057346 31963 consensus_queue.cc:237] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.065032 31642 catalog_manager.cc:5697] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.149410 31983 consensus_queue.cc:1048] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.159837 31983 consensus_queue.cc:1048] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.177392 31983 raft_consensus.cc:493] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.177821 31983 raft_consensus.cc:515] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.178123 31963 raft_consensus.cc:493] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.178359 31971 raft_consensus.cc:493] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.178660 31963 raft_consensus.cc:515] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.178936 31971 raft_consensus.cc:515] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.180617 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:33.181105 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:33.181406 31746 raft_consensus.cc:2468] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:33.181212 31971 leader_election.cc:290] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.181864 31894 raft_consensus.cc:2468] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:33.182646 31784 leader_election.cc:304] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:33.182947 31983 leader_election.cc:290] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.181744 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:33.182668 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:33.183579 31983 raft_consensus.cc:2804] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.183931 31895 raft_consensus.cc:2468] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:33.183974 31983 raft_consensus.cc:493] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.184551 31983 raft_consensus.cc:3060] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.184636 31963 leader_election.cc:290] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.185348 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:33.185555 31711 leader_election.cc:304] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: 
I20260709 13:12:33.186842 31963 raft_consensus.cc:2804] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.186885 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:33.187306 31963 raft_consensus.cc:493] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.187738 31895 raft_consensus.cc:2393] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bea62f58c7024abea16d17ee5ff2da99 in current term 1: Already voted for candidate bfda2baa4b9d4151bca7437a6027a1fd in this term.
I20260709 13:12:33.187752 31963 raft_consensus.cc:3060] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.188699 31711 leader_election.cc:304] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99; no voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:33.189667 31971 raft_consensus.cc:3060] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.192086 31983 raft_consensus.cc:515] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.193270 31819 raft_consensus.cc:2393] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bea62f58c7024abea16d17ee5ff2da99 in current term 1: Already voted for candidate bfda2baa4b9d4151bca7437a6027a1fd in this term.
I20260709 13:12:33.194711 31983 leader_election.cc:290] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.196497 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:33.197078 31971 raft_consensus.cc:2749] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.197531 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:33.197686 31963 raft_consensus.cc:515] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.198290 31895 raft_consensus.cc:3060] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.199183 31746 raft_consensus.cc:2393] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bfda2baa4b9d4151bca7437a6027a1fd in current term 1: Already voted for candidate bea62f58c7024abea16d17ee5ff2da99 in this term.
I20260709 13:12:33.201870 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:33.202044 31963 leader_election.cc:290] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.202803 31819 raft_consensus.cc:2393] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bea62f58c7024abea16d17ee5ff2da99 in current term 1: Already voted for candidate bfda2baa4b9d4151bca7437a6027a1fd in this term.
I20260709 13:12:33.203629 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac5ecff68444a5783240e5e35c7c4ca" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:33.205056 31711 leader_election.cc:304] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99; no voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:33.205806 31963 raft_consensus.cc:2749] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.209884 31895 raft_consensus.cc:2468] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:33.211225 31786 leader_election.cc:304] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:33.212178 31983 raft_consensus.cc:2804] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.212703 31983 raft_consensus.cc:697] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:33.213498 31983 consensus_queue.cc:237] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.223446 31642 catalog_manager.cc:5697] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 0 to 1, leader changed from <none> to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 1 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.287290 31963 consensus_queue.cc:1048] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.294566 31980 consensus_queue.cc:1048] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.298048 31963 consensus_queue.cc:1048] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.311561 31963 consensus_queue.cc:1048] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.334959 31820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "372fb0be4269425288939f7776ff0767"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
mode: GRACEFUL
new_leader_uuid: "bea62f58c7024abea16d17ee5ff2da99"
 from {username='slave'} at 127.0.0.1:53500
I20260709 13:12:33.335529 31820 raft_consensus.cc:606] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Received request to transfer leadership to TS bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:33.349828 31746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
mode: GRACEFUL
new_leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:12:33.350383 31746 raft_consensus.cc:606] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Received request to transfer leadership to TS bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:33.353042 31963 consensus_queue.cc:1048] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.358460 31746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
mode: GRACEFUL
new_leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:12:33.359054 31746 raft_consensus.cc:606] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Received request to transfer leadership to TS bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:33.363848 31971 consensus_queue.cc:1048] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.364876 31820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
mode: GRACEFUL
new_leader_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:53500
I20260709 13:12:33.365494 31820 raft_consensus.cc:606] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Received request to transfer leadership to TS 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:33.370716 31943 raft_consensus.cc:993] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99: : Instructing follower bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:33.371120 31971 raft_consensus.cc:1081] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Signalling peer bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:33.372493 31819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53470
I20260709 13:12:33.372929 31819 raft_consensus.cc:493] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:33.373221 31819 raft_consensus.cc:3060] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.378993 31819 raft_consensus.cc:515] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.380591 31819 leader_election.cc:290] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.381222 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:33.381629 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ba567cb7dc46c0907c9346ba85ce94" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:33.381855 31746 raft_consensus.cc:3055] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.382244 31895 raft_consensus.cc:3060] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.382297 31746 raft_consensus.cc:740] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:33.383245 31746 consensus_queue.cc:260] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.384191 31746 raft_consensus.cc:3060] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.388058 31895 raft_consensus.cc:2468] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 2.
I20260709 13:12:33.389046 31786 leader_election.cc:304] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:33.389284 31746 raft_consensus.cc:2468] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 2.
I20260709 13:12:33.389854 31983 raft_consensus.cc:2804] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.390323 31983 raft_consensus.cc:697] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:33.391108 31983 consensus_queue.cc:237] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.396549 31641 catalog_manager.cc:5697] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 1 to 2, leader changed from bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193) to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 2 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.405223 31971 consensus_queue.cc:1048] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.408409 31983 consensus_queue.cc:1048] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.417341 31985 raft_consensus.cc:993] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd: : Instructing follower bea62f58c7024abea16d17ee5ff2da99 to start an election
I20260709 13:12:33.417766 31985 raft_consensus.cc:1081] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Signalling peer bea62f58c7024abea16d17ee5ff2da99 to start an election
I20260709 13:12:33.419860 31745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "372fb0be4269425288939f7776ff0767"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
 from {username='slave'} at 127.0.0.1:53248
I20260709 13:12:33.420423 31745 raft_consensus.cc:493] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:33.420795 31745 raft_consensus.cc:3060] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.422994 31943 consensus_queue.cc:1048] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.428404 31745 raft_consensus.cc:515] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.428627 31985 consensus_queue.cc:1048] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.431596 31746 raft_consensus.cc:1240] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Rejecting Update request from peer bfda2baa4b9d4151bca7437a6027a1fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.432137 31893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372fb0be4269425288939f7776ff0767" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:33.433221 31745 leader_election.cc:290] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 2 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.434985 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372fb0be4269425288939f7776ff0767" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:33.435801 31819 raft_consensus.cc:3055] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.436193 31819 raft_consensus.cc:740] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:33.439901 31819 consensus_queue.cc:260] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.440937 31985 consensus_queue.cc:1059] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.442061 31819 raft_consensus.cc:3060] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.449294 31819 raft_consensus.cc:2468] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 2.
I20260709 13:12:33.450371 31710 leader_election.cc:304] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:33.451697 31963 raft_consensus.cc:2804] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.452155 31963 raft_consensus.cc:697] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 2 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:33.452953 31963 consensus_queue.cc:237] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.460501 31642 catalog_manager.cc:5697] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 1 to 2, leader changed from bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194) to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.476784 31985 consensus_queue.cc:1048] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.482764 31982 raft_consensus.cc:993] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd: : Instructing follower 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:33.483198 31983 raft_consensus.cc:1081] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Signalling peer 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:33.484869 31894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6"
dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:12:33.485494 31894 raft_consensus.cc:493] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:33.485893 31894 raft_consensus.cc:3060] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.488699 31983 consensus_queue.cc:1048] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.492947 31894 raft_consensus.cc:515] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.495749 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:33.499481 31894 leader_election.cc:290] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:33.499835 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8bea6824254217bef7c7d9f07bf0b6" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:33.500456 31819 raft_consensus.cc:3055] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.500762 31819 raft_consensus.cc:740] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:33.501411 31819 consensus_queue.cc:260] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.502394 31819 raft_consensus.cc:3060] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.508411 31819 raft_consensus.cc:2468] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 2.
I20260709 13:12:33.509248 31859 leader_election.cc:304] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:33.509924 31946 raft_consensus.cc:2804] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.510739 31946 raft_consensus.cc:697] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Becoming Leader. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Running, Role: LEADER
I20260709 13:12:33.511372 31946 consensus_queue.cc:237] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.517120 31643 catalog_manager.cc:5697] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 reported cstate change: term changed from 1 to 2, leader changed from bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194) to 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195). New cstate: current_term: 2 leader_uuid: "65621217b5b7487f947e8cf35abb03e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.533603 31963 consensus_queue.cc:1048] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.542941 31943 consensus_queue.cc:1048] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.550736 31963 raft_consensus.cc:993] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99: : Instructing follower bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:33.551188 31943 raft_consensus.cc:1081] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Signalling peer bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:33.552606 31819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53470
I20260709 13:12:33.553047 31819 raft_consensus.cc:493] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:33.553349 31819 raft_consensus.cc:3060] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.558262 31819 raft_consensus.cc:515] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.560668 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:33.560386 31819 leader_election.cc:290] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:33.560901 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbca3802d824aadba6ef70655e16a1d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:33.561354 31746 raft_consensus.cc:3055] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.561636 31894 raft_consensus.cc:3060] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.561739 31746 raft_consensus.cc:740] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:33.562685 31746 consensus_queue.cc:260] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.563609 31746 raft_consensus.cc:3060] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.567355 31894 raft_consensus.cc:2468] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 2.
I20260709 13:12:33.568387 31786 leader_election.cc:304] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:33.568785 31746 raft_consensus.cc:2468] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 2.
I20260709 13:12:33.569046 31983 raft_consensus.cc:2804] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.569582 31983 raft_consensus.cc:697] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:33.570377 31983 consensus_queue.cc:237] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:33.576042 31642 catalog_manager.cc:5697] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 1 to 2, leader changed from bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193) to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 2 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.675429 31983 consensus_queue.cc:1048] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.685261 31985 consensus_queue.cc:1048] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.838896 31895 raft_consensus.cc:1275] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:33.840142 31982 consensus_queue.cc:1048] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.847194 31746 raft_consensus.cc:1275] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:33.848742 31985 consensus_queue.cc:1048] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.981106 31819 raft_consensus.cc:1275] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Refusing update from remote peer bea62f58c7024abea16d17ee5ff2da99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:33.982259 31972 consensus_queue.cc:1048] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.989996 31895 raft_consensus.cc:3060] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.996544 31895 raft_consensus.cc:1275] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Refusing update from remote peer bea62f58c7024abea16d17ee5ff2da99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:33.997992 31972 consensus_queue.cc:1048] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:34.074090 31746 raft_consensus.cc:3060] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.079322 31746 raft_consensus.cc:1275] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.081009 31946 consensus_queue.cc:1048] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:34.091207 31819 raft_consensus.cc:1275] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.092511 31946 consensus_queue.cc:1048] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:34.160547 31746 raft_consensus.cc:1275] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.161798 31985 consensus_queue.cc:1048] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:34.169340 31895 raft_consensus.cc:1275] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.170768 31982 consensus_queue.cc:1048] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:36.394057 31643 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54318:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:36.396135 31643 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:36.444842 31732 tablet_service.cc:1511] Processing CreateTablet for tablet d4aa14eee1574e538a5bf17ca3f34e37 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:36.446094 31732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4aa14eee1574e538a5bf17ca3f34e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.446106 31806 tablet_service.cc:1511] Processing CreateTablet for tablet d4aa14eee1574e538a5bf17ca3f34e37 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:36.448347 31736 tablet_service.cc:1511] Processing CreateTablet for tablet 3971ab99b9f44847ba4c517f14dd067d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:36.449141 31806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4aa14eee1574e538a5bf17ca3f34e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.449617 31736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3971ab99b9f44847ba4c517f14dd067d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.451301 31807 tablet_service.cc:1511] Processing CreateTablet for tablet 3971ab99b9f44847ba4c517f14dd067d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:36.452539 31807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3971ab99b9f44847ba4c517f14dd067d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.455053 31808 tablet_service.cc:1511] Processing CreateTablet for tablet 988d7fdb723d4149910c89b3124ca071 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:36.456284 31808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988d7fdb723d4149910c89b3124ca071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.456607 31879 tablet_service.cc:1511] Processing CreateTablet for tablet 3971ab99b9f44847ba4c517f14dd067d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:36.457870 31879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3971ab99b9f44847ba4c517f14dd067d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.459038 31811 tablet_service.cc:1511] Processing CreateTablet for tablet 5413e94e491f4ef280dd7427e8def45d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:36.460227 31811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5413e94e491f4ef280dd7427e8def45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.460381 31734 tablet_service.cc:1511] Processing CreateTablet for tablet 988d7fdb723d4149910c89b3124ca071 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:36.461606 31734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988d7fdb723d4149910c89b3124ca071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.464597 31729 tablet_service.cc:1511] Processing CreateTablet for tablet 5413e94e491f4ef280dd7427e8def45d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:36.465811 31729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5413e94e491f4ef280dd7427e8def45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.465876 31733 tablet_service.cc:1511] Processing CreateTablet for tablet c6a5e841eb92487a87c5767610b7114a (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:36.465922 31730 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4cbf2965614445bba5f7b85958d417 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:36.456624 31881 tablet_service.cc:1511] Processing CreateTablet for tablet 988d7fdb723d4149910c89b3124ca071 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:36.468849 31881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988d7fdb723d4149910c89b3124ca071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.469756 31731 tablet_service.cc:1511] Processing CreateTablet for tablet 33dd7eb5dbd54688a2826d4fe39cef6d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:36.470463 31885 tablet_service.cc:1511] Processing CreateTablet for tablet 5413e94e491f4ef280dd7427e8def45d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:36.471643 31885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5413e94e491f4ef280dd7427e8def45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.451345 31882 tablet_service.cc:1511] Processing CreateTablet for tablet d4aa14eee1574e538a5bf17ca3f34e37 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:36.473049 31882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4aa14eee1574e538a5bf17ca3f34e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.476963 31735 tablet_service.cc:1511] Processing CreateTablet for tablet 123bf927b48d40fab2ce8636284c855d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:36.477380 31728 tablet_service.cc:1511] Processing CreateTablet for tablet b625653993504a8ab38f25e4536da86b (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:36.479481 31878 tablet_service.cc:1511] Processing CreateTablet for tablet c6a5e841eb92487a87c5767610b7114a (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:36.479883 31880 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4cbf2965614445bba5f7b85958d417 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:36.480782 31878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a5e841eb92487a87c5767610b7114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.481873 31883 tablet_service.cc:1511] Processing CreateTablet for tablet 33dd7eb5dbd54688a2826d4fe39cef6d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:36.483069 31883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33dd7eb5dbd54688a2826d4fe39cef6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.483932 31733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a5e841eb92487a87c5767610b7114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.484630 31884 tablet_service.cc:1511] Processing CreateTablet for tablet 123bf927b48d40fab2ce8636284c855d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:36.485006 31728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b625653993504a8ab38f25e4536da86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.485204 31880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4cbf2965614445bba5f7b85958d417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.485827 31884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123bf927b48d40fab2ce8636284c855d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.486335 31731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33dd7eb5dbd54688a2826d4fe39cef6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.488085 31735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123bf927b48d40fab2ce8636284c855d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.490219 31877 tablet_service.cc:1511] Processing CreateTablet for tablet b625653993504a8ab38f25e4536da86b (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:36.479413 31809 tablet_service.cc:1511] Processing CreateTablet for tablet c6a5e841eb92487a87c5767610b7114a (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:36.491439 31877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b625653993504a8ab38f25e4536da86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.491918 31730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4cbf2965614445bba5f7b85958d417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.500145 31810 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4cbf2965614445bba5f7b85958d417 (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:36.500669 31805 tablet_service.cc:1511] Processing CreateTablet for tablet 33dd7eb5dbd54688a2826d4fe39cef6d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:36.502977 31804 tablet_service.cc:1511] Processing CreateTablet for tablet 123bf927b48d40fab2ce8636284c855d (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:36.504988 31803 tablet_service.cc:1511] Processing CreateTablet for tablet b625653993504a8ab38f25e4536da86b (DEFAULT_TABLE table=soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:36.523316 32034 tablet_bootstrap.cc:492] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.533179 32034 tablet_bootstrap.cc:654] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.550654 32034 tablet_bootstrap.cc:492] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:36.551371 32034 ts_tablet_manager.cc:1403] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.012s
I20260709 13:12:36.552991 32033 tablet_bootstrap.cc:492] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:36.554214 32034 raft_consensus.cc:359] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.555128 32034 raft_consensus.cc:385] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.555475 32034 raft_consensus.cc:740] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.556778 32034 consensus_queue.cc:260] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.560012 31809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a5e841eb92487a87c5767610b7114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.560673 31803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b625653993504a8ab38f25e4536da86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.563963 31804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123bf927b48d40fab2ce8636284c855d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.565155 31805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33dd7eb5dbd54688a2826d4fe39cef6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.567929 31810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4cbf2965614445bba5f7b85958d417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.570477 32033 tablet_bootstrap.cc:654] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.570932 32034 ts_tablet_manager.cc:1434] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:12:36.578527 32034 tablet_bootstrap.cc:492] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.584558 32034 tablet_bootstrap.cc:654] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.585783 32036 tablet_bootstrap.cc:492] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:36.591689 32033 tablet_bootstrap.cc:492] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:36.592151 32033 ts_tablet_manager.cc:1403] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.007s
I20260709 13:12:36.597700 32036 tablet_bootstrap.cc:654] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.597815 32033 raft_consensus.cc:359] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.598621 32033 raft_consensus.cc:385] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.598920 32033 raft_consensus.cc:740] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.599774 32033 consensus_queue.cc:260] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
W20260709 13:12:36.628643 31921 tablet.cc:2406] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:36.650396 32034 tablet_bootstrap.cc:492] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:36.650954 32034 ts_tablet_manager.cc:1403] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.016s
I20260709 13:12:36.651500 32036 tablet_bootstrap.cc:492] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:36.652034 32036 ts_tablet_manager.cc:1403] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.010s
I20260709 13:12:36.653999 32034 raft_consensus.cc:359] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.654708 32034 raft_consensus.cc:385] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.654803 32036 raft_consensus.cc:359] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.654999 32034 raft_consensus.cc:740] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.655442 32036 raft_consensus.cc:385] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.655786 32036 raft_consensus.cc:740] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.655942 32033 ts_tablet_manager.cc:1434] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.003s
I20260709 13:12:36.656045 32034 consensus_queue.cc:260] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.656490 32036 consensus_queue.cc:260] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.658591 32034 ts_tablet_manager.cc:1434] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:12:36.659525 32034 tablet_bootstrap.cc:492] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.665997 32034 tablet_bootstrap.cc:654] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.667953 32036 ts_tablet_manager.cc:1434] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:36.668980 32036 tablet_bootstrap.cc:492] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:36.678350 32036 tablet_bootstrap.cc:654] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.680977 32033 tablet_bootstrap.cc:492] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:36.687378 32033 tablet_bootstrap.cc:654] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.690070 32036 tablet_bootstrap.cc:492] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:36.690608 32036 ts_tablet_manager.cc:1403] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:12:36.690625 32034 tablet_bootstrap.cc:492] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:36.693979 32034 ts_tablet_manager.cc:1403] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.006s
I20260709 13:12:36.693729 32036 raft_consensus.cc:359] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.694589 32036 raft_consensus.cc:385] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.694868 32036 raft_consensus.cc:740] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.695557 32036 consensus_queue.cc:260] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.697659 32036 ts_tablet_manager.cc:1434] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:36.697865 32034 raft_consensus.cc:359] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.698697 32034 raft_consensus.cc:385] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.699034 32034 raft_consensus.cc:740] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.699887 32034 consensus_queue.cc:260] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.700706 32033 tablet_bootstrap.cc:492] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:36.701152 32033 ts_tablet_manager.cc:1403] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:12:36.698545 32036 tablet_bootstrap.cc:492] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:36.703985 32033 raft_consensus.cc:359] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.704641 32033 raft_consensus.cc:385] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.704919 32033 raft_consensus.cc:740] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.705348 32034 ts_tablet_manager.cc:1434] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:36.705811 32033 consensus_queue.cc:260] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.706338 32034 tablet_bootstrap.cc:492] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.708845 32036 tablet_bootstrap.cc:654] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.712857 32034 tablet_bootstrap.cc:654] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.718905 32033 ts_tablet_manager.cc:1434] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:12:36.720805 32040 raft_consensus.cc:493] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.721642 32033 tablet_bootstrap.cc:492] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:36.721359 32040 raft_consensus.cc:515] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.724449 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:36.725071 31819 raft_consensus.cc:2468] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:36.726146 31710 leader_election.cc:304] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:36.727003 32041 raft_consensus.cc:2804] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.727548 32041 raft_consensus.cc:493] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.727985 32041 raft_consensus.cc:3060] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.728495 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:36.729131 31895 raft_consensus.cc:2468] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:36.729729 32036 tablet_bootstrap.cc:492] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:36.730530 32036 ts_tablet_manager.cc:1403] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 13:12:36.727152 32040 leader_election.cc:290] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.733284 32036 raft_consensus.cc:359] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.733982 32036 raft_consensus.cc:385] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.734279 32036 raft_consensus.cc:740] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.735327 32033 tablet_bootstrap.cc:654] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.735196 32036 consensus_queue.cc:260] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.738269 31982 raft_consensus.cc:493] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.738690 32041 raft_consensus.cc:515] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.740236 32036 ts_tablet_manager.cc:1434] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:36.741333 32036 tablet_bootstrap.cc:492] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:36.741688 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:36.742244 31819 raft_consensus.cc:3060] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.741346 32034 tablet_bootstrap.cc:492] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:36.743809 32034 ts_tablet_manager.cc:1403] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.013s
I20260709 13:12:36.746215 32022 raft_consensus.cc:493] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.746608 32034 raft_consensus.cc:359] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.747370 32034 raft_consensus.cc:385] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.746817 32022 raft_consensus.cc:515] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.749262 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:36.749905 31895 raft_consensus.cc:3060] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.751593 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:36.747709 32034 raft_consensus.cc:740] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.753005 32034 consensus_queue.cc:260] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.751986 32036 tablet_bootstrap.cc:654] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.753993 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:36.755740 32041 leader_election.cc:290] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
W20260709 13:12:36.755988 31858 leader_election.cc:343] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.759876 32022 leader_election.cc:290] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:36.765100 31895 raft_consensus.cc:2468] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:36.766098 32033 tablet_bootstrap.cc:492] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:36.766361 31711 leader_election.cc:304] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: 
I20260709 13:12:36.766754 32033 ts_tablet_manager.cc:1403] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.009s
I20260709 13:12:36.767244 32041 raft_consensus.cc:2804] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.767797 32041 raft_consensus.cc:697] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:36.768553 32041 consensus_queue.cc:237] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.772802 32033 raft_consensus.cc:359] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.773269 31819 raft_consensus.cc:2468] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:36.773562 32033 raft_consensus.cc:385] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.773887 32033 raft_consensus.cc:740] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.774571 32033 consensus_queue.cc:260] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.738857 31982 raft_consensus.cc:515] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.776706 31982 leader_election.cc:290] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.776739 32033 ts_tablet_manager.cc:1434] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:12:36.777930 32033 tablet_bootstrap.cc:492] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:36.779168 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:36.780714 31820 raft_consensus.cc:2468] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 0.
W20260709 13:12:36.782601 31784 leader_election.cc:343] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.783757 31859 leader_election.cc:304] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:36.784901 32022 raft_consensus.cc:2804] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.784937 32034 ts_tablet_manager.cc:1434] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.041s	user 0.015s	sys 0.017s
I20260709 13:12:36.785254 32033 tablet_bootstrap.cc:654] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.785531 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:36.785970 32022 raft_consensus.cc:493] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.787158 32022 raft_consensus.cc:3060] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.788854 32036 tablet_bootstrap.cc:492] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:36.789666 32036 ts_tablet_manager.cc:1403] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.001s
I20260709 13:12:36.792562 32036 raft_consensus.cc:359] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.794616 32034 tablet_bootstrap.cc:492] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.797652 32048 raft_consensus.cc:493] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.798503 32048 raft_consensus.cc:515] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.801949 32034 tablet_bootstrap.cc:654] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.803162 32048 leader_election.cc:290] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:36.804234 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:36.804514 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
W20260709 13:12:36.805680 31858 leader_election.cc:343] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.793684 32036 raft_consensus.cc:385] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:36.806243 31859 leader_election.cc:343] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.806986 32036 raft_consensus.cc:740] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.807181 31859 leader_election.cc:304] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0; no voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:36.807544 31643 catalog_manager.cc:5697] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.808754 32048 raft_consensus.cc:2749] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.809471 32022 raft_consensus.cc:515] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.810772 31895 raft_consensus.cc:2393] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfda2baa4b9d4151bca7437a6027a1fd in current term 1: Already voted for candidate 65621217b5b7487f947e8cf35abb03e0 in this term.
I20260709 13:12:36.807873 32036 consensus_queue.cc:260] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
W20260709 13:12:36.811726 31692 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:36.813217 32036 ts_tablet_manager.cc:1434] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 13:12:36.814314 32036 tablet_bootstrap.cc:492] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:36.814194 31786 leader_election.cc:304] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:36.815410 31982 raft_consensus.cc:3060] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.818492 32022 leader_election.cc:290] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:36.819370 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:36.820399 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
W20260709 13:12:36.823372 31858 leader_election.cc:343] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.829381 31982 raft_consensus.cc:2749] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.839061 31820 raft_consensus.cc:2468] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 1.
I20260709 13:12:36.843004 32034 tablet_bootstrap.cc:492] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:36.843680 32034 ts_tablet_manager.cc:1403] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.011s
I20260709 13:12:36.845176 32036 tablet_bootstrap.cc:654] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.845940 32033 tablet_bootstrap.cc:492] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:36.846431 32033 ts_tablet_manager.cc:1403] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.008s
I20260709 13:12:36.849507 32033 raft_consensus.cc:359] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.850227 32033 raft_consensus.cc:385] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.850522 32033 raft_consensus.cc:740] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.851219 31859 leader_election.cc:304] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:36.851213 32033 consensus_queue.cc:260] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.851711 32034 raft_consensus.cc:359] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.852494 32022 raft_consensus.cc:2804] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.852624 32034 raft_consensus.cc:385] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.853112 32022 raft_consensus.cc:697] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 LEADER]: Becoming Leader. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Running, Role: LEADER
I20260709 13:12:36.853336 32034 raft_consensus.cc:740] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.853907 32033 ts_tablet_manager.cc:1434] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:36.854055 32022 consensus_queue.cc:237] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.854379 32034 consensus_queue.cc:260] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.854998 32033 tablet_bootstrap.cc:492] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:36.856971 32034 ts_tablet_manager.cc:1434] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:36.858081 32034 tablet_bootstrap.cc:492] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.861544 32033 tablet_bootstrap.cc:654] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.864522 32034 tablet_bootstrap.cc:654] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.869706 32036 tablet_bootstrap.cc:492] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:36.870260 32036 ts_tablet_manager.cc:1403] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.007s
I20260709 13:12:36.871963 31643 catalog_manager.cc:5697] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195). New cstate: current_term: 1 leader_uuid: "65621217b5b7487f947e8cf35abb03e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.873497 32033 tablet_bootstrap.cc:492] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:36.873354 32036 raft_consensus.cc:359] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.874210 32033 ts_tablet_manager.cc:1403] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.005s
I20260709 13:12:36.874259 32036 raft_consensus.cc:385] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.874950 32036 raft_consensus.cc:740] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.875963 32036 consensus_queue.cc:260] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.877905 32033 raft_consensus.cc:359] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.878597 32033 raft_consensus.cc:385] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.878815 32036 ts_tablet_manager.cc:1434] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:12:36.878871 32033 raft_consensus.cc:740] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.880079 32036 tablet_bootstrap.cc:492] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:36.880338 32033 consensus_queue.cc:260] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.882908 32033 ts_tablet_manager.cc:1434] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:12:36.883872 32033 tablet_bootstrap.cc:492] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:36.891353 32033 tablet_bootstrap.cc:654] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.897581 32034 tablet_bootstrap.cc:492] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:36.897838 32041 raft_consensus.cc:493] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.898243 32034 ts_tablet_manager.cc:1403] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.007s
I20260709 13:12:36.899137 32036 tablet_bootstrap.cc:654] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.902670 32034 raft_consensus.cc:359] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.903442 32034 raft_consensus.cc:385] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.903748 32034 raft_consensus.cc:740] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.907899 32040 raft_consensus.cc:493] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.908599 32040 raft_consensus.cc:515] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.898378 32041 raft_consensus.cc:515] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.913033 32041 leader_election.cc:290] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.913686 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:36.917380 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:36.918316 31820 raft_consensus.cc:2468] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:36.919739 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4aa14eee1574e538a5bf17ca3f34e37" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:36.922538 31710 leader_election.cc:304] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:36.923149 32040 leader_election.cc:290] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.923355 32041 raft_consensus.cc:2804] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.923365 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4aa14eee1574e538a5bf17ca3f34e37" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:36.924007 32041 raft_consensus.cc:493] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:36.924062 31711 leader_election.cc:343] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.924449 32041 raft_consensus.cc:3060] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:36.923509 31710 leader_election.cc:343] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.923696 32034 consensus_queue.cc:260] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.925356 31895 raft_consensus.cc:2468] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:36.926756 32034 ts_tablet_manager.cc:1434] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:12:36.927929 32034 tablet_bootstrap.cc:492] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.928916 31711 leader_election.cc:304] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:36.930096 32040 raft_consensus.cc:2804] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.930475 32040 raft_consensus.cc:493] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.930832 32040 raft_consensus.cc:3060] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.931244 32033 tablet_bootstrap.cc:492] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:36.931869 32033 ts_tablet_manager.cc:1403] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.048s	user 0.027s	sys 0.007s
I20260709 13:12:36.935032 32033 raft_consensus.cc:359] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.935755 32033 raft_consensus.cc:385] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.936059 32033 raft_consensus.cc:740] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.936792 32033 consensus_queue.cc:260] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.939275 32033 ts_tablet_manager.cc:1434] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:12:36.939399 32034 tablet_bootstrap.cc:654] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.939793 32036 tablet_bootstrap.cc:492] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:36.941439 32036 ts_tablet_manager.cc:1403] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.027s
I20260709 13:12:36.940387 32033 tablet_bootstrap.cc:492] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:36.943778 32041 raft_consensus.cc:515] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.944248 32036 raft_consensus.cc:359] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.944970 32036 raft_consensus.cc:385] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.945103 32034 tablet_bootstrap.cc:492] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:36.945232 32036 raft_consensus.cc:740] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.946089 32036 consensus_queue.cc:260] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.946529 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:36.947190 31819 raft_consensus.cc:3060] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.947484 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:36.948396 32036 ts_tablet_manager.cc:1434] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
W20260709 13:12:36.948833 31711 leader_election.cc:343] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.940529 32040 raft_consensus.cc:515] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.949438 32041 leader_election.cc:290] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.945693 32034 ts_tablet_manager.cc:1403] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:12:36.953711 32041 raft_consensus.cc:493] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.954195 32041 raft_consensus.cc:515] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.954602 31819 raft_consensus.cc:2468] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:36.955814 31710 leader_election.cc:304] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:36.956249 32040 leader_election.cc:290] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.956812 32040 raft_consensus.cc:2804] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.957238 32040 raft_consensus.cc:697] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:36.957252 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4aa14eee1574e538a5bf17ca3f34e37" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:36.957903 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4aa14eee1574e538a5bf17ca3f34e37" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:36.958133 32040 consensus_queue.cc:237] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.957943 31895 raft_consensus.cc:3060] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.959465 32041 leader_election.cc:290] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.959944 32034 raft_consensus.cc:359] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.960690 32034 raft_consensus.cc:385] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.960975 32034 raft_consensus.cc:740] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.961822 32034 consensus_queue.cc:260] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.963049 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625653993504a8ab38f25e4536da86b" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:36.963739 31894 raft_consensus.cc:2468] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:36.964340 32034 ts_tablet_manager.cc:1434] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:12:36.965122 31711 leader_election.cc:304] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: 
I20260709 13:12:36.966320 32033 tablet_bootstrap.cc:654] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:36.966802 31710 leader_election.cc:343] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.966997 31972 raft_consensus.cc:2804] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.967367 31972 raft_consensus.cc:493] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.949339 32036 tablet_bootstrap.cc:492] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:36.967725 31972 raft_consensus.cc:3060] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.972704 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625653993504a8ab38f25e4536da86b" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:36.973105 31982 raft_consensus.cc:493] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.973340 31820 raft_consensus.cc:2468] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:36.973618 31982 raft_consensus.cc:515] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.974184 32036 tablet_bootstrap.cc:654] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.976291 31982 leader_election.cc:290] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:36.976796 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:36.978317 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:36.978983 31894 raft_consensus.cc:2468] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
W20260709 13:12:36.980229 31784 leader_election.cc:343] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.965401 32034 tablet_bootstrap.cc:492] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:36.980808 31786 leader_election.cc:304] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:36.984798 31982 raft_consensus.cc:2804] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.985319 31982 raft_consensus.cc:493] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.975478 31972 raft_consensus.cc:515] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:36.985826 31982 raft_consensus.cc:3060] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.988607 31895 raft_consensus.cc:2468] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:36.988804 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625653993504a8ab38f25e4536da86b" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:36.989382 31894 raft_consensus.cc:3060] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.989746 31711 leader_election.cc:304] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:36.998723 31894 raft_consensus.cc:2468] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:37.000077 31972 leader_election.cc:290] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.000846 31972 raft_consensus.cc:493] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.001368 31972 raft_consensus.cc:515] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.008364 31711 leader_election.cc:304] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: 
I20260709 13:12:37.009773 32065 raft_consensus.cc:2804] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.010111 32034 tablet_bootstrap.cc:654] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.010353 32065 raft_consensus.cc:697] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.011327 32065 consensus_queue.cc:237] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.015889 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625653993504a8ab38f25e4536da86b" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:37.016703 31819 raft_consensus.cc:3060] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.015291 32063 raft_consensus.cc:2804] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.026687 31819 raft_consensus.cc:2468] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:37.027468 31982 raft_consensus.cc:515] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.028597 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4cbf2965614445bba5f7b85958d417" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:37.029877 32033 tablet_bootstrap.cc:492] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:37.028510 31972 leader_election.cc:290] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.031026 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4cbf2965614445bba5f7b85958d417" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.036880 31982 leader_election.cc:290] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
W20260709 13:12:37.037257 31711 leader_election.cc:343] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.038930 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
W20260709 13:12:37.039207 31710 leader_election.cc:343] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.039479 31894 raft_consensus.cc:3060] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.039623 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:37.040452 32033 ts_tablet_manager.cc:1403] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.011s
W20260709 13:12:37.043354 31784 leader_election.cc:343] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.031272 32063 raft_consensus.cc:697] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.044942 32063 consensus_queue.cc:237] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.039741 31710 leader_election.cc:304] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99; no voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.047647 31972 raft_consensus.cc:2749] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.048311 31894 raft_consensus.cc:2468] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:37.043577 32033 raft_consensus.cc:359] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.049467 31786 leader_election.cc:304] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:37.053370 32033 raft_consensus.cc:385] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.053931 32033 raft_consensus.cc:740] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.054152 31982 raft_consensus.cc:2804] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.057111 31982 raft_consensus.cc:697] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:37.057973 31982 consensus_queue.cc:237] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.058804 32040 raft_consensus.cc:493] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.059350 32040 raft_consensus.cc:515] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.061180 32033 consensus_queue.cc:260] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.063688 32034 tablet_bootstrap.cc:492] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:37.064353 32034 ts_tablet_manager.cc:1403] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.015s
I20260709 13:12:37.068346 32033 ts_tablet_manager.cc:1434] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:12:37.068624 32036 tablet_bootstrap.cc:492] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:37.069150 32036 ts_tablet_manager.cc:1403] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.022s
I20260709 13:12:37.069357 32033 tablet_bootstrap.cc:492] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:37.072113 32036 raft_consensus.cc:359] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.072846 32036 raft_consensus.cc:385] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.073283 32036 raft_consensus.cc:740] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.073917 32040 leader_election.cc:290] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.074003 32036 consensus_queue.cc:260] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.074541 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d7fdb723d4149910c89b3124ca071" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:37.075803 32034 raft_consensus.cc:359] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.076764 32034 raft_consensus.cc:385] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:37.077172 31710 leader_election.cc:343] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.077231 32034 raft_consensus.cc:740] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.072892 31643 catalog_manager.cc:5697] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.074996 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d7fdb723d4149910c89b3124ca071" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.078754 32034 consensus_queue.cc:260] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.079633 32033 tablet_bootstrap.cc:654] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.078775 31643 catalog_manager.cc:5697] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.077678 32036 ts_tablet_manager.cc:1434] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:37.079885 31894 raft_consensus.cc:2468] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 0.
I20260709 13:12:37.080873 32036 tablet_bootstrap.cc:492] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:37.086318 31711 leader_election.cc:304] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.089208 32036 tablet_bootstrap.cc:654] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.090456 32040 raft_consensus.cc:2804] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.090879 32040 raft_consensus.cc:493] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.091226 32040 raft_consensus.cc:3060] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.091547 32034 ts_tablet_manager.cc:1434] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:12:37.092620 32034 tablet_bootstrap.cc:492] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0: Bootstrap starting.
I20260709 13:12:37.098177 32034 tablet_bootstrap.cc:654] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.102373 32040 raft_consensus.cc:515] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.108436 32036 tablet_bootstrap.cc:492] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:37.109061 32036 ts_tablet_manager.cc:1403] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.013s
I20260709 13:12:37.119112 31642 catalog_manager.cc:5697] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 0 to 1, leader changed from <none> to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 1 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.112432 32036 raft_consensus.cc:359] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.125905 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d7fdb723d4149910c89b3124ca071" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:37.126394 32036 raft_consensus.cc:385] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.126667 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d7fdb723d4149910c89b3124ca071" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:37.127315 31894 raft_consensus.cc:3060] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.125475 32040 leader_election.cc:290] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.126688 32036 raft_consensus.cc:740] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.130985 32036 consensus_queue.cc:260] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
W20260709 13:12:37.127318 31710 leader_election.cc:343] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.132817 32033 tablet_bootstrap.cc:492] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:37.132896 32036 ts_tablet_manager.cc:1434] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:37.133407 32033 ts_tablet_manager.cc:1403] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.064s	user 0.027s	sys 0.026s
I20260709 13:12:37.133883 32036 tablet_bootstrap.cc:492] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd: Bootstrap starting.
I20260709 13:12:37.135600 31894 raft_consensus.cc:2468] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 1.
I20260709 13:12:37.136392 32033 raft_consensus.cc:359] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.137138 32033 raft_consensus.cc:385] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.136960 31711 leader_election.cc:304] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.137475 32033 raft_consensus.cc:740] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.138168 31641 catalog_manager.cc:5697] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.138921 32040 raft_consensus.cc:2804] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.139855 32040 raft_consensus.cc:697] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.140784 32036 tablet_bootstrap.cc:654] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.140725 32040 consensus_queue.cc:237] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.144203 32033 consensus_queue.cc:260] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.151546 32033 ts_tablet_manager.cc:1434] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:12:37.152334 32036 tablet_bootstrap.cc:492] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd: No bootstrap required, opened a new log
I20260709 13:12:37.152961 32036 ts_tablet_manager.cc:1403] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 13:12:37.152398 32033 tablet_bootstrap.cc:492] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99: Bootstrap starting.
I20260709 13:12:37.161315 32063 consensus_queue.cc:1048] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.155323 32036 raft_consensus.cc:359] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.164458 32036 raft_consensus.cc:385] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.164748 32036 raft_consensus.cc:740] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.165503 32036 consensus_queue.cc:260] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.166811 31982 raft_consensus.cc:493] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.167311 31982 raft_consensus.cc:515] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.168149 32036 ts_tablet_manager.cc:1434] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:37.169664 31982 leader_election.cc:290] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.170900 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123bf927b48d40fab2ce8636284c855d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.171166 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123bf927b48d40fab2ce8636284c855d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:37.171811 31894 raft_consensus.cc:2468] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
W20260709 13:12:37.172784 31784 leader_election.cc:343] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.172727 31643 catalog_manager.cc:5697] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 1 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.173472 31786 leader_election.cc:304] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:37.161636 32033 tablet_bootstrap.cc:654] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.174816 31982 raft_consensus.cc:2804] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.175201 31982 raft_consensus.cc:493] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.175552 31982 raft_consensus.cc:3060] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.180198 32034 tablet_bootstrap.cc:492] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0: No bootstrap required, opened a new log
I20260709 13:12:37.180668 32034 ts_tablet_manager.cc:1403] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0: Time spent bootstrapping tablet: real 0.088s	user 0.022s	sys 0.004s
I20260709 13:12:37.182703 32034 raft_consensus.cc:359] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.183327 32034 raft_consensus.cc:385] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.183105 31982 raft_consensus.cc:515] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.187422 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123bf927b48d40fab2ce8636284c855d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:37.188220 31894 raft_consensus.cc:3060] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.190208 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123bf927b48d40fab2ce8636284c855d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
W20260709 13:12:37.191911 31784 leader_election.cc:343] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.183624 32034 raft_consensus.cc:740] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.196846 32034 consensus_queue.cc:260] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.197305 31894 raft_consensus.cc:2468] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:37.198863 31786 leader_election.cc:304] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:37.199482 31982 leader_election.cc:290] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.200191 32052 raft_consensus.cc:2804] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.200707 32052 raft_consensus.cc:697] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:37.201452 32052 consensus_queue.cc:237] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.203240 32034 ts_tablet_manager.cc:1434] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:12:37.204447 32065 raft_consensus.cc:493] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.204919 32065 raft_consensus.cc:515] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.207456 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:37.208421 32065 leader_election.cc:290] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.210786 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.212194 31894 raft_consensus.cc:2393] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bea62f58c7024abea16d17ee5ff2da99 in current term 1: Already voted for candidate bfda2baa4b9d4151bca7437a6027a1fd in this term.
I20260709 13:12:37.214335 31711 leader_election.cc:304] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99; no voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.215174 31972 raft_consensus.cc:3060] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.215646 31982 raft_consensus.cc:493] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.216151 31982 raft_consensus.cc:515] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.218214 32065 consensus_queue.cc:1048] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.218675 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4cbf2965614445bba5f7b85958d417" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:37.219295 31745 raft_consensus.cc:2468] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:37.220547 31784 leader_election.cc:304] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:37.220745 31982 leader_election.cc:290] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.221278 31982 raft_consensus.cc:2804] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.221591 31982 raft_consensus.cc:493] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.221931 31982 raft_consensus.cc:3060] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.229355 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4cbf2965614445bba5f7b85958d417" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.230242 31894 raft_consensus.cc:2468] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 0.
I20260709 13:12:37.233453 31972 raft_consensus.cc:2749] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.235582 31982 raft_consensus.cc:515] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.236646 32033 tablet_bootstrap.cc:492] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99: No bootstrap required, opened a new log
I20260709 13:12:37.237697 32033 ts_tablet_manager.cc:1403] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.002s
I20260709 13:12:37.240010 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4cbf2965614445bba5f7b85958d417" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:37.240571 31894 raft_consensus.cc:3060] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.240845 32033 raft_consensus.cc:359] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.241695 32033 raft_consensus.cc:385] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.242290 32033 raft_consensus.cc:740] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.243070 32033 consensus_queue.cc:260] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.244793 32033 ts_tablet_manager.cc:1434] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:37.247314 31894 raft_consensus.cc:2468] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:37.248805 31786 leader_election.cc:304] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:37.251056 32080 raft_consensus.cc:2804] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.251508 32080 raft_consensus.cc:697] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:37.252298 32080 consensus_queue.cc:237] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.254243 31982 leader_election.cc:290] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.258615 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4cbf2965614445bba5f7b85958d417" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:37.259199 31745 raft_consensus.cc:3060] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.264830 31642 catalog_manager.cc:5697] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 0 to 1, leader changed from <none> to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 1 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.266393 31745 raft_consensus.cc:2468] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 1.
I20260709 13:12:37.279776 31642 catalog_manager.cc:5697] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 0 to 1, leader changed from <none> to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 1 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.311105 31972 raft_consensus.cc:493] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.311703 31972 raft_consensus.cc:515] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.313421 31972 leader_election.cc:290] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.314083 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123bf927b48d40fab2ce8636284c855d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:37.314373 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123bf927b48d40fab2ce8636284c855d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.315132 31895 raft_consensus.cc:2393] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bea62f58c7024abea16d17ee5ff2da99 in current term 1: Already voted for candidate bfda2baa4b9d4151bca7437a6027a1fd in this term.
I20260709 13:12:37.315917 31711 leader_election.cc:304] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99; no voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.316509 31972 raft_consensus.cc:3060] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.321302 31972 raft_consensus.cc:2749] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.356317 32065 raft_consensus.cc:493] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.356776 32065 raft_consensus.cc:515] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.358467 32065 leader_election.cc:290] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.359144 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:37.359450 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.359831 31821 raft_consensus.cc:2393] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bea62f58c7024abea16d17ee5ff2da99 in current term 1: Already voted for candidate 65621217b5b7487f947e8cf35abb03e0 in this term.
I20260709 13:12:37.360813 31710 leader_election.cc:304] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99; no voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.361461 32065 raft_consensus.cc:3060] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.367515 32065 raft_consensus.cc:2749] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.391975 32080 raft_consensus.cc:493] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.392427 32080 raft_consensus.cc:515] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.393918 32080 leader_election.cc:290] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.394573 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d7fdb723d4149910c89b3124ca071" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:37.394888 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988d7fdb723d4149910c89b3124ca071" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65621217b5b7487f947e8cf35abb03e0" is_pre_election: true
I20260709 13:12:37.395942 32022 raft_consensus.cc:493] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.396497 31895 raft_consensus.cc:2393] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfda2baa4b9d4151bca7437a6027a1fd in current term 1: Already voted for candidate bea62f58c7024abea16d17ee5ff2da99 in this term.
I20260709 13:12:37.396533 32022 raft_consensus.cc:515] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.397507 31786 leader_election.cc:304] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:37.398342 32080 raft_consensus.cc:3060] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.399257 32022 leader_election.cc:290] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:37.399289 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea62f58c7024abea16d17ee5ff2da99" is_pre_election: true
I20260709 13:12:37.400383 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" is_pre_election: true
I20260709 13:12:37.401165 31821 raft_consensus.cc:2393] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65621217b5b7487f947e8cf35abb03e0 in current term 1: Already voted for candidate bea62f58c7024abea16d17ee5ff2da99 in this term.
I20260709 13:12:37.402050 31859 leader_election.cc:304] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0; no voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.402678 32022 raft_consensus.cc:3060] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.405691 32080 raft_consensus.cc:2749] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.407531 32022 raft_consensus.cc:2749] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.423889 32022 consensus_queue.cc:1048] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.441134 32022 consensus_queue.cc:1048] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.447445 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
mode: GRACEFUL
new_leader_uuid: "bea62f58c7024abea16d17ee5ff2da99"
 from {username='slave'} at 127.0.0.1:53500
I20260709 13:12:37.448084 31821 raft_consensus.cc:606] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Received request to transfer leadership to TS bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:37.463105 32065 consensus_queue.cc:1048] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.465636 31893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d"
dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
mode: GRACEFUL
new_leader_uuid: "bea62f58c7024abea16d17ee5ff2da99"
 from {username='slave'} at 127.0.0.1:60352
I20260709 13:12:37.466142 31893 raft_consensus.cc:606] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 LEADER]: Received request to transfer leadership to TS bea62f58c7024abea16d17ee5ff2da99
I20260709 13:12:37.473670 31821 raft_consensus.cc:3060] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.474079 31745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
mode: GRACEFUL
new_leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:12:37.474748 31745 raft_consensus.cc:606] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Received request to transfer leadership to TS bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.481082 32065 consensus_queue.cc:1048] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.483373 31745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
mode: GRACEFUL
new_leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:12:37.483939 31745 raft_consensus.cc:606] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Received request to transfer leadership to TS bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.494051 31745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b625653993504a8ab38f25e4536da86b"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
mode: GRACEFUL
new_leader_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:12:37.494592 31745 raft_consensus.cc:606] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Received request to transfer leadership to TS 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:37.544641 32065 consensus_queue.cc:1048] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.550392 31972 raft_consensus.cc:993] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: : Instructing follower bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:37.550873 32063 raft_consensus.cc:1081] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Signalling peer bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:37.553862 31819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53470
I20260709 13:12:37.554334 31819 raft_consensus.cc:493] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.554659 31819 raft_consensus.cc:3060] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.556275 32065 consensus_queue.cc:1048] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.561151 31819 raft_consensus.cc:515] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.563972 31745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:37.564132 31893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33dd7eb5dbd54688a2826d4fe39cef6d" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:37.565480 31819 leader_election.cc:290] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.564510 31745 raft_consensus.cc:3055] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.566283 31745 raft_consensus.cc:740] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.567180 31745 consensus_queue.cc:260] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.568326 31745 raft_consensus.cc:3060] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.573992 31745 raft_consensus.cc:2468] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 2.
I20260709 13:12:37.575040 31784 leader_election.cc:304] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:37.575811 32080 raft_consensus.cc:2804] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.576246 32080 raft_consensus.cc:697] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:37.577021 32080 consensus_queue.cc:237] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.581343 31972 consensus_queue.cc:1048] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.584228 31641 catalog_manager.cc:5697] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 1 to 2, leader changed from bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193) to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 2 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.585321 32080 consensus_queue.cc:1048] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.593241 31972 consensus_queue.cc:1048] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.599849 32063 raft_consensus.cc:993] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: : Instructing follower 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:37.605659 32063 raft_consensus.cc:1081] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Signalling peer 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:37.608487 31895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b625653993504a8ab38f25e4536da86b"
dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:60348
I20260709 13:12:37.608948 31895 raft_consensus.cc:493] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.609182 31895 raft_consensus.cc:3060] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.611168 31982 consensus_queue.cc:1048] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.616792 32065 consensus_queue.cc:1048] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.620254 32065 consensus_queue.cc:1048] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.615365 31895 raft_consensus.cc:515] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.624034 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625653993504a8ab38f25e4536da86b" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:37.624588 31746 raft_consensus.cc:3055] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.624898 31746 raft_consensus.cc:740] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.625665 31746 consensus_queue.cc:260] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.626338 31746 raft_consensus.cc:3060] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.630359 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625653993504a8ab38f25e4536da86b" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:37.634186 31895 leader_election.cc:290] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:37.641474 31746 raft_consensus.cc:2468] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 2.
I20260709 13:12:37.642923 31858 leader_election.cc:304] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: bfda2baa4b9d4151bca7437a6027a1fd
I20260709 13:12:37.643972 32022 raft_consensus.cc:2804] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.644457 32022 raft_consensus.cc:697] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Becoming Leader. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Running, Role: LEADER
I20260709 13:12:37.645282 32022 consensus_queue.cc:237] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.647320 32080 raft_consensus.cc:993] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: : Instructing follower bea62f58c7024abea16d17ee5ff2da99 to start an election
I20260709 13:12:37.647836 32082 raft_consensus.cc:1081] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Signalling peer bea62f58c7024abea16d17ee5ff2da99 to start an election
I20260709 13:12:37.648412 31972 raft_consensus.cc:993] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: : Instructing follower bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:37.648895 32063 raft_consensus.cc:1081] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Signalling peer bfda2baa4b9d4151bca7437a6027a1fd to start an election
I20260709 13:12:37.649781 31745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
 from {username='slave'} at 127.0.0.1:53248
I20260709 13:12:37.650854 31819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
 from {username='slave'} at 127.0.0.1:53470
I20260709 13:12:37.653039 31819 raft_consensus.cc:493] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.653415 31819 raft_consensus.cc:3060] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.656512 31745 raft_consensus.cc:493] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.657224 31745 raft_consensus.cc:3060] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.662842 31819 raft_consensus.cc:515] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.665216 31819 leader_election.cc:290] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.665470 31744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:37.666129 31744 raft_consensus.cc:3055] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.666446 31744 raft_consensus.cc:740] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.666522 31643 catalog_manager.cc:5697] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 reported cstate change: term changed from 1 to 2, leader changed from bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193) to 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195). New cstate: current_term: 2 leader_uuid: "65621217b5b7487f947e8cf35abb03e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.667239 31744 consensus_queue.cc:260] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.668654 31744 raft_consensus.cc:3060] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.671552 31745 raft_consensus.cc:515] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.672780 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a5e841eb92487a87c5767610b7114a" candidate_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:37.673276 31894 raft_consensus.cc:3060] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.673636 31745 leader_election.cc:290] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 2 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.674348 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:37.675236 31819 raft_consensus.cc:3055] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.675567 31819 raft_consensus.cc:740] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:37.676287 31819 consensus_queue.cc:260] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.677101 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3971ab99b9f44847ba4c517f14dd067d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:37.677386 31819 raft_consensus.cc:3060] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.677655 31895 raft_consensus.cc:3060] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.683768 31895 raft_consensus.cc:2468] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 2.
I20260709 13:12:37.683768 31819 raft_consensus.cc:2468] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 2.
I20260709 13:12:37.684880 31710 leader_election.cc:304] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:37.684924 31744 raft_consensus.cc:2468] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 2.
I20260709 13:12:37.685757 32065 raft_consensus.cc:2804] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.686254 32065 raft_consensus.cc:697] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 2 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.686393 31784 leader_election.cc:304] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:37.687361 32082 raft_consensus.cc:2804] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.687083 32065 consensus_queue.cc:237] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.687897 32082 raft_consensus.cc:697] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Becoming Leader. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:37.688719 32082 consensus_queue.cc:237] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.692185 31894 raft_consensus.cc:2468] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfda2baa4b9d4151bca7437a6027a1fd in term 2.
I20260709 13:12:37.694729 31643 catalog_manager.cc:5697] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 1 to 2, leader changed from bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194) to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.697059 31642 catalog_manager.cc:5697] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd reported cstate change: term changed from 1 to 2, leader changed from bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193) to bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194). New cstate: current_term: 2 leader_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.718307 32082 consensus_queue.cc:1048] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.729249 32052 consensus_queue.cc:1048] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.735575 32052 consensus_queue.cc:1048] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.750794 32052 consensus_queue.cc:1048] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.873356 32088 raft_consensus.cc:993] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: : Instructing follower bea62f58c7024abea16d17ee5ff2da99 to start an election
I20260709 13:12:37.874249 32088 raft_consensus.cc:1081] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 LEADER]: Signalling peer bea62f58c7024abea16d17ee5ff2da99 to start an election
I20260709 13:12:37.876802 31746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
 from {username='slave'} at 127.0.0.1:53250
I20260709 13:12:37.877933 31746 raft_consensus.cc:493] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.878551 31746 raft_consensus.cc:3060] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.887527 31746 raft_consensus.cc:515] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.889425 31746 leader_election.cc:290] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 2 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195:45255)
I20260709 13:12:37.890815 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
I20260709 13:12:37.891142 31819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5413e94e491f4ef280dd7427e8def45d" candidate_uuid: "bea62f58c7024abea16d17ee5ff2da99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:37.891683 31895 raft_consensus.cc:3055] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.891875 31819 raft_consensus.cc:3060] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.892060 31895 raft_consensus.cc:740] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Running, Role: LEADER
I20260709 13:12:37.893193 31895 consensus_queue.cc:260] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.895169 31895 raft_consensus.cc:3060] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.901610 31819 raft_consensus.cc:2468] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 2.
I20260709 13:12:37.903045 31710 leader_election.cc:304] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bea62f58c7024abea16d17ee5ff2da99, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:37.903954 32065 raft_consensus.cc:2804] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.904290 31895 raft_consensus.cc:2468] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea62f58c7024abea16d17ee5ff2da99 in term 2.
I20260709 13:12:37.904474 32065 raft_consensus.cc:697] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 2 LEADER]: Becoming Leader. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:37.905995 32065 consensus_queue.cc:237] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:37.914250 31643 catalog_manager.cc:5697] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 reported cstate change: term changed from 1 to 2, leader changed from 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195) to bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193). New cstate: current_term: 2 leader_uuid: "bea62f58c7024abea16d17ee5ff2da99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.973138 31746 raft_consensus.cc:1275] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.974228 32052 consensus_queue.cc:1048] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.982859 31895 raft_consensus.cc:3060] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.990545 31895 raft_consensus.cc:1275] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.991827 32080 consensus_queue.cc:1048] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.039469 31746 raft_consensus.cc:1275] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.040515 32088 consensus_queue.cc:1048] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.048545 31819 raft_consensus.cc:3060] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.058728 31819 raft_consensus.cc:1275] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.059852 32088 consensus_queue.cc:1048] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.121217 31895 raft_consensus.cc:1275] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.122365 32080 consensus_queue.cc:1048] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.130927 31746 raft_consensus.cc:1275] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer bfda2baa4b9d4151bca7437a6027a1fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.133148 32052 consensus_queue.cc:1048] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.160611 31895 raft_consensus.cc:1275] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Refusing update from remote peer bea62f58c7024abea16d17ee5ff2da99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.161800 31972 consensus_queue.cc:1048] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.170336 31819 raft_consensus.cc:1275] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Refusing update from remote peer bea62f58c7024abea16d17ee5ff2da99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.171741 31972 consensus_queue.cc:1048] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.427327 31895 raft_consensus.cc:1275] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Refusing update from remote peer bea62f58c7024abea16d17ee5ff2da99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.429068 32063 consensus_queue.cc:1048] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.439980 31819 raft_consensus.cc:1275] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Refusing update from remote peer bea62f58c7024abea16d17ee5ff2da99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.441584 31972 consensus_queue.cc:1048] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.497824 31643 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54318:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:12:40.517221 31643 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54318:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:12:40.557210 21775 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:40.696338 31821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77"
dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
mode: GRACEFUL
new_leader_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:53516
I20260709 13:12:40.697139 31821 raft_consensus.cc:606] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Received request to transfer leadership to TS 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:40.728246 32153 tablet.cc:1724] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.731940 32151 tablet.cc:1724] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.728080 32157 tablet.cc:1724] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.726255 32158 tablet.cc:1724] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.761337 32154 tablet.cc:1724] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.812889 32143 tablet.cc:1724] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.817592 32082 raft_consensus.cc:993] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd: : Instructing follower 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:40.838174 32082 raft_consensus.cc:1081] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Signalling peer 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:40.864672 32151 tablet.cc:1724] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.871167 32153 tablet.cc:1724] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:40.923897 31711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45255, user_credentials={real_user=slave}} blocked reactor thread for 122219us
W20260709 13:12:40.891355 31786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.67.195:45255, user_credentials={real_user=slave}} blocked reactor thread for 45437.2us
I20260709 13:12:40.969091 32158 tablet.cc:1724] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.973671 31740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75"
dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
mode: GRACEFUL
new_leader_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:53270
I20260709 13:12:40.974344 31740 raft_consensus.cc:606] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Received request to transfer leadership to TS 65621217b5b7487f947e8cf35abb03e0
I20260709 13:12:40.979105 31895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77"
dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:60344
I20260709 13:12:40.979882 31895 raft_consensus.cc:493] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:40.980244 31895 raft_consensus.cc:3060] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.984522 32184 tablet.cc:1724] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.989223 32065 raft_consensus.cc:993] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99: : Instructing follower 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:41.005218 32157 tablet.cc:1724] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.018626 32181 tablet.cc:1724] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:40.994400 32178 tablet.cc:1724] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.000525 32154 tablet.cc:1724] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:41.044703 32168 log.cc:927] Time spent T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: Append to log took a long time: real 0.122s	user 0.006s	sys 0.000s
I20260709 13:12:41.046978 32143 tablet.cc:1724] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.049611 32155 raft_consensus.cc:1081] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Signalling peer 65621217b5b7487f947e8cf35abb03e0 to start an election
I20260709 13:12:41.052711 31895 raft_consensus.cc:515] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:40.985510 32186 tablet.cc:1724] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.062603 21775 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:41.063366 31895 leader_election.cc:290] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Requested vote from peers bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355), bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253)
I20260709 13:12:41.064215 21775 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:41.067027 31746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:41.067734 31746 raft_consensus.cc:3060] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.069643 31894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75"
dest_uuid: "65621217b5b7487f947e8cf35abb03e0"
 from {username='slave'} at 127.0.0.1:60348
I20260709 13:12:41.070214 31894 raft_consensus.cc:493] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:41.070549 31894 raft_consensus.cc:3060] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.076117 31746 raft_consensus.cc:2468] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 2.
I20260709 13:12:41.076242 31820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c876f874224fbbb54617d8a4598b77" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:41.076968 31820 raft_consensus.cc:3055] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:41.077272 31820 raft_consensus.cc:740] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bfda2baa4b9d4151bca7437a6027a1fd, State: Running, Role: LEADER
I20260709 13:12:41.077390 32158 tablet.cc:1724] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.078137 31820 consensus_queue.cc:260] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:41.082312 31858 leader_election.cc:304] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bea62f58c7024abea16d17ee5ff2da99; no voters: 
I20260709 13:12:41.083328 32174 raft_consensus.cc:2804] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.083027 31894 raft_consensus.cc:515] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:41.083839 32174 raft_consensus.cc:697] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Becoming Leader. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Running, Role: LEADER
I20260709 13:12:41.084692 32174 consensus_queue.cc:237] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } }
I20260709 13:12:41.087380 31821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfda2baa4b9d4151bca7437a6027a1fd"
I20260709 13:12:41.087989 31821 raft_consensus.cc:3060] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.103943 31894 leader_election.cc:290] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Requested vote from peers bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253), bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355)
I20260709 13:12:41.104650 32157 tablet.cc:1724] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.109901 31744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf0d653caa4e7788fb5a3a573cac75" candidate_uuid: "65621217b5b7487f947e8cf35abb03e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bea62f58c7024abea16d17ee5ff2da99"
I20260709 13:12:41.110553 31744 raft_consensus.cc:3055] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:41.110888 31744 raft_consensus.cc:740] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bea62f58c7024abea16d17ee5ff2da99, State: Running, Role: LEADER
I20260709 13:12:41.112172 31744 consensus_queue.cc:260] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:41.113528 31744 raft_consensus.cc:3060] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.118709 32153 tablet.cc:1724] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.113941 32183 tablet.cc:1724] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.133783 32186 tablet.cc:1724] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.079618 31820 raft_consensus.cc:3060] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.123976 32157 tablet.cc:1724] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.125999 32154 tablet.cc:1724] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.147884 32187 tablet.cc:1724] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.152846 31821 raft_consensus.cc:2468] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 2.
I20260709 13:12:41.100129 32181 tablet.cc:1724] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.155224 31859 leader_election.cc:304] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65621217b5b7487f947e8cf35abb03e0, bfda2baa4b9d4151bca7437a6027a1fd; no voters: 
I20260709 13:12:41.156430 32171 raft_consensus.cc:2804] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.157119 32171 raft_consensus.cc:697] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Becoming Leader. State: Replica: 65621217b5b7487f947e8cf35abb03e0, State: Running, Role: LEADER
I20260709 13:12:41.158048 32171 consensus_queue.cc:237] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } }
I20260709 13:12:41.166498 31820 raft_consensus.cc:2468] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 2.
I20260709 13:12:41.163540 32153 tablet.cc:1724] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.175287 31643 catalog_manager.cc:5697] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 reported cstate change: term changed from 1 to 2, leader changed from bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194) to 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195). New cstate: current_term: 2 leader_uuid: "65621217b5b7487f947e8cf35abb03e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:41.190606 31744 raft_consensus.cc:2468] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65621217b5b7487f947e8cf35abb03e0 in term 2.
I20260709 13:12:41.196898 32186 tablet.cc:1724] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:41.209596 31642 catalog_manager.cc:6242] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b: soft_deleted_table [id=609c316fd90e41b69be8c86980e2d630] alter complete (version 1)
I20260709 13:12:41.221597 31642 catalog_manager.cc:5697] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 reported cstate change: term changed from 1 to 2, leader changed from bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193) to 65621217b5b7487f947e8cf35abb03e0 (127.21.67.195). New cstate: current_term: 2 leader_uuid: "65621217b5b7487f947e8cf35abb03e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65621217b5b7487f947e8cf35abb03e0" member_type: VOTER last_known_addr { host: "127.21.67.195" port: 45255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.582831 31820 raft_consensus.cc:1275] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.583959 32171 consensus_queue.cc:1048] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.595413 31744 raft_consensus.cc:1275] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.596693 32171 consensus_queue.cc:1048] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.657444 31820 raft_consensus.cc:1275] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.658582 32171 consensus_queue.cc:1048] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfda2baa4b9d4151bca7437a6027a1fd" member_type: VOTER last_known_addr { host: "127.21.67.194" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.667220 31744 raft_consensus.cc:1275] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Refusing update from remote peer 65621217b5b7487f947e8cf35abb03e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.669066 32174 consensus_queue.cc:1048] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea62f58c7024abea16d17ee5ff2da99" member_type: VOTER last_known_addr { host: "127.21.67.193" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:42.120350 21775 tablet_server.cc:179] TabletServer@127.21.67.193:0 shutting down...
W20260709 13:12:42.124030 31784 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:12:42.129765 31784 consensus_peers.cc:597] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd -> Peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Couldn't send request to peer bea62f58c7024abea16d17ee5ff2da99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.151499 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:42.152339 21775 tablet_replica.cc:333] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.153195 21775 raft_consensus.cc:2243] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.153656 21775 raft_consensus.cc:2272] T 123bf927b48d40fab2ce8636284c855d P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.156314 21775 tablet_replica.cc:333] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.156927 21775 raft_consensus.cc:2243] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.157366 21775 raft_consensus.cc:2272] T b625653993504a8ab38f25e4536da86b P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.159343 21775 tablet_replica.cc:333] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.160028 21775 raft_consensus.cc:2243] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.160776 21775 raft_consensus.cc:2272] T 5413e94e491f4ef280dd7427e8def45d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.163764 21775 tablet_replica.cc:333] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.164393 21775 raft_consensus.cc:2243] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.164835 21775 raft_consensus.cc:2272] T 33dd7eb5dbd54688a2826d4fe39cef6d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.167092 21775 tablet_replica.cc:333] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.167723 21775 raft_consensus.cc:2243] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.168259 21775 raft_consensus.cc:2272] T 6d4cbf2965614445bba5f7b85958d417 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.170854 21775 tablet_replica.cc:333] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.171418 21775 raft_consensus.cc:2243] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.172181 21775 raft_consensus.cc:2272] T 988d7fdb723d4149910c89b3124ca071 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.174046 21775 tablet_replica.cc:333] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.174656 21775 raft_consensus.cc:2243] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.175100 21775 raft_consensus.cc:2272] T cac5ecff68444a5783240e5e35c7c4ca P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.177304 21775 tablet_replica.cc:333] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.177875 21775 raft_consensus.cc:2243] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.178330 21775 raft_consensus.cc:2272] T 0f8bea6824254217bef7c7d9f07bf0b6 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.180279 21775 tablet_replica.cc:333] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.180807 21775 raft_consensus.cc:2243] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.181543 21775 raft_consensus.cc:2272] T 372fb0be4269425288939f7776ff0767 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.183598 21775 tablet_replica.cc:333] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.184120 21775 raft_consensus.cc:2243] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.184460 21775 raft_consensus.cc:2272] T d3bf0d653caa4e7788fb5a3a573cac75 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.186627 21775 tablet_replica.cc:333] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.187111 21775 raft_consensus.cc:2243] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.187889 21775 raft_consensus.cc:2272] T 8862505b4bc84982b8da0d0ca08acaae P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.190161 21775 tablet_replica.cc:333] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.190719 21775 raft_consensus.cc:2243] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.191143 21775 raft_consensus.cc:2272] T c6a5e841eb92487a87c5767610b7114a P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.193104 21775 tablet_replica.cc:333] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.193619 21775 raft_consensus.cc:2243] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.194032 21775 raft_consensus.cc:2272] T 4dbca3802d824aadba6ef70655e16a1d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.196193 21775 tablet_replica.cc:333] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.196863 21775 raft_consensus.cc:2243] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.197841 21775 raft_consensus.cc:2272] T b800469e506e4ca5bf477e2d3a3f58ff P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.199968 21775 tablet_replica.cc:333] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.200462 21775 raft_consensus.cc:2243] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.201113 21775 raft_consensus.cc:2272] T 3971ab99b9f44847ba4c517f14dd067d P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.203421 21775 tablet_replica.cc:333] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.204129 21775 raft_consensus.cc:2243] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.204723 21775 raft_consensus.cc:2272] T 96ba567cb7dc46c0907c9346ba85ce94 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.207023 31784 consensus_peers.cc:597] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd -> Peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Couldn't send request to peer bea62f58c7024abea16d17ee5ff2da99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.207433 21775 tablet_replica.cc:333] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.208082 21775 raft_consensus.cc:2243] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:42.208417 31784 consensus_peers.cc:597] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd -> Peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Couldn't send request to peer bea62f58c7024abea16d17ee5ff2da99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.209039 21775 raft_consensus.cc:2272] T d4aa14eee1574e538a5bf17ca3f34e37 P bea62f58c7024abea16d17ee5ff2da99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.210976 21775 tablet_replica.cc:333] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99: stopping tablet replica
I20260709 13:12:42.211447 21775 raft_consensus.cc:2243] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.211906 21775 raft_consensus.cc:2272] T 47c876f874224fbbb54617d8a4598b77 P bea62f58c7024abea16d17ee5ff2da99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.240911 21775 tablet_server.cc:196] TabletServer@127.21.67.193:0 shutdown complete.
W20260709 13:12:42.275396 31858 consensus_peers.cc:597] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 -> Peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Couldn't send request to peer bea62f58c7024abea16d17ee5ff2da99. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:35355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.279419 21775 tablet_server.cc:179] TabletServer@127.21.67.194:0 shutting down...
I20260709 13:12:42.306408 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:42.307083 21775 tablet_replica.cc:333] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.307806 21775 raft_consensus.cc:2243] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.308348 21775 raft_consensus.cc:2272] T d4aa14eee1574e538a5bf17ca3f34e37 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.310397 21775 tablet_replica.cc:333] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.310984 21775 raft_consensus.cc:2243] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.311403 21775 raft_consensus.cc:2272] T 988d7fdb723d4149910c89b3124ca071 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.313290 21775 tablet_replica.cc:333] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.313832 21775 raft_consensus.cc:2243] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.314548 21775 raft_consensus.cc:2272] T 6d4cbf2965614445bba5f7b85958d417 P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.316358 21775 tablet_replica.cc:333] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.316895 21775 raft_consensus.cc:2243] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.317639 21775 raft_consensus.cc:2272] T 123bf927b48d40fab2ce8636284c855d P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.319509 21775 tablet_replica.cc:333] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.320107 21775 raft_consensus.cc:2243] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.320502 21775 raft_consensus.cc:2272] T b625653993504a8ab38f25e4536da86b P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.322242 21775 tablet_replica.cc:333] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.322778 21775 raft_consensus.cc:2243] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.323491 21775 raft_consensus.cc:2272] T cac5ecff68444a5783240e5e35c7c4ca P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.325453 21775 tablet_replica.cc:333] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.325984 21775 raft_consensus.cc:2243] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.326371 21775 raft_consensus.cc:2272] T 0f8bea6824254217bef7c7d9f07bf0b6 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.328249 21775 tablet_replica.cc:333] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.328759 21775 raft_consensus.cc:2243] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.329218 21775 raft_consensus.cc:2272] T 3971ab99b9f44847ba4c517f14dd067d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.330991 21775 tablet_replica.cc:333] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.331473 21775 raft_consensus.cc:2243] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.332213 21775 raft_consensus.cc:2272] T 96ba567cb7dc46c0907c9346ba85ce94 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.334026 21775 tablet_replica.cc:333] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.334601 21775 raft_consensus.cc:2243] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.335146 21775 raft_consensus.cc:2272] T 372fb0be4269425288939f7776ff0767 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.337111 21775 tablet_replica.cc:333] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.337689 21775 raft_consensus.cc:2243] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.338486 21775 raft_consensus.cc:2272] T 4dbca3802d824aadba6ef70655e16a1d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.340410 21775 tablet_replica.cc:333] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.340937 21775 raft_consensus.cc:2243] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.341615 21775 raft_consensus.cc:2272] T c6a5e841eb92487a87c5767610b7114a P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.343307 21775 tablet_replica.cc:333] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.343881 21775 raft_consensus.cc:2243] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.344259 21775 raft_consensus.cc:2272] T 47c876f874224fbbb54617d8a4598b77 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.347095 21775 tablet_replica.cc:333] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.347594 21775 raft_consensus.cc:2243] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.348081 21775 raft_consensus.cc:2272] T 8862505b4bc84982b8da0d0ca08acaae P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.350081 21775 tablet_replica.cc:333] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.350577 21775 raft_consensus.cc:2243] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.351271 21775 raft_consensus.cc:2272] T 33dd7eb5dbd54688a2826d4fe39cef6d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.353101 21775 tablet_replica.cc:333] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.353580 21775 raft_consensus.cc:2243] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.353972 21775 raft_consensus.cc:2272] T 5413e94e491f4ef280dd7427e8def45d P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.355779 21775 tablet_replica.cc:333] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.356238 21775 raft_consensus.cc:2243] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.356626 21775 raft_consensus.cc:2272] T d3bf0d653caa4e7788fb5a3a573cac75 P bfda2baa4b9d4151bca7437a6027a1fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.358798 21775 tablet_replica.cc:333] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd: stopping tablet replica
I20260709 13:12:42.359239 21775 raft_consensus.cc:2243] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.359643 21775 raft_consensus.cc:2272] T b800469e506e4ca5bf477e2d3a3f58ff P bfda2baa4b9d4151bca7437a6027a1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.397624 21775 tablet_server.cc:196] TabletServer@127.21.67.194:0 shutdown complete.
W20260709 13:12:42.428944 31859 consensus_peers.cc:597] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 -> Peer bfda2baa4b9d4151bca7437a6027a1fd (127.21.67.194:38253): Couldn't send request to peer bfda2baa4b9d4151bca7437a6027a1fd. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.194:38253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.432127 21775 tablet_server.cc:179] TabletServer@127.21.67.195:0 shutting down...
I20260709 13:12:42.456624 21775 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:42.457262 21775 tablet_replica.cc:333] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.457870 21775 raft_consensus.cc:2243] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.458320 21775 raft_consensus.cc:2272] T 6d4cbf2965614445bba5f7b85958d417 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.460251 21775 tablet_replica.cc:333] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.460813 21775 raft_consensus.cc:2243] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.461236 21775 raft_consensus.cc:2272] T 988d7fdb723d4149910c89b3124ca071 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.463909 21775 tablet_replica.cc:333] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.464661 21775 raft_consensus.cc:2243] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.465169 21775 raft_consensus.cc:2272] T d4aa14eee1574e538a5bf17ca3f34e37 P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.465883 31858 consensus_peers.cc:597] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 -> Peer bea62f58c7024abea16d17ee5ff2da99 (127.21.67.193:35355): Couldn't send request to peer bea62f58c7024abea16d17ee5ff2da99. Status: Network error: Client connection negotiation failed: client connection to 127.21.67.193:35355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.467311 21775 tablet_replica.cc:333] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.467962 21775 raft_consensus.cc:2243] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.468349 21775 raft_consensus.cc:2272] T 123bf927b48d40fab2ce8636284c855d P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.470171 21775 tablet_replica.cc:333] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.470644 21775 raft_consensus.cc:2243] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.471371 21775 raft_consensus.cc:2272] T b625653993504a8ab38f25e4536da86b P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.473217 21775 tablet_replica.cc:333] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.473716 21775 raft_consensus.cc:2243] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.474048 21775 raft_consensus.cc:2272] T 3971ab99b9f44847ba4c517f14dd067d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.475852 21775 tablet_replica.cc:333] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.476351 21775 raft_consensus.cc:2243] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.476693 21775 raft_consensus.cc:2272] T 96ba567cb7dc46c0907c9346ba85ce94 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.478538 21775 tablet_replica.cc:333] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.479018 21775 raft_consensus.cc:2243] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.479377 21775 raft_consensus.cc:2272] T 372fb0be4269425288939f7776ff0767 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.481330 21775 tablet_replica.cc:333] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.481758 21775 raft_consensus.cc:2243] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.482100 21775 raft_consensus.cc:2272] T cac5ecff68444a5783240e5e35c7c4ca P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.484036 21775 tablet_replica.cc:333] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.484486 21775 raft_consensus.cc:2243] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.485195 21775 raft_consensus.cc:2272] T 0f8bea6824254217bef7c7d9f07bf0b6 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.487044 21775 tablet_replica.cc:333] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.487475 21775 raft_consensus.cc:2243] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.488127 21775 raft_consensus.cc:2272] T 47c876f874224fbbb54617d8a4598b77 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.490254 21775 tablet_replica.cc:333] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.490694 21775 raft_consensus.cc:2243] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.491050 21775 raft_consensus.cc:2272] T c6a5e841eb92487a87c5767610b7114a P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.492729 21775 tablet_replica.cc:333] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.493171 21775 raft_consensus.cc:2243] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.493520 21775 raft_consensus.cc:2272] T 4dbca3802d824aadba6ef70655e16a1d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.495136 21775 tablet_replica.cc:333] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.495534 21775 raft_consensus.cc:2243] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.495862 21775 raft_consensus.cc:2272] T b800469e506e4ca5bf477e2d3a3f58ff P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.497619 21775 tablet_replica.cc:333] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.498029 21775 raft_consensus.cc:2243] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.498358 21775 raft_consensus.cc:2272] T 8862505b4bc84982b8da0d0ca08acaae P 65621217b5b7487f947e8cf35abb03e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.500139 21775 tablet_replica.cc:333] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.500560 21775 raft_consensus.cc:2243] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.500910 21775 raft_consensus.cc:2272] T 33dd7eb5dbd54688a2826d4fe39cef6d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.502535 21775 tablet_replica.cc:333] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.502902 21775 raft_consensus.cc:2243] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.503247 21775 raft_consensus.cc:2272] T 5413e94e491f4ef280dd7427e8def45d P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.504833 21775 tablet_replica.cc:333] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0: stopping tablet replica
I20260709 13:12:42.505196 21775 raft_consensus.cc:2243] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.505800 21775 raft_consensus.cc:2272] T d3bf0d653caa4e7788fb5a3a573cac75 P 65621217b5b7487f947e8cf35abb03e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.533802 21775 tablet_server.cc:196] TabletServer@127.21.67.195:0 shutdown complete.
I20260709 13:12:42.563446 21775 master.cc:562] Master@127.21.67.254:42149 shutting down...
I20260709 13:12:42.587059 21775 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.587589 21775 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.587989 21775 tablet_replica.cc:333] T 00000000000000000000000000000000 P d1fe50de32524dd1ae081a3305911a2b: stopping tablet replica
I20260709 13:12:42.607735 21775 master.cc:584] Master@127.21.67.254:42149 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11035 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23268 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (292269 ms total)
[  PASSED  ] 8 tests.
I20260709 13:12:42.659585 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 395 messages since previous log ~14 seconds ago
I20260709 13:12:42.659929 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 395 messages since previous log ~14 seconds ago
I20260709 13:12:42.660121 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 394 messages since previous log ~14 seconds ago
I20260709 13:12:42.660320 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:12:42.660501 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:12:42.660696 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~163 seconds ago
I20260709 13:12:42.660895 21775 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~168 seconds ago
I20260709 13:12:42.661119 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~169 seconds ago
I20260709 13:12:42.661393 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:12:42.661679 21775 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
